-- Logs begin at Thu 2022-08-04 09:40:56 UTC, end at Thu 2022-08-04 10:52:19 UTC. -- Aug 04 10:10:34.986110 dv-cinder-826608-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 04 10:10:34.993898 dv-cinder-826608-8-smb devstack@keystone.service[80108]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 04 10:10:34.995915 dv-cinder-826608-8-smb devstack@keystone.service[80108]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 10:10:34 2022] *** Aug 04 10:10:34.995915 dv-cinder-826608-8-smb devstack@keystone.service[80108]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 10:10:34.995915 dv-cinder-826608-8-smb devstack@keystone.service[80108]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 10:10:34.995915 dv-cinder-826608-8-smb devstack@keystone.service[80108]: nodename: dv-cinder-826608-8-smb Aug 04 10:10:34.996220 dv-cinder-826608-8-smb devstack@keystone.service[80108]: machine: x86_64 Aug 04 10:10:34.996220 dv-cinder-826608-8-smb devstack@keystone.service[80108]: clock source: unix Aug 04 10:10:34.996220 dv-cinder-826608-8-smb devstack@keystone.service[80108]: pcre jit disabled Aug 04 10:10:34.996220 dv-cinder-826608-8-smb devstack@keystone.service[80108]: detected number of CPU cores: 4 Aug 04 10:10:34.996220 dv-cinder-826608-8-smb devstack@keystone.service[80108]: current working directory: / Aug 04 10:10:34.996220 dv-cinder-826608-8-smb devstack@keystone.service[80108]: detected binary path: /usr/bin/uwsgi-core Aug 04 10:10:34.996220 dv-cinder-826608-8-smb devstack@keystone.service[80108]: your processes number limit is 47680 Aug 04 10:10:34.996220 dv-cinder-826608-8-smb devstack@keystone.service[80108]: your memory page size is 4096 bytes Aug 04 10:10:34.996220 dv-cinder-826608-8-smb devstack@keystone.service[80108]: detected max file descriptor number: 2048 Aug 04 10:10:34.996220 dv-cinder-826608-8-smb devstack@keystone.service[80108]: lock engine: pthread robust mutexes Aug 04 10:10:34.996220 dv-cinder-826608-8-smb devstack@keystone.service[80108]: thunder lock: enabled Aug 04 10:10:34.998449 dv-cinder-826608-8-smb devstack@keystone.service[80108]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 04 10:10:34.998449 dv-cinder-826608-8-smb devstack@keystone.service[80108]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 10:10:35.036946 dv-cinder-826608-8-smb devstack@keystone.service[80108]: Python main interpreter initialized at 0x55b04b56f9c0 Aug 04 10:10:35.036946 dv-cinder-826608-8-smb devstack@keystone.service[80108]: python threads support enabled Aug 04 10:10:35.036946 dv-cinder-826608-8-smb devstack@keystone.service[80108]: your server socket listen backlog is limited to 100 connections Aug 04 10:10:35.036946 dv-cinder-826608-8-smb devstack@keystone.service[80108]: your mercy for graceful operations on workers is 90 seconds Aug 04 10:10:35.037306 dv-cinder-826608-8-smb devstack@keystone.service[80108]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 10:10:35.037400 dv-cinder-826608-8-smb devstack@keystone.service[80108]: *** Operational MODE: preforking *** Aug 04 10:10:35.037674 dv-cinder-826608-8-smb devstack@keystone.service[80108]: *** uWSGI is running in multiple interpreter mode *** Aug 04 10:10:35.037674 dv-cinder-826608-8-smb devstack@keystone.service[80108]: spawned uWSGI master process (pid: 80108) Aug 04 10:10:35.037880 dv-cinder-826608-8-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 04 10:10:35.044198 dv-cinder-826608-8-smb devstack@keystone.service[80108]: spawned uWSGI worker 1 (pid: 80116, cores: 1) Aug 04 10:10:35.044198 dv-cinder-826608-8-smb devstack@keystone.service[80108]: spawned uWSGI worker 2 (pid: 80117, cores: 1) Aug 04 10:10:35.044198 dv-cinder-826608-8-smb devstack@keystone.service[80108]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 10:10:40.566899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:10:40.566899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: from cryptography.utils import int_from_bytes Aug 04 10:10:40.567758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:10:40.567758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: from cryptography.utils import int_from_bytes Aug 04 10:10:40.568212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:10:40.568212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: from cryptography.utils import int_from_bytes Aug 04 10:10:40.568332 dv-cinder-826608-8-smb devstack@keystone.service[80116]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:10:40.568332 dv-cinder-826608-8-smb devstack@keystone.service[80116]: from cryptography.utils import int_from_bytes Aug 04 10:10:40.617739 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 10:10:40.618004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 10:10:40.618111 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 10:10:40.618191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] command line args: [] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 10:10:40.618258 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 10:10:40.618323 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] command line args: [] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 10:10:40.618380 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 10:10:40.618575 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ================================================================================ {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 10:10:40.618656 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 10:10:40.618793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ================================================================================ {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 10:10:40.618870 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] admin_token = **** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.618996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] admin_token = **** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.619080 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] config_dir = [] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.619227 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.619306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] config_dir = [] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.619366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] config_source = [] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.619430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.619591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] debug = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.619678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] config_source = [] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.619741 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.620018 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] debug = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.620018 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.620191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.620271 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.620338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.620402 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.620614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.620703 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.620776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.620914 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.620998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] list_limit = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.621130 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] list_limit = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.621213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] log_config_append = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.621279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] log_config_append = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.621346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.621490 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.621623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] log_dir = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.621755 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] log_dir = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.621883 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] log_file = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.622094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] log_file = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.622323 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.622491 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.622691 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.622884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.623076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.623274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.623505 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.623677 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.623874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.624589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.624742 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.624875 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.625013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.625153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.625236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.625311 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.625439 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.625515 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.625636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.625712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.625838 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.625914 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.626037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.626112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.626233 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.626314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.626386 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.626457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.626457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.626643 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.626763 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.626843 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.626923 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] publish_errors = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.627000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] publish_errors = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.627076 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.627146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.627222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.627346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.627421 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.627497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.627567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.627654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.627737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.627809 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.627884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] standard_threads = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.627961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] standard_threads = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.628038 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.628158 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.628293 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.628368 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.628482 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.628556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.628643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] use_journal = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.628716 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] use_journal = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.628787 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] use_json = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.628862 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] use_json = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.628934 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] use_stderr = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.629010 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] use_stderr = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.629088 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] use_syslog = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.629163 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] use_syslog = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.629239 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.629331 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:10:40.629461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.629586 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.629700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.629778 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.629849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.629849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.629974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.630043 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.630174 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.630256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.630329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.630399 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.630474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.630601 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.630690 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.630853 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.630940 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.631107 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.631188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.631361 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.631453 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.631603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.631693 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.631855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.631935 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.632095 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.632201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.632382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.632469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.632639 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.632727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.632881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.633040 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.633141 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.633220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.633401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.633484 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.633650 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.633739 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.633891 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.633977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.634146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.634223 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.634415 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.634500 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.634673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.634757 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.634926 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.635006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.635165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.635252 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.635402 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.635480 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.635638 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.635717 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.635877 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.635957 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.636121 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.636218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.636399 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.636477 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.636638 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.636717 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.636875 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.636961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.637122 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.637205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.637373 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.637451 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.637615 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.637700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.637871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.637953 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.638107 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.638185 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.638349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.638433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.638590 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.638674 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.638830 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.638905 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.639051 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.639135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.639287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.639365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.639524 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.639606 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.639763 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.639839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.640015 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.640091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.640275 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.640356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.640522 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.640599 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.640758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.640837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.641002 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.641081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.641243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.641320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.641486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.641563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.641722 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.641799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.641952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.642036 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.642196 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.642310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.642439 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.642550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.642681 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.642786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.642922 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.643027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.643160 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.643273 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.643413 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.643515 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.643666 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.643812 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.643988 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.644289 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.644444 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.644657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.644846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.645064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.645285 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.645558 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.645946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.646097 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.646270 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.646442 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.646620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.646793 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.646974 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.647152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.647323 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.647493 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.647664 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.647845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.648016 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.648156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.648332 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.648474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.648619 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.648748 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.648893 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.649007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.649121 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.649261 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.649377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.649500 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.649615 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.649728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.649842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.649982 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.650099 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.650222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.650338 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.650338 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.650551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.650665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.650778 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.650899 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.651015 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.651129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.651242 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.651387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.651500 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.651626 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.651741 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.651855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.651976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.652098 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.652291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.652488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.652616 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.652732 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.652845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.652957 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.653072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.653193 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.653316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.653446 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.653561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.653675 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.653788 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.653936 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.654078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.654203 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.654319 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.654433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.654546 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.654660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.654782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.654905 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.655021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.655136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.655249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.655362 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.655482 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.655606 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.655722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.655835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.655948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.656062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] auth.external = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.656199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.656316 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.656429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.656542 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.656657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] auth.external = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.656771 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.656923 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.657039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] auth.password = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.657039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] auth.token = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.657267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.657382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.657496 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.657610 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.657724 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] auth.password = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.657846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.657970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] auth.token = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.658086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.658200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.658315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.658430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.658555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.658671 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.658786 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.658906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.659028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] credential.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.659143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.659266 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.659383 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.659498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.659612 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.659726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.659840 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] credential.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.659962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.660078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.660218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.660336 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.660451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.661097 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.661229 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.661542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.661661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.661776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.661892 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.662006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.662130 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.662246 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.662361 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.662485 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.662601 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.662716 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.662839 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.663287 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.663416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.663533 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.663533 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.663757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.663881 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.663998 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] federation.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.664119 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.664253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.664369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.664484 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.664613 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] federation.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.664731 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.664846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.664961 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.665076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.665190 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.665314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.665430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.665544 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.665660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.665775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.665890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.666013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.666129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.666251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.666374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.666489 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.666604 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.666728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.666851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.666967 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.667081 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.667196 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.667320 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.667508 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.667626 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.667743 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.667857 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.667962 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.668087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.668244 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.668362 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.668477 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.668591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.668716 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.668843 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.668960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.669074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.669189 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.669302 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.669417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.669539 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.669655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.669769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.669885 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.669999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.670114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.670237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.670353 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.670467 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.670581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.670695 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.670818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.670944 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.671061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.671176 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.671291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.671405 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.671519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.671643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.671759 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.671874 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.671990 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.672104 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.672232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.672362 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.672478 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.672593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.672714 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.672830 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.672945 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.673068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.673185 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.673302 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.673418 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.673532 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.673646 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.673768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.673891 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.674008 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.674122 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.674236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.674351 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.674473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.674589 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.674704 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.674818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.674938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.674938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.675163 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.675280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.675394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.675508 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.675622 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.675736 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.675859 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.675859 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.676083 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.676323 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.676961 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.677108 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.677272 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.677420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.677565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.677718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.677864 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.678010 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.678182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.678339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.678494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.678647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.678803 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.678956 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.679120 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.679278 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.679431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.679596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.679757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.679906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.680061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.680226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.680375 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.680521 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.680667 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.680812 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.680978 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.681140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.681300 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.681462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.681621 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.681792 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.681953 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.682112 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.682302 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.682445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.682561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.682689 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.682806 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.682920 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.683035 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.683149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.683263 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.683391 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.683508 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.683612 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.683725 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.683839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.683952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.684074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.684219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.684337 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.684451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.684567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.684567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.684793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.684910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.685270 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.685270 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.685493 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.685611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.685733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.685849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.685964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.686078 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.686192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.686306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.686429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.686545 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.686660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.686774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.686889 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.687002 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.687125 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.687240 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.687355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.687469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.687583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.687739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.687865 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.687981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.688095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.688095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.688325 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.688440 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.688565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.688736 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.688855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.688969 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.689083 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.689204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.689332 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.689448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.689563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.689677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.689792 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.689906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.690029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] resource.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.690146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.690260 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.690374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] resource.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.690489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.690603 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.690726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.690843 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.690958 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.691072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.691187 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.691301 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.691424 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.691540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.691654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.691767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.692025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.692152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.692397 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.692516 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.692632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] role.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.692746 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.692860 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] role.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.692975 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] role.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.693097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.693214 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] role.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.693332 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.693486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.693604 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.693720 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.693843 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.693960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.694076 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.694190 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.694305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.694427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.694543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.694657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.694772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.694886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.695002 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.695123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.695239 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.695354 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.695354 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.695568 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.695682 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.695805 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.695922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.696040 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.696040 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.696271 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.696271 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.696499 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.696499 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.696716 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.696831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.697194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.697317 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.697441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.697559 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.697673 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.697673 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.697888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.697888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.698111 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.698111 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.698328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.698442 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.698557 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.698672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.698795 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.698911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.699025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.699139 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.699255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.699369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.699492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.699608 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.699723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.699837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.699952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.700074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.700205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.700322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.700437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.700552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.700666 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.700792 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.700908 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.701022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.701136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] token.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.701251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] token.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.701366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.701489 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.701604 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.701719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.701833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.701948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.702062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.702184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.702300 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.702415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.702530 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.702644 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.702758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.702881 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.702998 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.703112 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.703227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.703346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.703468 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.703592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.703709 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.703823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.703937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.704052 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.704212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.704342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.704460 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.704584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.704700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.704814 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.704928 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.705050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.705050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.705266 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.705380 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.connection = **** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.705504 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.connection = **** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.705633 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.705758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.705875 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.705990 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.706114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.706230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.706345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.706459 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.706574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.706688 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.706810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.706926 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.707041 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.707156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.707270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.707385 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.707508 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.707625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.707740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.707861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.707977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.708091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.708237 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.708355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.708470 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.708585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.708700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.708815 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.708938 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.709055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.709170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.709284 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.709399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.709513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.709635 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.709752 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:10:40.709867 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 10:10:40.709981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 10:10:40.734941 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.735073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.735169 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.735276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.735385 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.735507 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.744408 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.744713 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.774311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.774534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.776424 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.776664 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.828092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.828260 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.880361 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.880599 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.880696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.880921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.945814 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.946041 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.946127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.946261 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.946370 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.946480 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.946564 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.946696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.946779 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.946911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.947001 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.947130 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.970287 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.970518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.970745 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.970848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.970971 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.971081 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.971191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.971315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.971406 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.971548 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.971629 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.971777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.972010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.972261 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.983161 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.983810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.995878 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.996058 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.996148 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.996328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.996415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.996559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.996645 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.996778 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.996870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.996993 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.997077 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.997205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.997289 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:40.997422 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 10:10:41.014161 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.014390 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 10:10:41.014572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.014742 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.014824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 10:10:41.014959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 10:10:41.015120 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.015241 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.015322 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 10:10:41.015514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.015605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.015770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.015852 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.016039 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.016122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.016357 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.026664 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.026941 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.027029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.027215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.027299 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.027502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.027595 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.027853 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.034478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.035285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.040209 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.040499 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.040789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.041072 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.041155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.041353 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.041446 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.041613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.041696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.041881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.041964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.042156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.042238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.042431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.042517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.042701 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.042789 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.042968 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.043050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.043282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.043574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.043856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.066339 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.067953 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.068259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.068346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.069773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.070051 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.072906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.073226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.073645 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.074639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.074916 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.075194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.080491 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.080725 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.081823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.082102 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.085446 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.085739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.086024 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.086314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.086587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.086877 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.086958 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.087158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.087241 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.087433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.087524 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.087737 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.088009 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.088328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.088606 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.088882 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.104245 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.104537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.105430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.105705 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.108504 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.109690 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.111869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.112216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.112838 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.113133 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.117860 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.118035 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.121299 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.121603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.124469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.124764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.124847 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.125043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.125153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.125319 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.125448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.125588 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.125745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.125873 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.126036 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.126319 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.142511 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.142791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.143060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.143329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.143567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.143856 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.144129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.144433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.150259 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.151647 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.151822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.152046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.153240 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.153519 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.154899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.155176 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.155466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.155743 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.156014 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.156411 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.156696 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.156994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.157281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.157561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.167496 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.167768 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.168039 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.168336 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.168610 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.168888 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.169155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.169285 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.169451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.169735 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.170021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.170303 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.170590 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.170868 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.185568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.187558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.188550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.190566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.191501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.194259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.194647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.196151 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.196447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.196734 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.196862 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.198605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.198959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.199258 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.203469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.205085 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.205789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.207481 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.208065 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.208380 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.208657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.208925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.210565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.210859 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.211147 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.211436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.217289 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.217598 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.217894 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.219526 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.219831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.220117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.225192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.225488 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.225780 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.226056 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.226345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.226634 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.226921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.227221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 10:10:41.227364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.227492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.227618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.227778 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.227905 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.228043 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.228201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.228350 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.228476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.228618 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.228802 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.228934 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.229065 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.229195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.229549 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.229825 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.230101 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.230384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.230655 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.230921 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 10:10:41.265034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b04b56f9c0 pid: 80117 (default app) Aug 04 10:10:41.265593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b04b56f9c0 pid: 80116 (default app) Aug 04 10:10:41.268371 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c06792-d78d-4526-82ef-2ed215bd1354 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:41.268664 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c06792-d78d-4526-82ef-2ed215bd1354 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:41.268943 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c06792-d78d-4526-82ef-2ed215bd1354 None None] PATH_INFO: `/v3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:41.273263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Thu Aug 4 10:10:41 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:10:48.914301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec240445-4e28-41b6-a0e6-ba808d2cfd8f None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:48.914828 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec240445-4e28-41b6-a0e6-ba808d2cfd8f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:48.914828 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec240445-4e28-41b6-a0e6-ba808d2cfd8f None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:48.919269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:10:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:10:48.924365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359762b1-1c36-4ae7-aef7-badcb4875f26 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:48.924783 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359762b1-1c36-4ae7-aef7-badcb4875f26 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:48.924937 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359762b1-1c36-4ae7-aef7-badcb4875f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:48.996221 dv-cinder-826608-8-smb devstack@keystone.service[80117]: INFO dbcounter [None req-359762b1-1c36-4ae7-aef7-badcb4875f26 None None] Registered counter for database keystone Aug 04 10:10:49.015559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG oslo_db.sqlalchemy.engines [None req-359762b1-1c36-4ae7-aef7-badcb4875f26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80117) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:10:49.022343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writer thread running {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:10:49.201620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG passlib.handlers.bcrypt [None req-359762b1-1c36-4ae7-aef7-badcb4875f26 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80117) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 10:10:49.201969 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG passlib.handlers.bcrypt [None req-359762b1-1c36-4ae7-aef7-badcb4875f26 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80117) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 10:10:49.256365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-359762b1-1c36-4ae7-aef7-badcb4875f26 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:10:49.258004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-359762b1-1c36-4ae7-aef7-badcb4875f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:10:49.390718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:10:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 04 10:10:49.553002 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec240445-4e28-41b6-a0e6-ba808d2cfd8f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:49.622903 dv-cinder-826608-8-smb devstack@keystone.service[80116]: INFO dbcounter [None req-ec240445-4e28-41b6-a0e6-ba808d2cfd8f None None] Registered counter for database keystone Aug 04 10:10:49.644624 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG oslo_db.sqlalchemy.engines [None req-ec240445-4e28-41b6-a0e6-ba808d2cfd8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80116) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:10:49.651431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writer thread running {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:10:49.771662 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec240445-4e28-41b6-a0e6-ba808d2cfd8f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:49.775990 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda589e-e57c-4801-916e-859a3dbd629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:49.776663 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda589e-e57c-4801-916e-859a3dbd629d admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:49.776952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda589e-e57c-4801-916e-859a3dbd629d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:49.777232 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda589e-e57c-4801-916e-859a3dbd629d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:49.785362 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda589e-e57c-4801-916e-859a3dbd629d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:49.838100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3cda589e-e57c-4801-916e-859a3dbd629d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 10:10:49.838391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda589e-e57c-4801-916e-859a3dbd629d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:49.848425 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Aug 4 10:10:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 10:10:49.854363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359762b1-1c36-4ae7-aef7-badcb4875f26 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:49.869176 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359762b1-1c36-4ae7-aef7-badcb4875f26 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:49.873617 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7875fe3-f709-4ea4-9e08-39e21b415b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:49.874747 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7875fe3-f709-4ea4-9e08-39e21b415b1c admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:49.875033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7875fe3-f709-4ea4-9e08-39e21b415b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:49.875317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7875fe3-f709-4ea4-9e08-39e21b415b1c admin admin] PATH_INFO: `/v3/projects/ed5a4d067698404b8e986636ba77adc9` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:49.876842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7875fe3-f709-4ea4-9e08-39e21b415b1c admin admin] RBAC: Authorizing `identity:get_project(project_id=ed5a4d067698404b8e986636ba77adc9)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:49.930880 dv-cinder-826608-8-smb devstack@keystone.service[80117]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b7875fe3-f709-4ea4-9e08-39e21b415b1c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 10:10:49.931461 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7875fe3-f709-4ea4-9e08-39e21b415b1c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:49.936245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Aug 4 10:10:49 2022] GET /identity/v3/projects/ed5a4d067698404b8e986636ba77adc9 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:10:51.938830 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbe39c-1f0b-4b20-bb0a-7ee51d8646a8 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:51.939324 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbe39c-1f0b-4b20-bb0a-7ee51d8646a8 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:51.939324 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbe39c-1f0b-4b20-bb0a-7ee51d8646a8 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:51.944348 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:10:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:10:51.949976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d9166-25de-42ca-adb8-b12b12261700 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:51.950388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d9166-25de-42ca-adb8-b12b12261700 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:51.950523 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d9166-25de-42ca-adb8-b12b12261700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:51.970616 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7c5d9166-25de-42ca-adb8-b12b12261700 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:10:51.972122 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7c5d9166-25de-42ca-adb8-b12b12261700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:10:51.981701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:10:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 04 10:10:52.004100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbe39c-1f0b-4b20-bb0a-7ee51d8646a8 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:52.017293 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbe39c-1f0b-4b20-bb0a-7ee51d8646a8 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:52.021965 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3557c-d23d-492e-803b-f063bf340e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:52.022578 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3557c-d23d-492e-803b-f063bf340e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:52.022867 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3557c-d23d-492e-803b-f063bf340e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:52.023146 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3557c-d23d-492e-803b-f063bf340e26 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:52.031316 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3557c-d23d-492e-803b-f063bf340e26 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:52.033147 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3557c-d23d-492e-803b-f063bf340e26 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:52.042685 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Aug 4 10:10:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 10:10:52.048105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d9166-25de-42ca-adb8-b12b12261700 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:52.057771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d9166-25de-42ca-adb8-b12b12261700 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:52.062419 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8237bc-79d9-4803-b622-daaa4a626f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:52.063051 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8237bc-79d9-4803-b622-daaa4a626f3b admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:52.063338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8237bc-79d9-4803-b622-daaa4a626f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:52.063619 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8237bc-79d9-4803-b622-daaa4a626f3b admin admin] PATH_INFO: `/v3/users/d47a57563f9b4a2aa0de495b20f1a6be` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:52.064991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8237bc-79d9-4803-b622-daaa4a626f3b admin admin] RBAC: Authorizing `identity:get_user(user_id=d47a57563f9b4a2aa0de495b20f1a6be)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:52.066880 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8237bc-79d9-4803-b622-daaa4a626f3b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:52.068502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Aug 4 10:10:52 2022] GET /identity/v3/users/d47a57563f9b4a2aa0de495b20f1a6be => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:10:54.291205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdce83-1842-49e5-bb4c-5736647178a8 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:54.291762 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdce83-1842-49e5-bb4c-5736647178a8 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:54.291762 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdce83-1842-49e5-bb4c-5736647178a8 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:54.293139 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:10:54.298338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c757e-b371-4778-b7c5-813047e724a9 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:54.298788 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c757e-b371-4778-b7c5-813047e724a9 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:54.298915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c757e-b371-4778-b7c5-813047e724a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:54.319786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f33c757e-b371-4778-b7c5-813047e724a9 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:10:54.321934 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f33c757e-b371-4778-b7c5-813047e724a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:10:54.392521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcabc0-28f9-4b39-9379-a42c6c8da00a None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:54.392836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcabc0-28f9-4b39-9379-a42c6c8da00a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:54.393117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcabc0-28f9-4b39-9379-a42c6c8da00a None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:54.394445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:10:54.400480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1320ab-6e03-492e-b16c-05c13259c5f1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:54.400943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1320ab-6e03-492e-b16c-05c13259c5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:54.401229 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1320ab-6e03-492e-b16c-05c13259c5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:54.405884 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:10:54.427480 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c757e-b371-4778-b7c5-813047e724a9 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:54.452107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:10:54.453891 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG passlib.handlers.bcrypt [None req-ac1320ab-6e03-492e-b16c-05c13259c5f1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80116) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 10:10:54.454334 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG passlib.handlers.bcrypt [None req-ac1320ab-6e03-492e-b16c-05c13259c5f1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80116) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 10:10:54.503077 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ac1320ab-6e03-492e-b16c-05c13259c5f1 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:10:54.506039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ac1320ab-6e03-492e-b16c-05c13259c5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:10:54.531231 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c757e-b371-4778-b7c5-813047e724a9 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:54.566441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58871d73-ed1a-4cab-a6a1-d03551fd323d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:54.567641 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58871d73-ed1a-4cab-a6a1-d03551fd323d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:54.567920 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58871d73-ed1a-4cab-a6a1-d03551fd323d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:54.568226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58871d73-ed1a-4cab-a6a1-d03551fd323d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:54.610933 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:10:54.635010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1320ab-6e03-492e-b16c-05c13259c5f1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:54.636503 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58871d73-ed1a-4cab-a6a1-d03551fd323d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:54.638021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58871d73-ed1a-4cab-a6a1-d03551fd323d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:54.661177 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:10:54.736737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1320ab-6e03-492e-b16c-05c13259c5f1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:54.737824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 7/14] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:10:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 10:10:54.739903 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:10:54.744611 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58871d73-ed1a-4cab-a6a1-d03551fd323d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:54.776448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebdb972-461d-42e7-9e8d-dc969a34f546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:54.777595 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebdb972-461d-42e7-9e8d-dc969a34f546 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:54.777885 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebdb972-461d-42e7-9e8d-dc969a34f546 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:54.778172 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebdb972-461d-42e7-9e8d-dc969a34f546 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:54.791547 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebdb972-461d-42e7-9e8d-dc969a34f546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:10:54.800094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-3ebdb972-461d-42e7-9e8d-dc969a34f546 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:10:54.800094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:10:54.800094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:10:54.800094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:10:54.800094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:10:54.800094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:10:54.800094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:10:54.800094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:10:54.800094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:10:54.800094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:10:54.800094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:10:54.800094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:10:54.800094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:10:54.800094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:10:54.800094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:10:54.800094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:10:54.801005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:10:54.801005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:10:54.801005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:10:54.801005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:10:54.801005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:10:54.801005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:10:54.801005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:10:54.801005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:10:54.801005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:10:54.801005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:10:54.801005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:10:54.801005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:10:54.801005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:10:54.801005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:10:54.801005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:10:54.801005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:10:54.802551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:10:54.802551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:10:54.802551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:10:54.802551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:10:54.802551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:10:54.802551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:10:54.802551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:10:54.802551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:10:54.802551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:10:54.802551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:10:54.802551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:10:54.802551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:10:54.802551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:10:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:10:54.808007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebdb972-461d-42e7-9e8d-dc969a34f546 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:54.845360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58871d73-ed1a-4cab-a6a1-d03551fd323d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:54.915187 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebdb972-461d-42e7-9e8d-dc969a34f546 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:54.953610 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6727f-4842-4180-83b1-e0c9263bd8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:54.954240 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6727f-4842-4180-83b1-e0c9263bd8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:54.954527 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6727f-4842-4180-83b1-e0c9263bd8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:54.954810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6727f-4842-4180-83b1-e0c9263bd8a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:54.955547 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6727f-4842-4180-83b1-e0c9263bd8a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:10:54.955859 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6727f-4842-4180-83b1-e0c9263bd8a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:54.958052 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6727f-4842-4180-83b1-e0c9263bd8a1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:54.970335 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 9/16] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:10:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:10:54.976880 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6727f-4842-4180-83b1-e0c9263bd8a1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:54.977104 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:10:54.989811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c20ae-b2cd-4fc4-bbd1-851cf390cc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:54.990467 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c20ae-b2cd-4fc4-bbd1-851cf390cc5c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:54.990749 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c20ae-b2cd-4fc4-bbd1-851cf390cc5c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:54.991024 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c20ae-b2cd-4fc4-bbd1-851cf390cc5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:55.001035 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c20ae-b2cd-4fc4-bbd1-851cf390cc5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:55.002493 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c20ae-b2cd-4fc4-bbd1-851cf390cc5c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:55.005326 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:10:55.021866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-c49c20ae-b2cd-4fc4-bbd1-851cf390cc5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:10:55.021866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:10:55.021866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:10:55.021866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:10:55.021866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:10:55.021866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:10:55.021866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:10:55.021866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:10:55.021866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:10:55.021866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:10:55.021866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:10:55.021866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:10:55.021866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:10:55.021866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:10:55.021866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:10:55.022842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:10:55.022842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:10:55.022842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:10:55.022842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:10:55.022842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:10:55.022842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:10:55.022842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:10:55.022842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:10:55.022842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:10:55.022842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:10:55.022842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:10:55.022842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:10:55.022842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:10:55.022842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:10:55.022842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:10:55.022842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:10:55.022842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:10:55.023626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:10:55.023626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:10:55.023626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:10:55.023626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:10:55.023626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 8/17] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:10:55.028800 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c20ae-b2cd-4fc4-bbd1-851cf390cc5c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:55.082799 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6727f-4842-4180-83b1-e0c9263bd8a1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:55.118438 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3cf3c-12a3-418a-ad4f-853fd8ebcf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:55.119016 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3cf3c-12a3-418a-ad4f-853fd8ebcf88 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:55.119302 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3cf3c-12a3-418a-ad4f-853fd8ebcf88 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:55.119579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3cf3c-12a3-418a-ad4f-853fd8ebcf88 None admin] PATH_INFO: `/v3/users/d47a57563f9b4a2aa0de495b20f1a6be` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:55.121128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3cf3c-12a3-418a-ad4f-853fd8ebcf88 None admin] RBAC: Authorizing `identity:get_user(user_id=d47a57563f9b4a2aa0de495b20f1a6be)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:55.122598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3cf3c-12a3-418a-ad4f-853fd8ebcf88 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:55.124517 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 10/18] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:10:54 2022] GET /identity/v3/users/d47a57563f9b4a2aa0de495b20f1a6be => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:10:55.129574 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3cf3c-12a3-418a-ad4f-853fd8ebcf88 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:55.129776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c20ae-b2cd-4fc4-bbd1-851cf390cc5c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:55.164097 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bbc41-3322-4738-9e6d-c280c855898a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:55.164770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bbc41-3322-4738-9e6d-c280c855898a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:55.165058 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bbc41-3322-4738-9e6d-c280c855898a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:55.165342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bbc41-3322-4738-9e6d-c280c855898a None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:55.166034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bbc41-3322-4738-9e6d-c280c855898a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:10:55.166346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bbc41-3322-4738-9e6d-c280c855898a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:55.167745 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bbc41-3322-4738-9e6d-c280c855898a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:55.185931 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 9/19] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:10:55.225724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:10:55.233336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3cf3c-12a3-418a-ad4f-853fd8ebcf88 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:55.271617 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ece05-e67b-4b7f-8c0d-c0c52960b60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:55.272326 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ece05-e67b-4b7f-8c0d-c0c52960b60e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:55.272613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ece05-e67b-4b7f-8c0d-c0c52960b60e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:55.272889 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ece05-e67b-4b7f-8c0d-c0c52960b60e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:55.274135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ece05-e67b-4b7f-8c0d-c0c52960b60e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:55.275638 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ece05-e67b-4b7f-8c0d-c0c52960b60e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:55.277321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:10:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:10:55.283465 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bbc41-3322-4738-9e6d-c280c855898a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:55.320482 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:10:55.388625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bbc41-3322-4738-9e6d-c280c855898a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:55.425936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021aaa9-720b-4dbe-b9cb-622e248db28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:55.426635 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021aaa9-720b-4dbe-b9cb-622e248db28b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:55.426922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021aaa9-720b-4dbe-b9cb-622e248db28b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:55.427206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021aaa9-720b-4dbe-b9cb-622e248db28b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:55.428014 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021aaa9-720b-4dbe-b9cb-622e248db28b None admin] RBAC: Adding query filter params (role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.domain.id=default, user.id=d47a57563f9b4a2aa0de495b20f1a6be) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:10:55.428429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021aaa9-720b-4dbe-b9cb-622e248db28b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:55.429913 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021aaa9-720b-4dbe-b9cb-622e248db28b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:55.437382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1322 bytes} [Thu Aug 4 10:10:55 2022] GET /identity/v3/role_assignments?user.id=d47a57563f9b4a2aa0de495b20f1a6be&scope.domain.id=default&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:10:57.595595 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd53581-3d39-468a-b182-87bc049c2b04 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:57.600619 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd53581-3d39-468a-b182-87bc049c2b04 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:57.600916 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd53581-3d39-468a-b182-87bc049c2b04 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:57.602369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:10:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:10:57.622772 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cad59-fd2d-478a-8f87-ea6a1136c902 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:57.625797 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cad59-fd2d-478a-8f87-ea6a1136c902 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:57.626311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cad59-fd2d-478a-8f87-ea6a1136c902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:57.660082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6b2cad59-fd2d-478a-8f87-ea6a1136c902 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:10:57.661700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6b2cad59-fd2d-478a-8f87-ea6a1136c902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:10:57.833636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:10:57.871239 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd53581-3d39-468a-b182-87bc049c2b04 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:58.015933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab000d-3d4b-4fa1-8891-6c5f108a35f5 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:58.016957 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab000d-3d4b-4fa1-8891-6c5f108a35f5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:58.017450 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab000d-3d4b-4fa1-8891-6c5f108a35f5 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:58.024037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:10:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:10:58.025564 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e51a1-74d0-4ee2-960d-455022a772d1 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:58.026146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e51a1-74d0-4ee2-960d-455022a772d1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:58.026619 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e51a1-74d0-4ee2-960d-455022a772d1 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:58.028417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 13/25] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:10:58.036547 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b39cb-1012-46e6-ac9c-734292a6f278 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:58.039767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b39cb-1012-46e6-ac9c-734292a6f278 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:58.039767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b39cb-1012-46e6-ac9c-734292a6f278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:58.043610 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd53581-3d39-468a-b182-87bc049c2b04 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:58.072984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-301b39cb-1012-46e6-ac9c-734292a6f278 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:10:58.074204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-301b39cb-1012-46e6-ac9c-734292a6f278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:10:58.107119 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2539d-3f49-4c20-9a93-aaa5d79498ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:58.107788 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2539d-3f49-4c20-9a93-aaa5d79498ec None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:58.108078 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2539d-3f49-4c20-9a93-aaa5d79498ec None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:58.108383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2539d-3f49-4c20-9a93-aaa5d79498ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:58.129724 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:10:58.156131 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2539d-3f49-4c20-9a93-aaa5d79498ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:58.157658 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2539d-3f49-4c20-9a93-aaa5d79498ec None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:58.189030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-6cd2539d-3f49-4c20-9a93-aaa5d79498ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:10:58.189030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:10:58.189030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:10:58.189030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:10:58.189030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:10:58.189030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:10:58.189030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:10:58.189030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:10:58.189030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:10:58.189030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:10:58.189030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:10:58.189030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:10:58.189030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:10:58.189030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:10:58.189030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:10:58.189876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:10:58.189876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:10:58.189876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:10:58.189876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:10:58.189876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:10:58.189876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:10:58.189876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:10:58.189876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:10:58.189876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:10:58.189876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:10:58.189876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:10:58.189876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:10:58.189876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:10:58.189876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:10:58.189876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:10:58.189876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:10:58.189876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:10:58.190640 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:10:58.190640 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:10:58.190640 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:10:58.190640 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:10:58.190640 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 13/26] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:10:58.191592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137b8bc-fd48-4961-944c-bffde516557e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:58.191757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137b8bc-fd48-4961-944c-bffde516557e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:58.192196 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137b8bc-fd48-4961-944c-bffde516557e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:58.210917 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 14/27] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:10:58.211546 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b39cb-1012-46e6-ac9c-734292a6f278 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:58.236981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a137b8bc-fd48-4961-944c-bffde516557e None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:10:58.238216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a137b8bc-fd48-4961-944c-bffde516557e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:10:58.258473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:10:58.387315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 14/28] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:10:58.388608 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137b8bc-fd48-4961-944c-bffde516557e None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:58.414924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b39cb-1012-46e6-ac9c-734292a6f278 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:58.463988 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430998e-b166-4b3f-8d47-f64f52331578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:58.465031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430998e-b166-4b3f-8d47-f64f52331578 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:58.465486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430998e-b166-4b3f-8d47-f64f52331578 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:58.465909 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430998e-b166-4b3f-8d47-f64f52331578 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:58.466750 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430998e-b166-4b3f-8d47-f64f52331578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:10:58.467669 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430998e-b166-4b3f-8d47-f64f52331578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:58.469590 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430998e-b166-4b3f-8d47-f64f52331578 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:58.486330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 15/29] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:10:58.489215 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b947143-3419-4e4a-a25e-ed718b0b12f8 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:58.489819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b947143-3419-4e4a-a25e-ed718b0b12f8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:58.490333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b947143-3419-4e4a-a25e-ed718b0b12f8 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:58.492103 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:10:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:10:58.493061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b947143-3419-4e4a-a25e-ed718b0b12f8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:58.518486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:10:58.533072 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137b8bc-fd48-4961-944c-bffde516557e None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:58.573551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e11a3d-8267-4577-a80c-fb2ef866fbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:58.574236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e11a3d-8267-4577-a80c-fb2ef866fbc1 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:58.574541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e11a3d-8267-4577-a80c-fb2ef866fbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:58.574806 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e11a3d-8267-4577-a80c-fb2ef866fbc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:58.575816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e11a3d-8267-4577-a80c-fb2ef866fbc1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:58.577531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e11a3d-8267-4577-a80c-fb2ef866fbc1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:58.640302 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b947143-3419-4e4a-a25e-ed718b0b12f8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:58.682743 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c1f68-bf32-4e1a-b4ab-6641d2a46407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:58.683427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c1f68-bf32-4e1a-b4ab-6641d2a46407 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:58.683712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c1f68-bf32-4e1a-b4ab-6641d2a46407 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:58.683993 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c1f68-bf32-4e1a-b4ab-6641d2a46407 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:58.700531 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c1f68-bf32-4e1a-b4ab-6641d2a46407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:10:58.708284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-806c1f68-bf32-4e1a-b4ab-6641d2a46407 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:10:58.708284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:10:58.708284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:10:58.708284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:10:58.708284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:10:58.708284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:10:58.708284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:10:58.708284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:10:58.708284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:10:58.708284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:10:58.708284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:10:58.708284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:10:58.708284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:10:58.708284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:10:58.708284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:10:58.708284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:10:58.709170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:10:58.709170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:10:58.709170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:10:58.709170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:10:58.709170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:10:58.709170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:10:58.709170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:10:58.709170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:10:58.709170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:10:58.709170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:10:58.709170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:10:58.709170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:10:58.709170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:10:58.709170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:10:58.709170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:10:58.709170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:10:58.709998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:10:58.709998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:10:58.709998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:10:58.709998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:10:58.709998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:10:58.709998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:10:58.709998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:10:58.709998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:10:58.709998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:10:58.709998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:10:58.709998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:10:58.709998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:10:58.710565 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 17/31] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:10:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:10:58.711150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c1f68-bf32-4e1a-b4ab-6641d2a46407 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:58.799597 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:10:58.824973 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c1f68-bf32-4e1a-b4ab-6641d2a46407 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:58.830147 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 15/32] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Aug 4 10:10:58 2022] POST /identity/v3/roles => generated 225 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:10:58.832212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0b5d0-3644-4dad-a4c4-076d9f18b921 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:58.832906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0b5d0-3644-4dad-a4c4-076d9f18b921 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:58.833417 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0b5d0-3644-4dad-a4c4-076d9f18b921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:58.842546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:10:58.855364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-cdd0b5d0-3644-4dad-a4c4-076d9f18b921 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:10:58.857377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cdd0b5d0-3644-4dad-a4c4-076d9f18b921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:10:58.871105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cd836-155f-4e4d-9d5f-43406ab3aa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:58.871751 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cd836-155f-4e4d-9d5f-43406ab3aa48 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:58.872039 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cd836-155f-4e4d-9d5f-43406ab3aa48 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:58.872364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cd836-155f-4e4d-9d5f-43406ab3aa48 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:58.873062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4cd836-155f-4e4d-9d5f-43406ab3aa48 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:58.874754 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4cd836-155f-4e4d-9d5f-43406ab3aa48 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:58.944336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 16/33] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:10:58.945630 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0b5d0-3644-4dad-a4c4-076d9f18b921 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:59.087380 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 18/34] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Aug 4 10:10:58 2022] POST /identity/v3/projects => generated 301 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:10:59.088425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cd836-155f-4e4d-9d5f-43406ab3aa48 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:59.090169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0b5d0-3644-4dad-a4c4-076d9f18b921 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:59.135477 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b431d-2429-46ce-8ce4-2048d33b068e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:59.136802 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b431d-2429-46ce-8ce4-2048d33b068e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:59.137310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b431d-2429-46ce-8ce4-2048d33b068e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:59.138797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b431d-2429-46ce-8ce4-2048d33b068e None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:59.139849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b431d-2429-46ce-8ce4-2048d33b068e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:10:59.140458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b431d-2429-46ce-8ce4-2048d33b068e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:59.142262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b431d-2429-46ce-8ce4-2048d33b068e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:59.145721 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:10:59.158460 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 17/35] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:10:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:10:59.161883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0de6b-2acf-4e84-aa2b-8794ebfd9cef None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:59.162481 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0de6b-2acf-4e84-aa2b-8794ebfd9cef None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:59.163341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0de6b-2acf-4e84-aa2b-8794ebfd9cef None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:59.165591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 18/36] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:10:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:10:59.166235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0de6b-2acf-4e84-aa2b-8794ebfd9cef None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:59.232280 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cd836-155f-4e4d-9d5f-43406ab3aa48 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:59.266627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:10:59.276509 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea6f03-d953-4523-9be2-acdb1539589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:59.277412 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea6f03-d953-4523-9be2-acdb1539589a None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:59.277868 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea6f03-d953-4523-9be2-acdb1539589a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:59.278310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea6f03-d953-4523-9be2-acdb1539589a None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:59.279191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea6f03-d953-4523-9be2-acdb1539589a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:59.280961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea6f03-d953-4523-9be2-acdb1539589a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:59.298677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 19/37] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Aug 4 10:10:59 2022] POST /identity/v3/roles => generated 219 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:10:59.300374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec872c-bc1f-4f73-bf2e-41156ad02d8c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:59.300819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec872c-bc1f-4f73-bf2e-41156ad02d8c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:59.301282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec872c-bc1f-4f73-bf2e-41156ad02d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:59.306176 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0de6b-2acf-4e84-aa2b-8794ebfd9cef None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:59.322723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-61ec872c-bc1f-4f73-bf2e-41156ad02d8c None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:10:59.324707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-61ec872c-bc1f-4f73-bf2e-41156ad02d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:10:59.348355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb705c57-7e13-49f9-92bb-46d943b5a52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:59.349064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb705c57-7e13-49f9-92bb-46d943b5a52f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:59.349355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb705c57-7e13-49f9-92bb-46d943b5a52f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:59.349639 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb705c57-7e13-49f9-92bb-46d943b5a52f None admin] PATH_INFO: `/v3/users/d47a57563f9b4a2aa0de495b20f1a6be` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:59.350878 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb705c57-7e13-49f9-92bb-46d943b5a52f None admin] RBAC: Authorizing `identity:get_user(user_id=d47a57563f9b4a2aa0de495b20f1a6be)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:59.352395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb705c57-7e13-49f9-92bb-46d943b5a52f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:59.354073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 19/38] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:10:59 2022] GET /identity/v3/users/d47a57563f9b4a2aa0de495b20f1a6be => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:10:59.356620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8de3d-c47a-420c-b126-cb86ffeeb3bc None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:59.356883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8de3d-c47a-420c-b126-cb86ffeeb3bc None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:59.357167 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8de3d-c47a-420c-b126-cb86ffeeb3bc None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:59.358752 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 20/39] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:10:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:10:59.364750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41602d5-a0fb-49eb-8aae-dd3bfd1c9948 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:59.365183 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41602d5-a0fb-49eb-8aae-dd3bfd1c9948 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:59.365563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41602d5-a0fb-49eb-8aae-dd3bfd1c9948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:59.386861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c41602d5-a0fb-49eb-8aae-dd3bfd1c9948 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:10:59.388196 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c41602d5-a0fb-49eb-8aae-dd3bfd1c9948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:10:59.412276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 20/40] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:10:59.413438 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec872c-bc1f-4f73-bf2e-41156ad02d8c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:59.484398 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:10:59.495784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 21/41] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:10:59.496647 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41602d5-a0fb-49eb-8aae-dd3bfd1c9948 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:59.537243 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec872c-bc1f-4f73-bf2e-41156ad02d8c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:59.562610 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:10:59.578355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4024be1-2275-45ca-bd6d-9c6992ec6fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:59.579010 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4024be1-2275-45ca-bd6d-9c6992ec6fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:59.579296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4024be1-2275-45ca-bd6d-9c6992ec6fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:59.579576 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4024be1-2275-45ca-bd6d-9c6992ec6fb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:59.580790 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4024be1-2275-45ca-bd6d-9c6992ec6fb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:59.582914 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4024be1-2275-45ca-bd6d-9c6992ec6fb2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:59.584977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 21/42] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:10:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:10:59.585536 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4024be1-2275-45ca-bd6d-9c6992ec6fb2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:59.622377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41602d5-a0fb-49eb-8aae-dd3bfd1c9948 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:59.656447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f393df5-84b4-431b-8040-2573a979d3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:59.657078 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f393df5-84b4-431b-8040-2573a979d3b9 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:59.657363 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f393df5-84b4-431b-8040-2573a979d3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:59.657644 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f393df5-84b4-431b-8040-2573a979d3b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:59.658365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f393df5-84b4-431b-8040-2573a979d3b9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:59.659746 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f393df5-84b4-431b-8040-2573a979d3b9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:59.673614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 22/43] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Aug 4 10:10:59 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:10:59.674633 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f393df5-84b4-431b-8040-2573a979d3b9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:59.692537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4024be1-2275-45ca-bd6d-9c6992ec6fb2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:59.734538 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3059424-24d4-49bb-ae4e-ec515ce4ef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:59.734960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3059424-24d4-49bb-ae4e-ec515ce4ef6d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:59.735256 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3059424-24d4-49bb-ae4e-ec515ce4ef6d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:59.735550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3059424-24d4-49bb-ae4e-ec515ce4ef6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:59.737105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3059424-24d4-49bb-ae4e-ec515ce4ef6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:59.739389 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3059424-24d4-49bb-ae4e-ec515ce4ef6d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:59.741346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 22/44] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:10:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:10:59.741691 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:10:59.747387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3059424-24d4-49bb-ae4e-ec515ce4ef6d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:10:59.802809 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f393df5-84b4-431b-8040-2573a979d3b9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:59.813541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:10:59.847178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6564f-2071-4cc9-b069-7ba485d35969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:59.847869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6564f-2071-4cc9-b069-7ba485d35969 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:59.848800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6564f-2071-4cc9-b069-7ba485d35969 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:59.849084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6564f-2071-4cc9-b069-7ba485d35969 None admin] PATH_INFO: `/v3/domains/default/users/d47a57563f9b4a2aa0de495b20f1a6be/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:59.852495 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6564f-2071-4cc9-b069-7ba485d35969 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d47a57563f9b4a2aa0de495b20f1a6be, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:59.853433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6564f-2071-4cc9-b069-7ba485d35969 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:59.870562 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 23/45] 10.222.0.48 () {58 vars in 1361 bytes} [Thu Aug 4 10:10:59 2022] PUT /identity/v3/domains/default/users/d47a57563f9b4a2aa0de495b20f1a6be/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:10:59.876226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3059424-24d4-49bb-ae4e-ec515ce4ef6d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:10:59.918135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820575a-9858-499a-a9e7-dae279b13eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:10:59.918785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820575a-9858-499a-a9e7-dae279b13eb9 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:10:59.919075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820575a-9858-499a-a9e7-dae279b13eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:10:59.919436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820575a-9858-499a-a9e7-dae279b13eb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:10:59.920074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820575a-9858-499a-a9e7-dae279b13eb9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:10:59.921642 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820575a-9858-499a-a9e7-dae279b13eb9 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:10:59.952335 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 23/46] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Aug 4 10:10:59 2022] POST /identity/v3/projects => generated 312 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:11:01.875239 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f7154-9599-48cb-8775-cb3b2837c972 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:01.875748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f7154-9599-48cb-8775-cb3b2837c972 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:01.876220 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f7154-9599-48cb-8775-cb3b2837c972 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:01.878161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 24/47] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:01.884282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d9034-39dc-4d2b-a872-e3c0685d5ab5 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:01.884737 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d9034-39dc-4d2b-a872-e3c0685d5ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:01.884863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d9034-39dc-4d2b-a872-e3c0685d5ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:01.903737 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c85d9034-39dc-4d2b-a872-e3c0685d5ab5 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:01.904965 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c85d9034-39dc-4d2b-a872-e3c0685d5ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:01.972271 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 24/48] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:01.979560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bed92-38ae-41bb-b873-6c317eeec35d None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:01.979856 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bed92-38ae-41bb-b873-6c317eeec35d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:01.980140 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bed92-38ae-41bb-b873-6c317eeec35d None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:01.981554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 25/49] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:01.986718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116099ac-940e-4a30-8808-13a593aa03f2 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:01.987015 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116099ac-940e-4a30-8808-13a593aa03f2 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:01.987301 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116099ac-940e-4a30-8808-13a593aa03f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:01.995510 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bed92-38ae-41bb-b873-6c317eeec35d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:02.006686 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-116099ac-940e-4a30-8808-13a593aa03f2 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:02.007891 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-116099ac-940e-4a30-8808-13a593aa03f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:02.036982 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:02.077158 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 25/50] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:02.101367 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116099ac-940e-4a30-8808-13a593aa03f2 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:02.107669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bed92-38ae-41bb-b873-6c317eeec35d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:02.122574 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:02.145937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff3d0c-6e67-4964-9975-387b5c615bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:02.146575 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff3d0c-6e67-4964-9975-387b5c615bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:02.146964 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff3d0c-6e67-4964-9975-387b5c615bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:02.147340 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff3d0c-6e67-4964-9975-387b5c615bf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:02.158999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff3d0c-6e67-4964-9975-387b5c615bf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:02.164938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-9fff3d0c-6e67-4964-9975-387b5c615bf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:02.164938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:02.164938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:02.164938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:02.164938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:02.164938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:02.164938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:02.164938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:02.164938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:02.164938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:02.164938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:02.164938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:02.164938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:02.164938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:02.164938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:02.164938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:02.166047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:02.166047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:02.166047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:02.166047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:02.166047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:02.166047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:02.166047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:02.166047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:02.166047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:02.166047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:02.166047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:02.166047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:02.166047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:02.166047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:02.166047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:02.166047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:02.166992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:02.166992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:02.166992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:02.166992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:02.166992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:02.166992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:02.166992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:02.166992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:02.166992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:02.166992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:02.166992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:02.166992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:02.166992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 26/51] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:11:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:11:02.171919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff3d0c-6e67-4964-9975-387b5c615bf2 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:02.208722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116099ac-940e-4a30-8808-13a593aa03f2 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:02.244534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93754f-cfdf-4df9-9d72-037ad03541db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:02.245196 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93754f-cfdf-4df9-9d72-037ad03541db None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:02.245482 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93754f-cfdf-4df9-9d72-037ad03541db None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:02.245758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93754f-cfdf-4df9-9d72-037ad03541db None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:02.246929 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93754f-cfdf-4df9-9d72-037ad03541db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:02.248432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93754f-cfdf-4df9-9d72-037ad03541db None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:02.250064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 26/52] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:11:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:02.256022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93754f-cfdf-4df9-9d72-037ad03541db None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:02.277530 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff3d0c-6e67-4964-9975-387b5c615bf2 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:02.293433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:02.314707 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f39f4-743d-442e-a3b2-8528a30f6f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:02.315478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f39f4-743d-442e-a3b2-8528a30f6f7e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:02.315686 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f39f4-743d-442e-a3b2-8528a30f6f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:02.315968 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f39f4-743d-442e-a3b2-8528a30f6f7e None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:02.317324 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f39f4-743d-442e-a3b2-8528a30f6f7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:02.317646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f39f4-743d-442e-a3b2-8528a30f6f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:02.319128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f39f4-743d-442e-a3b2-8528a30f6f7e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:02.328803 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 27/53] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:02.335488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f39f4-743d-442e-a3b2-8528a30f6f7e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:02.367526 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93754f-cfdf-4df9-9d72-037ad03541db None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:02.370598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:02.404490 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ec255-0499-4e3a-a5c2-696e59902f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:02.405034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ec255-0499-4e3a-a5c2-696e59902f57 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:02.405317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ec255-0499-4e3a-a5c2-696e59902f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:02.405595 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ec255-0499-4e3a-a5c2-696e59902f57 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:02.406293 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ec255-0499-4e3a-a5c2-696e59902f57 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:02.407783 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ec255-0499-4e3a-a5c2-696e59902f57 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:02.436480 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 27/54] 10.222.0.48 () {60 vars in 1140 bytes} [Thu Aug 4 10:11:02 2022] POST /identity/v3/projects => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:11:02.446141 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f39f4-743d-442e-a3b2-8528a30f6f7e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:02.484339 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ab728-cd83-4dd9-b0e9-1eb8b71ca4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:02.485018 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ab728-cd83-4dd9-b0e9-1eb8b71ca4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:02.485303 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ab728-cd83-4dd9-b0e9-1eb8b71ca4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:02.485583 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ab728-cd83-4dd9-b0e9-1eb8b71ca4a2 None admin] PATH_INFO: `/v3/users/d47a57563f9b4a2aa0de495b20f1a6be` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:02.486907 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ab728-cd83-4dd9-b0e9-1eb8b71ca4a2 None admin] RBAC: Authorizing `identity:get_user(user_id=d47a57563f9b4a2aa0de495b20f1a6be)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:02.488448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ab728-cd83-4dd9-b0e9-1eb8b71ca4a2 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:02.490621 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 28/55] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:02 2022] GET /identity/v3/users/d47a57563f9b4a2aa0de495b20f1a6be => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:02.496579 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ec255-0499-4e3a-a5c2-696e59902f57 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:02.593715 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:02.607530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ec255-0499-4e3a-a5c2-696e59902f57 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:02.643860 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a803a4-b9f0-44f6-b4c5-ba7242fe7277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:02.644551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a803a4-b9f0-44f6-b4c5-ba7242fe7277 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:02.644947 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a803a4-b9f0-44f6-b4c5-ba7242fe7277 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:02.645233 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a803a4-b9f0-44f6-b4c5-ba7242fe7277 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:02.646413 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a803a4-b9f0-44f6-b4c5-ba7242fe7277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:02.647877 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a803a4-b9f0-44f6-b4c5-ba7242fe7277 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:02.649517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 28/56] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:11:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:02.655544 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ab728-cd83-4dd9-b0e9-1eb8b71ca4a2 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:02.759072 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ab728-cd83-4dd9-b0e9-1eb8b71ca4a2 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:02.761417 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:02.794817 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be7541-3bc6-49ec-8a37-6f0642479664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:02.795453 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be7541-3bc6-49ec-8a37-6f0642479664 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:02.795742 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be7541-3bc6-49ec-8a37-6f0642479664 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:02.796022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be7541-3bc6-49ec-8a37-6f0642479664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:02.796865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be7541-3bc6-49ec-8a37-6f0642479664 None admin] RBAC: Adding query filter params (role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.domain.id=default, user.id=d47a57563f9b4a2aa0de495b20f1a6be) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:02.797183 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be7541-3bc6-49ec-8a37-6f0642479664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:02.798672 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be7541-3bc6-49ec-8a37-6f0642479664 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:02.806870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 29/57] 10.222.0.48 () {56 vars in 1322 bytes} [Thu Aug 4 10:11:02 2022] GET /identity/v3/role_assignments?user.id=d47a57563f9b4a2aa0de495b20f1a6be&scope.domain.id=default&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:04.495927 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd561e-b946-4d83-9a72-aa93cda3766f None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:04.496568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd561e-b946-4d83-9a72-aa93cda3766f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:04.496691 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd561e-b946-4d83-9a72-aa93cda3766f None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:04.498111 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 29/58] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:11:04.503872 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254635a-04fb-43d3-a662-be241f4ff4c6 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:04.504337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254635a-04fb-43d3-a662-be241f4ff4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:04.504470 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254635a-04fb-43d3-a662-be241f4ff4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:04.523390 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a254635a-04fb-43d3-a662-be241f4ff4c6 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:04.524649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a254635a-04fb-43d3-a662-be241f4ff4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:04.593284 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 30/59] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:04.617173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd561e-b946-4d83-9a72-aa93cda3766f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:04.721548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd561e-b946-4d83-9a72-aa93cda3766f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:04.757749 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12ad6b-4951-401f-8c34-efe40caadd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:04.758312 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12ad6b-4951-401f-8c34-efe40caadd1b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:04.758602 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12ad6b-4951-401f-8c34-efe40caadd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:04.758883 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12ad6b-4951-401f-8c34-efe40caadd1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:04.760055 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12ad6b-4951-401f-8c34-efe40caadd1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:04.761550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12ad6b-4951-401f-8c34-efe40caadd1b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:04.763162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 30/60] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:11:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:04.768809 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254635a-04fb-43d3-a662-be241f4ff4c6 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:04.866736 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:04.871534 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254635a-04fb-43d3-a662-be241f4ff4c6 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:04.909831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cd906-6a20-4b10-88e8-1c37912accfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:04.910536 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cd906-6a20-4b10-88e8-1c37912accfa None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:04.910968 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cd906-6a20-4b10-88e8-1c37912accfa None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:04.911477 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cd906-6a20-4b10-88e8-1c37912accfa None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:04.912207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cd906-6a20-4b10-88e8-1c37912accfa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:04.913730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cd906-6a20-4b10-88e8-1c37912accfa None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:04.942630 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 31/61] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Aug 4 10:11:04 2022] POST /identity/v3/users => generated 275 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:11:08.025997 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aea440-36c1-4569-bd5f-bde06f2324a7 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:08.026480 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aea440-36c1-4569-bd5f-bde06f2324a7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:08.026480 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aea440-36c1-4569-bd5f-bde06f2324a7 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:08.027846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 31/62] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:08.033105 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4314bf-1881-443f-9664-3d39d6872ca3 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:08.033519 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4314bf-1881-443f-9664-3d39d6872ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:08.033686 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4314bf-1881-443f-9664-3d39d6872ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:08.061588 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3a4314bf-1881-443f-9664-3d39d6872ca3 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:08.062847 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3a4314bf-1881-443f-9664-3d39d6872ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:08.169604 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 32/63] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:08.221912 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aea440-36c1-4569-bd5f-bde06f2324a7 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:08.257281 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:08.364088 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aea440-36c1-4569-bd5f-bde06f2324a7 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:08.405725 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b552fd-bf8a-41c8-9369-6b57f29a1052 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:08.406020 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b552fd-bf8a-41c8-9369-6b57f29a1052 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:08.406308 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b552fd-bf8a-41c8-9369-6b57f29a1052 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:08.407693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 33/64] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:08.417358 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa32d8-4493-4a4d-8df9-b84716efcbc1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:08.417651 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa32d8-4493-4a4d-8df9-b84716efcbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:08.417940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa32d8-4493-4a4d-8df9-b84716efcbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:08.423134 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674d17c-73a0-4b57-a961-907a7f24fc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:08.423808 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674d17c-73a0-4b57-a961-907a7f24fc6b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:08.424102 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674d17c-73a0-4b57-a961-907a7f24fc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:08.424414 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674d17c-73a0-4b57-a961-907a7f24fc6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:08.436460 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674d17c-73a0-4b57-a961-907a7f24fc6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:08.439165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-e3aa32d8-4493-4a4d-8df9-b84716efcbc1 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:08.440633 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e3aa32d8-4493-4a4d-8df9-b84716efcbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:08.441510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-9674d17c-73a0-4b57-a961-907a7f24fc6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:08.441510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:08.441510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:08.441510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:08.441510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:08.441510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:08.441510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:08.441510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:08.441510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:08.441510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:08.441510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:08.441510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:08.441510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:08.441510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:08.441510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:08.441510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:08.442424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:08.442424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:08.442424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:08.442424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:08.442424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:08.442424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:08.442424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:08.442424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:08.442424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:08.442424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:08.442424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:08.442424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:08.442424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:08.442424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:08.442424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:08.442424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:08.443172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:08.443172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:08.443172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:08.443172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:08.443172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:08.443172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:08.443172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:08.443172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:08.443172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:08.443172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:08.443172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:08.443172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:08.443172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 32/65] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:08.444637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a9035-7be0-44be-a915-726560437fad None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:08.444930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a9035-7be0-44be-a915-726560437fad None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:08.445213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a9035-7be0-44be-a915-726560437fad None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:08.446484 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 33/66] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:08.451142 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a9035-7be0-44be-a915-726560437fad None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:08.521362 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 34/67] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:08.524335 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e64064-b0c3-4671-90f7-737f145ffc7f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:08.524335 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e64064-b0c3-4671-90f7-737f145ffc7f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:08.524335 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e64064-b0c3-4671-90f7-737f145ffc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:08.545100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-63e64064-b0c3-4671-90f7-737f145ffc7f None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:08.546817 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-63e64064-b0c3-4671-90f7-737f145ffc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:08.549718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:08.557569 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:08.576517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a9035-7be0-44be-a915-726560437fad None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:08.614201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd040a7-dffd-4ad7-89d3-9a302a4b97e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:08.614932 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd040a7-dffd-4ad7-89d3-9a302a4b97e0 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:08.615538 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd040a7-dffd-4ad7-89d3-9a302a4b97e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:08.615838 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd040a7-dffd-4ad7-89d3-9a302a4b97e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:08.616742 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd040a7-dffd-4ad7-89d3-9a302a4b97e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:08.617061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd040a7-dffd-4ad7-89d3-9a302a4b97e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:08.620322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd040a7-dffd-4ad7-89d3-9a302a4b97e0 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:08.626429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 35/68] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:08.627591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b58544-4168-430b-a789-e480064d1134 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:08.627922 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b58544-4168-430b-a789-e480064d1134 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:08.628231 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b58544-4168-430b-a789-e480064d1134 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:08.630213 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 36/69] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:08.634552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 34/70] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:08.635493 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b58544-4168-430b-a789-e480064d1134 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:08.635863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8eca06-83f9-4cf2-9a5d-2feb8241bcad None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:08.640401 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8eca06-83f9-4cf2-9a5d-2feb8241bcad None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:08.640401 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8eca06-83f9-4cf2-9a5d-2feb8241bcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:08.657882 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3c8eca06-83f9-4cf2-9a5d-2feb8241bcad None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:08.659166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3c8eca06-83f9-4cf2-9a5d-2feb8241bcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:08.725377 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 35/71] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:08.728364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8eca06-83f9-4cf2-9a5d-2feb8241bcad None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:08.753867 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b58544-4168-430b-a789-e480064d1134 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:08.788745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a7364-97b1-4fbe-919a-297e3e2d0f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:08.789398 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a7364-97b1-4fbe-919a-297e3e2d0f20 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:08.789686 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a7364-97b1-4fbe-919a-297e3e2d0f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:08.789971 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a7364-97b1-4fbe-919a-297e3e2d0f20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:08.800398 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a7364-97b1-4fbe-919a-297e3e2d0f20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:08.802229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:08.806371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-193a7364-97b1-4fbe-919a-297e3e2d0f20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:08.806371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:08.806371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:08.806371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:08.806371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:08.806371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:08.806371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:08.806371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:08.806371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:08.806371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:08.806371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:08.806371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:08.806371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:08.806371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:08.806371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:08.806371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:08.807366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:08.807366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:08.807366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:08.807366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:08.807366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:08.807366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:08.807366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:08.807366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:08.807366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:08.807366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:08.807366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:08.807366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:08.807366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:08.807366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:08.807366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:08.807366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:08.808137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:08.808137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:08.808137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:08.808137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:08.808137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:08.808137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:08.808137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:08.808137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:08.808137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:08.808137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:08.808137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:08.808137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:08.808137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 37/72] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:11:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:08.808790 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a7364-97b1-4fbe-919a-297e3e2d0f20 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:08.813430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:08.830519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8eca06-83f9-4cf2-9a5d-2feb8241bcad None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:08.864305 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838b244-a687-4676-978d-e32b363896cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:08.865006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838b244-a687-4676-978d-e32b363896cf None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:08.865297 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838b244-a687-4676-978d-e32b363896cf None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:08.865583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838b244-a687-4676-978d-e32b363896cf None admin] PATH_INFO: `/v3/users/ec0e7e1f75384c61b47651e3ecc71eb1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:08.878466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838b244-a687-4676-978d-e32b363896cf None admin] RBAC: Authorizing `identity:get_user(user_id=ec0e7e1f75384c61b47651e3ecc71eb1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:08.880576 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838b244-a687-4676-978d-e32b363896cf None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:08.882232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:08 2022] GET /identity/v3/users/ec0e7e1f75384c61b47651e3ecc71eb1 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:08.883390 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac3ed8-63c5-4fe4-a6cb-b284a5625b2f None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:08.883687 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac3ed8-63c5-4fe4-a6cb-b284a5625b2f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:08.883967 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac3ed8-63c5-4fe4-a6cb-b284a5625b2f None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:08.885230 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 37/74] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:08.885926 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac3ed8-63c5-4fe4-a6cb-b284a5625b2f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:08.911998 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a7364-97b1-4fbe-919a-297e3e2d0f20 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:08.946767 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f531e19-eaf4-411a-9eb3-2786647fd9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:08.947418 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f531e19-eaf4-411a-9eb3-2786647fd9ee None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:08.947709 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f531e19-eaf4-411a-9eb3-2786647fd9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:08.947994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f531e19-eaf4-411a-9eb3-2786647fd9ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:08.958367 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f531e19-eaf4-411a-9eb3-2786647fd9ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:08.963280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-0f531e19-eaf4-411a-9eb3-2786647fd9ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:08.963280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:08.963280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:08.963280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:08.963280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:08.963280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:08.963280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:08.963280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:08.963280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:08.963280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:08.963280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:08.963280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:08.963280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:08.963280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:08.963280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:08.963280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:08.964295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:08.964295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:08.964295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:08.964295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:08.964295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:08.964295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:08.964295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:08.964295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:08.964295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:08.964295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:08.964295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:08.964295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:08.964295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:08.964295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:08.964295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:08.964295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:08.965192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:08.965192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:08.965192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:08.965192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:08.965192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:08.965192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:08.965192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:08.965192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:08.965192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:08.965192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:08.965192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:08.965192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:08.965192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 38/75] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:11:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:08.965192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f531e19-eaf4-411a-9eb3-2786647fd9ee None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:08.991099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac3ed8-63c5-4fe4-a6cb-b284a5625b2f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:09.024345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e100c-2194-4e18-aa87-114da97a25b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:09.024984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e100c-2194-4e18-aa87-114da97a25b2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:09.025264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e100c-2194-4e18-aa87-114da97a25b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:09.025539 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e100c-2194-4e18-aa87-114da97a25b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:09.027338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:09.030133 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:09.037156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e100c-2194-4e18-aa87-114da97a25b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:09.042032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-582e100c-2194-4e18-aa87-114da97a25b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:09.042032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:09.042032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:09.042032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:09.042032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:09.042032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:09.042032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:09.042032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:09.042032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:09.042032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:09.042032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:09.042032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:09.042032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:09.042032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:09.042032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:09.042032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:09.042857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:09.042857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:09.042857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:09.042857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:09.042857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:09.042857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:09.042857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:09.042857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:09.042857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:09.042857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:09.042857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:09.042857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:09.042857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:09.042857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:09.042857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:09.042857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:09.048428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:09.048428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:09.048428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:09.048428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:09.048428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:09.048428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:09.048428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:09.048428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:09.048428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:09.048428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:09.048428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:09.048428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:09.048428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 38/76] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:09.048428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e100c-2194-4e18-aa87-114da97a25b2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:09.075376 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f531e19-eaf4-411a-9eb3-2786647fd9ee None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:09.112370 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac0049-98be-4306-9717-507baef51037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:09.113004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac0049-98be-4306-9717-507baef51037 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:09.113297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac0049-98be-4306-9717-507baef51037 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:09.114293 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac0049-98be-4306-9717-507baef51037 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:09.115164 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac0049-98be-4306-9717-507baef51037 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:09.115430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac0049-98be-4306-9717-507baef51037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:09.116847 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac0049-98be-4306-9717-507baef51037 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:09.124969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 39/77] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:09.126223 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfb9e1-c503-4e31-9eb7-8514ebc75534 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:09.126525 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfb9e1-c503-4e31-9eb7-8514ebc75534 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:09.126817 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfb9e1-c503-4e31-9eb7-8514ebc75534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:09.143147 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e100c-2194-4e18-aa87-114da97a25b2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:09.144372 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-1ddfb9e1-c503-4e31-9eb7-8514ebc75534 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:09.145635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1ddfb9e1-c503-4e31-9eb7-8514ebc75534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:09.177963 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c9b26-9218-49f8-800b-d8c4c1a6b3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:09.178594 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c9b26-9218-49f8-800b-d8c4c1a6b3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:09.178887 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c9b26-9218-49f8-800b-d8c4c1a6b3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:09.179174 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c9b26-9218-49f8-800b-d8c4c1a6b3d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:09.212371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 40/78] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:09.217052 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfb9e1-c503-4e31-9eb7-8514ebc75534 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:09.242243 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:09.250383 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c9b26-9218-49f8-800b-d8c4c1a6b3d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:09.251876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c9b26-9218-49f8-800b-d8c4c1a6b3d0 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:09.275201 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:09.320318 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfb9e1-c503-4e31-9eb7-8514ebc75534 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:09.351173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 39/79] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:09.352016 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c9b26-9218-49f8-800b-d8c4c1a6b3d0 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:09.354639 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18388fa6-0162-4155-8000-3fb2f527654f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:09.355273 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18388fa6-0162-4155-8000-3fb2f527654f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:09.355557 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18388fa6-0162-4155-8000-3fb2f527654f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:09.355840 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18388fa6-0162-4155-8000-3fb2f527654f None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:09.356597 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18388fa6-0162-4155-8000-3fb2f527654f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:09.356907 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18388fa6-0162-4155-8000-3fb2f527654f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:09.358301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18388fa6-0162-4155-8000-3fb2f527654f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:09.367261 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 41/80] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:11:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:09.369058 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18388fa6-0162-4155-8000-3fb2f527654f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:09.441677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:09.448696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c9b26-9218-49f8-800b-d8c4c1a6b3d0 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:09.471507 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18388fa6-0162-4155-8000-3fb2f527654f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:09.482881 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e062a-3d2c-4f58-8a92-970ed1527fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:09.483508 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e062a-3d2c-4f58-8a92-970ed1527fdf None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:09.483797 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e062a-3d2c-4f58-8a92-970ed1527fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:09.484080 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e062a-3d2c-4f58-8a92-970ed1527fdf None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:09.484834 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e062a-3d2c-4f58-8a92-970ed1527fdf None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:09.485144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e062a-3d2c-4f58-8a92-970ed1527fdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:09.486537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e062a-3d2c-4f58-8a92-970ed1527fdf None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:09.488470 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:09.494512 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 40/81] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:09.495304 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e062a-3d2c-4f58-8a92-970ed1527fdf None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:09.508032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4134e-f984-4d3a-8b9a-92289aec1dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:09.508727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4134e-f984-4d3a-8b9a-92289aec1dff None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:09.509017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4134e-f984-4d3a-8b9a-92289aec1dff None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:09.509301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4134e-f984-4d3a-8b9a-92289aec1dff None admin] PATH_INFO: `/v3/users/d47a57563f9b4a2aa0de495b20f1a6be` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:09.510503 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4134e-f984-4d3a-8b9a-92289aec1dff None admin] RBAC: Authorizing `identity:get_user(user_id=d47a57563f9b4a2aa0de495b20f1a6be)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:09.511983 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4134e-f984-4d3a-8b9a-92289aec1dff None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:09.513665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 42/82] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:09 2022] GET /identity/v3/users/d47a57563f9b4a2aa0de495b20f1a6be => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:09.514430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4134e-f984-4d3a-8b9a-92289aec1dff None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:09.595577 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e062a-3d2c-4f58-8a92-970ed1527fdf None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:09.616509 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4134e-f984-4d3a-8b9a-92289aec1dff None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:09.631081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff229f-8044-4652-a591-313a2a838976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:09.631738 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff229f-8044-4652-a591-313a2a838976 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:09.632024 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff229f-8044-4652-a591-313a2a838976 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:09.632344 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff229f-8044-4652-a591-313a2a838976 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:09.633502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff229f-8044-4652-a591-313a2a838976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:09.634971 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff229f-8044-4652-a591-313a2a838976 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:09.636736 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 41/83] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:11:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:09.637499 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff229f-8044-4652-a591-313a2a838976 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:09.654514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf421a6-66e0-4fae-820e-d47c8565aa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:09.655252 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf421a6-66e0-4fae-820e-d47c8565aa59 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:09.655541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf421a6-66e0-4fae-820e-d47c8565aa59 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:09.655826 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf421a6-66e0-4fae-820e-d47c8565aa59 None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:09.657047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf421a6-66e0-4fae-820e-d47c8565aa59 None admin] RBAC: Authorizing `identity:get_project(project_id=8c7f15d3ce55460993f520e6f8838a8a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:09.658490 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf421a6-66e0-4fae-820e-d47c8565aa59 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:09.661061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 43/84] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:09 2022] GET /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:09.661946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf421a6-66e0-4fae-820e-d47c8565aa59 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:09.666973 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:09.715773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:09.743572 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff229f-8044-4652-a591-313a2a838976 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:09.761219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf421a6-66e0-4fae-820e-d47c8565aa59 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:09.776559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84467c-5eac-4310-bf8f-d871c68d37d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:09.777211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84467c-5eac-4310-bf8f-d871c68d37d5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:09.777502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84467c-5eac-4310-bf8f-d871c68d37d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:09.777798 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84467c-5eac-4310-bf8f-d871c68d37d5 None admin] PATH_INFO: `/v3/users/ec0e7e1f75384c61b47651e3ecc71eb1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:09.778975 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84467c-5eac-4310-bf8f-d871c68d37d5 None admin] RBAC: Authorizing `identity:get_user(user_id=ec0e7e1f75384c61b47651e3ecc71eb1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:09.780496 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84467c-5eac-4310-bf8f-d871c68d37d5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:09.782417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 42/85] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:09 2022] GET /identity/v3/users/ec0e7e1f75384c61b47651e3ecc71eb1 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:09.783194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84467c-5eac-4310-bf8f-d871c68d37d5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:09.798274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b076f3d-76dc-4234-866e-929e937b4eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:09.798931 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b076f3d-76dc-4234-866e-929e937b4eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:09.799225 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b076f3d-76dc-4234-866e-929e937b4eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:09.799510 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b076f3d-76dc-4234-866e-929e937b4eb3 None admin] PATH_INFO: `/v3/users/ec0e7e1f75384c61b47651e3ecc71eb1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:09.800724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b076f3d-76dc-4234-866e-929e937b4eb3 None admin] RBAC: Authorizing `identity:get_user(user_id=ec0e7e1f75384c61b47651e3ecc71eb1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:09.802220 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b076f3d-76dc-4234-866e-929e937b4eb3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:09.803842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 44/86] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:09 2022] GET /identity/v3/users/ec0e7e1f75384c61b47651e3ecc71eb1 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:09.804607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b076f3d-76dc-4234-866e-929e937b4eb3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:09.875668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:09.884902 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84467c-5eac-4310-bf8f-d871c68d37d5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:09.905905 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b076f3d-76dc-4234-866e-929e937b4eb3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:09.917798 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a8394-06b3-4be7-8812-7c1a4bf6b16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:09.918428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a8394-06b3-4be7-8812-7c1a4bf6b16e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:09.918719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a8394-06b3-4be7-8812-7c1a4bf6b16e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:09.919004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a8394-06b3-4be7-8812-7c1a4bf6b16e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:09.928345 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:09.940965 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2337da9-ed7c-43d1-b29d-1f904f7b9511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:09.942111 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2337da9-ed7c-43d1-b29d-1f904f7b9511 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:09.942575 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2337da9-ed7c-43d1-b29d-1f904f7b9511 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:09.942862 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2337da9-ed7c-43d1-b29d-1f904f7b9511 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:09.943556 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2337da9-ed7c-43d1-b29d-1f904f7b9511 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:09.945030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2337da9-ed7c-43d1-b29d-1f904f7b9511 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:09.965730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 45/87] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Aug 4 10:11:09 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:11:09.966612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2337da9-ed7c-43d1-b29d-1f904f7b9511 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:09.989630 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a8394-06b3-4be7-8812-7c1a4bf6b16e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:09.991148 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a8394-06b3-4be7-8812-7c1a4bf6b16e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:10.102623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:10.114973 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2337da9-ed7c-43d1-b29d-1f904f7b9511 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:10.115602 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 43/88] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:10.117667 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a8394-06b3-4be7-8812-7c1a4bf6b16e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:10.164361 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeb1fb-83b2-49c9-a62c-e3631c5a0c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:10.164935 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeb1fb-83b2-49c9-a62c-e3631c5a0c92 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:10.165228 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeb1fb-83b2-49c9-a62c-e3631c5a0c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:10.165514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeb1fb-83b2-49c9-a62c-e3631c5a0c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:10.166334 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eeb1fb-83b2-49c9-a62c-e3631c5a0c92 None admin] RBAC: Adding query filter params (role.id=50575a0d3f4340ee92356ce22ff3e62a, scope.project.id=8c7f15d3ce55460993f520e6f8838a8a, user.id=ec0e7e1f75384c61b47651e3ecc71eb1) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:10.169033 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eeb1fb-83b2-49c9-a62c-e3631c5a0c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:10.169033 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eeb1fb-83b2-49c9-a62c-e3631c5a0c92 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:10.178968 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 46/89] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:11:09 2022] GET /identity/v3/role_assignments?user.id=ec0e7e1f75384c61b47651e3ecc71eb1&scope.project.id=8c7f15d3ce55460993f520e6f8838a8a&role.id=50575a0d3f4340ee92356ce22ff3e62a => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:10.180224 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeb1fb-83b2-49c9-a62c-e3631c5a0c92 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:10.242530 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:10.258623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a8394-06b3-4be7-8812-7c1a4bf6b16e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:10.301567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd68da-0ec5-414b-94d8-5f1b383b0753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:10.302384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd68da-0ec5-414b-94d8-5f1b383b0753 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:10.302740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd68da-0ec5-414b-94d8-5f1b383b0753 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:10.303094 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd68da-0ec5-414b-94d8-5f1b383b0753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:10.315935 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeb1fb-83b2-49c9-a62c-e3631c5a0c92 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:10.380584 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c773e-8bee-4aa5-b06f-0570b1a0f231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:10.381296 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c773e-8bee-4aa5-b06f-0570b1a0f231 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:10.381592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c773e-8bee-4aa5-b06f-0570b1a0f231 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:10.382424 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c773e-8bee-4aa5-b06f-0570b1a0f231 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:10.388956 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:10.402581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd68da-0ec5-414b-94d8-5f1b383b0753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:10.404341 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd68da-0ec5-414b-94d8-5f1b383b0753 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:10.456249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c773e-8bee-4aa5-b06f-0570b1a0f231 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:10.458571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c773e-8bee-4aa5-b06f-0570b1a0f231 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:10.506064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:10.583580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 44/90] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:10.584252 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd68da-0ec5-414b-94d8-5f1b383b0753 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:10.611269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 47/91] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:10.612127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c773e-8bee-4aa5-b06f-0570b1a0f231 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:10.722450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c773e-8bee-4aa5-b06f-0570b1a0f231 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:10.770883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba8386-45d6-44ec-b30f-f69cd884eeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:10.771551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba8386-45d6-44ec-b30f-f69cd884eeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:10.771836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba8386-45d6-44ec-b30f-f69cd884eeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:10.772115 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba8386-45d6-44ec-b30f-f69cd884eeb6 None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:10.775835 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:10.776924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba8386-45d6-44ec-b30f-f69cd884eeb6 None admin] RBAC: Authorizing `identity:get_project(project_id=8c7f15d3ce55460993f520e6f8838a8a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:10.778577 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba8386-45d6-44ec-b30f-f69cd884eeb6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:10.780314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 48/92] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:10 2022] GET /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:10.781075 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba8386-45d6-44ec-b30f-f69cd884eeb6 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:10.785959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd68da-0ec5-414b-94d8-5f1b383b0753 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:10.798102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:10.826849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48145ce1-6faf-4240-bbce-d65a9a2507cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:10.827796 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48145ce1-6faf-4240-bbce-d65a9a2507cc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:10.828253 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48145ce1-6faf-4240-bbce-d65a9a2507cc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:10.828676 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48145ce1-6faf-4240-bbce-d65a9a2507cc None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:10.830017 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48145ce1-6faf-4240-bbce-d65a9a2507cc None admin] RBAC: Authorizing `identity:get_project(project_id=8c7f15d3ce55460993f520e6f8838a8a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:10.831762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48145ce1-6faf-4240-bbce-d65a9a2507cc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:10.834416 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 45/93] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:10 2022] GET /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:10.835452 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48145ce1-6faf-4240-bbce-d65a9a2507cc None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:10.913297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba8386-45d6-44ec-b30f-f69cd884eeb6 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:10.972278 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8942e4-f64c-44cb-b16e-52dcea2b7ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:10.973403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8942e4-f64c-44cb-b16e-52dcea2b7ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:10.973902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8942e4-f64c-44cb-b16e-52dcea2b7ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:10.974379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8942e4-f64c-44cb-b16e-52dcea2b7ac3 None admin] PATH_INFO: `/v3/projects/7a0263c81cf1486cbae00010d6dc63e9` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:10.974565 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48145ce1-6faf-4240-bbce-d65a9a2507cc None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:10.976116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8942e4-f64c-44cb-b16e-52dcea2b7ac3 None admin] RBAC: Authorizing `identity:get_project(project_id=7a0263c81cf1486cbae00010d6dc63e9)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:10.977820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8942e4-f64c-44cb-b16e-52dcea2b7ac3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:10.979774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 49/94] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:10 2022] GET /identity/v3/projects/7a0263c81cf1486cbae00010d6dc63e9 => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:10.980846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8942e4-f64c-44cb-b16e-52dcea2b7ac3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:11.040364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793e9f1-a55b-4bfa-9631-89eaea2c5555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:11.041454 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793e9f1-a55b-4bfa-9631-89eaea2c5555 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:11.041955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793e9f1-a55b-4bfa-9631-89eaea2c5555 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:11.042435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793e9f1-a55b-4bfa-9631-89eaea2c5555 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:11.043505 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793e9f1-a55b-4bfa-9631-89eaea2c5555 None admin] RBAC: Adding query filter params (role.id=472f2455c837486084f108ce944f1bff, scope.project.id=8c7f15d3ce55460993f520e6f8838a8a, user.id=ec0e7e1f75384c61b47651e3ecc71eb1) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:11.044024 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793e9f1-a55b-4bfa-9631-89eaea2c5555 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:11.045919 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793e9f1-a55b-4bfa-9631-89eaea2c5555 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:11.052904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 46/95] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:11:10 2022] GET /identity/v3/role_assignments?user.id=ec0e7e1f75384c61b47651e3ecc71eb1&scope.project.id=8c7f15d3ce55460993f520e6f8838a8a&role.id=472f2455c837486084f108ce944f1bff => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:11.053965 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793e9f1-a55b-4bfa-9631-89eaea2c5555 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:11.112586 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:11.169013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793e9f1-a55b-4bfa-9631-89eaea2c5555 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:11.178090 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:11.209579 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cda60b-fe37-4559-aa8f-65491973effa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:11.210609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cda60b-fe37-4559-aa8f-65491973effa None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:11.211097 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cda60b-fe37-4559-aa8f-65491973effa None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:11.211573 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cda60b-fe37-4559-aa8f-65491973effa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:11.212674 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cda60b-fe37-4559-aa8f-65491973effa None admin] RBAC: Adding query filter params (role.id=50575a0d3f4340ee92356ce22ff3e62a, scope.project.id=7a0263c81cf1486cbae00010d6dc63e9, user.id=ec0e7e1f75384c61b47651e3ecc71eb1) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:11.213225 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cda60b-fe37-4559-aa8f-65491973effa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:11.214964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cda60b-fe37-4559-aa8f-65491973effa None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:11.221399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 47/96] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:11:11 2022] GET /identity/v3/role_assignments?user.id=ec0e7e1f75384c61b47651e3ecc71eb1&scope.project.id=7a0263c81cf1486cbae00010d6dc63e9&role.id=50575a0d3f4340ee92356ce22ff3e62a => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:11.233438 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8942e4-f64c-44cb-b16e-52dcea2b7ac3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:11.274041 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11765333-1829-4448-b877-530da21df9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:11.275103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11765333-1829-4448-b877-530da21df9ce None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:11.275590 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11765333-1829-4448-b877-530da21df9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:11.276071 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11765333-1829-4448-b877-530da21df9ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:11.277115 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11765333-1829-4448-b877-530da21df9ce None admin] RBAC: Adding query filter params (role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.project.id=8c7f15d3ce55460993f520e6f8838a8a, user.id=d47a57563f9b4a2aa0de495b20f1a6be) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:11.277653 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11765333-1829-4448-b877-530da21df9ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:11.279403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11765333-1829-4448-b877-530da21df9ce None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:11.286559 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 50/97] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:11:10 2022] GET /identity/v3/role_assignments?user.id=d47a57563f9b4a2aa0de495b20f1a6be&scope.project.id=8c7f15d3ce55460993f520e6f8838a8a&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:12.566473 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc319d5e-7a21-4a08-8515-f8266b47e3c6 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:12.568235 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc319d5e-7a21-4a08-8515-f8266b47e3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:12.568793 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc319d5e-7a21-4a08-8515-f8266b47e3c6 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:12.570538 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 48/98] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:12.584742 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39545e84-df4f-4d63-90f7-b236f8cda80e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:12.585756 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39545e84-df4f-4d63-90f7-b236f8cda80e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:12.586253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39545e84-df4f-4d63-90f7-b236f8cda80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:12.617368 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-39545e84-df4f-4d63-90f7-b236f8cda80e None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:12.619078 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-39545e84-df4f-4d63-90f7-b236f8cda80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:12.702947 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 51/99] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:12.747022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc319d5e-7a21-4a08-8515-f8266b47e3c6 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:12.866598 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:12.881517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc319d5e-7a21-4a08-8515-f8266b47e3c6 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:12.938345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9509f71-f6bc-4e97-9970-8dd8ded72303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:12.939355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9509f71-f6bc-4e97-9970-8dd8ded72303 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:12.939843 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9509f71-f6bc-4e97-9970-8dd8ded72303 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:12.940376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9509f71-f6bc-4e97-9970-8dd8ded72303 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:12.961106 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9509f71-f6bc-4e97-9970-8dd8ded72303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:12.966474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-d9509f71-f6bc-4e97-9970-8dd8ded72303 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 10:11:12.966474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:12.966474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:12.966474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:12.966474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:12.966474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:12.966474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:12.966474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:12.966474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:12.966474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:12.966474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:12.966474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:12.966474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:12.966474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:12.966474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:12.966474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:12.967295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:12.967295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:12.967295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:12.967295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:12.967295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:12.967295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:12.967295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:12.967295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:12.967295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:12.967295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:12.967295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:12.967295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:12.967295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:12.967295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:12.967295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:12.967295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:12.968023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:12.968023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:12.968023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:12.968023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:12.968023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:12.968023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:12.968023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:12.968023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:12.968023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:12.968023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:12.968023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 10:11:12.968023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:12.975830 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 49/100] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:12.977499 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39545e84-df4f-4d63-90f7-b236f8cda80e None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:13.026618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab857b-ce03-40a4-b44e-5aad53bfce9a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:13.027237 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab857b-ce03-40a4-b44e-5aad53bfce9a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:13.027722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab857b-ce03-40a4-b44e-5aad53bfce9a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:13.029356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 50/101] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:13.044711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d07a40-1ba6-422d-a301-c151e8f6c86a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:13.045306 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d07a40-1ba6-422d-a301-c151e8f6c86a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:13.045788 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d07a40-1ba6-422d-a301-c151e8f6c86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:13.087202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e9d07a40-1ba6-422d-a301-c151e8f6c86a None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:13.089190 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e9d07a40-1ba6-422d-a301-c151e8f6c86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:13.140715 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:13.186276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39545e84-df4f-4d63-90f7-b236f8cda80e None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:13.237405 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02e923-6e3d-40c6-a2ac-111f137acc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:13.238428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02e923-6e3d-40c6-a2ac-111f137acc28 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:13.238785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02e923-6e3d-40c6-a2ac-111f137acc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:13.239080 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02e923-6e3d-40c6-a2ac-111f137acc28 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:13.239935 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02e923-6e3d-40c6-a2ac-111f137acc28 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:13.240273 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02e923-6e3d-40c6-a2ac-111f137acc28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:13.241771 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02e923-6e3d-40c6-a2ac-111f137acc28 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:13.255363 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 52/102] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:13.260975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02e923-6e3d-40c6-a2ac-111f137acc28 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:13.296695 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 51/103] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:13.298001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cf347-1c04-4121-a9e8-d72cb95ef89c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:13.298367 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cf347-1c04-4121-a9e8-d72cb95ef89c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:13.302568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cf347-1c04-4121-a9e8-d72cb95ef89c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:13.309625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 52/104] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:13 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:13.311366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7f6c2-22db-49df-8020-d939ecdd615e None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:13.311656 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7f6c2-22db-49df-8020-d939ecdd615e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:13.311938 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7f6c2-22db-49df-8020-d939ecdd615e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:13.338327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-68d7f6c2-22db-49df-8020-d939ecdd615e None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:13.339518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-68d7f6c2-22db-49df-8020-d939ecdd615e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:13.419145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02e923-6e3d-40c6-a2ac-111f137acc28 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:13.461969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadb96c-0b2e-4355-89cc-f7ebbdd6655d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:13.462624 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadb96c-0b2e-4355-89cc-f7ebbdd6655d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:13.462909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadb96c-0b2e-4355-89cc-f7ebbdd6655d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:13.463189 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadb96c-0b2e-4355-89cc-f7ebbdd6655d None admin] PATH_INFO: `/v3/users/e99c9c8fdc9a46ddae524ed91bd45e9b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:13.469448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:13.478908 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 53/105] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:13.479859 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7f6c2-22db-49df-8020-d939ecdd615e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:13.500049 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadb96c-0b2e-4355-89cc-f7ebbdd6655d None admin] RBAC: Authorizing `identity:get_user(user_id=e99c9c8fdc9a46ddae524ed91bd45e9b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:13.500530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:13.501563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadb96c-0b2e-4355-89cc-f7ebbdd6655d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:13.512277 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 53/106] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:13 2022] GET /identity/v3/users/e99c9c8fdc9a46ddae524ed91bd45e9b => generated 289 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:13.513365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadb96c-0b2e-4355-89cc-f7ebbdd6655d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:13.608210 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7f6c2-22db-49df-8020-d939ecdd615e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:13.648684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee5abf-c054-406e-ae2d-5e156cd465be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:13.649360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee5abf-c054-406e-ae2d-5e156cd465be None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:13.649646 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee5abf-c054-406e-ae2d-5e156cd465be None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:13.649925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee5abf-c054-406e-ae2d-5e156cd465be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:13.651092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee5abf-c054-406e-ae2d-5e156cd465be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:13.652585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee5abf-c054-406e-ae2d-5e156cd465be None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:13.654931 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 54/107] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:11:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:13.655741 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee5abf-c054-406e-ae2d-5e156cd465be None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:13.729041 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadb96c-0b2e-4355-89cc-f7ebbdd6655d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:13.746832 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:13.775179 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4d29b-1f8f-4c2f-8573-4ec6b9c816ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:13.776050 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4d29b-1f8f-4c2f-8573-4ec6b9c816ab None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:13.776485 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4d29b-1f8f-4c2f-8573-4ec6b9c816ab None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:13.776875 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4d29b-1f8f-4c2f-8573-4ec6b9c816ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:13.777083 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee5abf-c054-406e-ae2d-5e156cd465be None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:13.790239 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4d29b-1f8f-4c2f-8573-4ec6b9c816ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:13.795801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-73a4d29b-1f8f-4c2f-8573-4ec6b9c816ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:13.795801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:13.795801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:13.795801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:13.795801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:13.795801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:13.795801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:13.795801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:13.795801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:13.795801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:13.795801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:13.795801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:13.795801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:13.795801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:13.795801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:13.795801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:13.796646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:13.796646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:13.796646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:13.796646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:13.796646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:13.796646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:13.796646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:13.796646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:13.796646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:13.796646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:13.796646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:13.796646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:13.796646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:13.796646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:13.796646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:13.796646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:13.798198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:13.798198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:13.798198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:13.798198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:13.798198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:13.798198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:13.798198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:13.798198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:13.798198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:13.798198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:13.798198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:13.798198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:13.798198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 54/108] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:13.799846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4d29b-1f8f-4c2f-8573-4ec6b9c816ab None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:13.817194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069c452-79d8-4512-aa80-2e30ebc309e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:13.818281 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069c452-79d8-4512-aa80-2e30ebc309e1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:13.818588 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069c452-79d8-4512-aa80-2e30ebc309e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:13.818897 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069c452-79d8-4512-aa80-2e30ebc309e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:13.870657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:13.904898 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069c452-79d8-4512-aa80-2e30ebc309e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:13.906571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069c452-79d8-4512-aa80-2e30ebc309e1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:13.929647 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4d29b-1f8f-4c2f-8573-4ec6b9c816ab None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:13.971019 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec4caa-208f-4f84-903f-aa61016d0302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:13.971653 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec4caa-208f-4f84-903f-aa61016d0302 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:13.971936 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec4caa-208f-4f84-903f-aa61016d0302 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:13.972248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec4caa-208f-4f84-903f-aa61016d0302 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:13.973913 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec4caa-208f-4f84-903f-aa61016d0302 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:13.975719 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec4caa-208f-4f84-903f-aa61016d0302 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:14.001941 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:14.013201 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 55/109] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Aug 4 10:11:13 2022] POST /identity/v3/projects => generated 302 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:11:14.013921 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec4caa-208f-4f84-903f-aa61016d0302 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:14.028903 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 55/110] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:14.034516 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069c452-79d8-4512-aa80-2e30ebc309e1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:14.178773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069c452-79d8-4512-aa80-2e30ebc309e1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:14.204858 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec4caa-208f-4f84-903f-aa61016d0302 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:14.209886 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:14.274858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eab4da-5d9f-4ec0-ae86-891fba8c4a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:14.275656 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4028350-8ef7-4832-9e16-0c7aa4271f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:14.276119 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eab4da-5d9f-4ec0-ae86-891fba8c4a42 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:14.276447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4028350-8ef7-4832-9e16-0c7aa4271f6a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:14.276829 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4028350-8ef7-4832-9e16-0c7aa4271f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:14.277066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eab4da-5d9f-4ec0-ae86-891fba8c4a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:14.277161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4028350-8ef7-4832-9e16-0c7aa4271f6a None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:14.277622 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eab4da-5d9f-4ec0-ae86-891fba8c4a42 None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:14.278057 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4028350-8ef7-4832-9e16-0c7aa4271f6a None admin] RBAC: Adding query filter params (name=member) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:14.278405 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4028350-8ef7-4832-9e16-0c7aa4271f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:14.279583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eab4da-5d9f-4ec0-ae86-891fba8c4a42 None admin] RBAC: Authorizing `identity:get_project(project_id=8c7f15d3ce55460993f520e6f8838a8a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:14.280224 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4028350-8ef7-4832-9e16-0c7aa4271f6a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:14.281531 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eab4da-5d9f-4ec0-ae86-891fba8c4a42 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:14.288275 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 56/111] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:14 2022] GET /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:14.295326 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eab4da-5d9f-4ec0-ae86-891fba8c4a42 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:14.297498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 56/112] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:14.304306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4028350-8ef7-4832-9e16-0c7aa4271f6a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:14.403697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:14.474774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4028350-8ef7-4832-9e16-0c7aa4271f6a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:14.485825 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eab4da-5d9f-4ec0-ae86-891fba8c4a42 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:14.524266 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e012d-6cdb-4ecc-829c-5218d16c47af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:14.525021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e012d-6cdb-4ecc-829c-5218d16c47af None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:14.525413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e012d-6cdb-4ecc-829c-5218d16c47af None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:14.525697 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e012d-6cdb-4ecc-829c-5218d16c47af None admin] PATH_INFO: `/v3/users/ec0e7e1f75384c61b47651e3ecc71eb1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:14.527456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e012d-6cdb-4ecc-829c-5218d16c47af None admin] RBAC: Authorizing `identity:get_user(user_id=ec0e7e1f75384c61b47651e3ecc71eb1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:14.528978 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e012d-6cdb-4ecc-829c-5218d16c47af None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:14.530897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 57/113] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:14 2022] GET /identity/v3/users/ec0e7e1f75384c61b47651e3ecc71eb1 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:14.531007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badb473-b838-4c5a-8214-09155a1094e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:14.531495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badb473-b838-4c5a-8214-09155a1094e2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:14.531784 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badb473-b838-4c5a-8214-09155a1094e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:14.532118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badb473-b838-4c5a-8214-09155a1094e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:14.535008 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee2a71-9499-4caf-bddf-815a6d620c22 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:14.535008 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee2a71-9499-4caf-bddf-815a6d620c22 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:14.535203 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badb473-b838-4c5a-8214-09155a1094e2 None admin] RBAC: Adding query filter params (role.id=439977f47a30404790859f8a0d504997, scope.project.id=8c7f15d3ce55460993f520e6f8838a8a, user.id=e99c9c8fdc9a46ddae524ed91bd45e9b) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:14.535319 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee2a71-9499-4caf-bddf-815a6d620c22 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:14.535406 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badb473-b838-4c5a-8214-09155a1094e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:14.535498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 58/114] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:14.535578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badb473-b838-4c5a-8214-09155a1094e2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:14.539615 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee2a71-9499-4caf-bddf-815a6d620c22 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:14.545483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 57/115] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:11:14 2022] GET /identity/v3/role_assignments?user.id=e99c9c8fdc9a46ddae524ed91bd45e9b&scope.project.id=8c7f15d3ce55460993f520e6f8838a8a&role.id=439977f47a30404790859f8a0d504997 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:14.547790 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41c0ab-5f56-417a-ae9e-4ebb24f7203e None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:14.548088 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41c0ab-5f56-417a-ae9e-4ebb24f7203e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:14.548400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41c0ab-5f56-417a-ae9e-4ebb24f7203e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:14.574621 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-4c41c0ab-5f56-417a-ae9e-4ebb24f7203e None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:14.576789 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4c41c0ab-5f56-417a-ae9e-4ebb24f7203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:14.597158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:14.688453 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee2a71-9499-4caf-bddf-815a6d620c22 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:14.735529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3855c-2714-4177-9a36-5728ae2b8920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:14.736450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3855c-2714-4177-9a36-5728ae2b8920 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:14.736850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3855c-2714-4177-9a36-5728ae2b8920 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:14.737139 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3855c-2714-4177-9a36-5728ae2b8920 None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:14.738001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 58/116] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:14.740028 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33129c-0d4c-4df6-afc9-8f33311ce00c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:14.740284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33129c-0d4c-4df6-afc9-8f33311ce00c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:14.740551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33129c-0d4c-4df6-afc9-8f33311ce00c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:14.741884 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 59/117] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:14.744344 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3855c-2714-4177-9a36-5728ae2b8920 None admin] RBAC: Authorizing `identity:get_project(project_id=8c7f15d3ce55460993f520e6f8838a8a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:14.747483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3855c-2714-4177-9a36-5728ae2b8920 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:14.749802 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8c0bd-c99b-4bde-8996-63693c124c44 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:14.750017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 59/118] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:14 2022] GET /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:14.750530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8c0bd-c99b-4bde-8996-63693c124c44 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:14.750963 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8c0bd-c99b-4bde-8996-63693c124c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:14.757635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3855c-2714-4177-9a36-5728ae2b8920 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:14.787385 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-efe8c0bd-c99b-4bde-8996-63693c124c44 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:14.788684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-efe8c0bd-c99b-4bde-8996-63693c124c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:14.824871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:14.870285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 60/119] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:14.871658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8c0bd-c99b-4bde-8996-63693c124c44 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:14.908978 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3855c-2714-4177-9a36-5728ae2b8920 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:14.911379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:14.956723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79199e-ea14-4610-9ba8-8cbcf8218c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:14.958429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79199e-ea14-4610-9ba8-8cbcf8218c7e None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:14.958764 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79199e-ea14-4610-9ba8-8cbcf8218c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:14.959241 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79199e-ea14-4610-9ba8-8cbcf8218c7e None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a/users/ec0e7e1f75384c61b47651e3ecc71eb1/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:14.961846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79199e-ea14-4610-9ba8-8cbcf8218c7e None admin] RBAC: Authorizing `identity:create_grant(project_id=8c7f15d3ce55460993f520e6f8838a8a, user_id=ec0e7e1f75384c61b47651e3ecc71eb1, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:14.963446 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79199e-ea14-4610-9ba8-8cbcf8218c7e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:14.981837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 60/120] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:11:14 2022] PUT /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a/users/ec0e7e1f75384c61b47651e3ecc71eb1/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:11:14.988321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce5b99-f38d-4a45-ae5f-7dd3b9dd09f7 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:14.988321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce5b99-f38d-4a45-ae5f-7dd3b9dd09f7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:14.988321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce5b99-f38d-4a45-ae5f-7dd3b9dd09f7 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:14.988321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 61/121] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:14.988321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce5b99-f38d-4a45-ae5f-7dd3b9dd09f7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:15.046583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8c0bd-c99b-4bde-8996-63693c124c44 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:15.137457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce5b99-f38d-4a45-ae5f-7dd3b9dd09f7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:15.161811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f08e5-964d-4d47-a04c-3b9cb66f1972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:15.162794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f08e5-964d-4d47-a04c-3b9cb66f1972 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:15.163287 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f08e5-964d-4d47-a04c-3b9cb66f1972 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:15.163745 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f08e5-964d-4d47-a04c-3b9cb66f1972 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:15.184036 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c194e63-ac5b-41b6-9b2f-8d2f662c9258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:15.184743 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c194e63-ac5b-41b6-9b2f-8d2f662c9258 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:15.185037 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c194e63-ac5b-41b6-9b2f-8d2f662c9258 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:15.185321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c194e63-ac5b-41b6-9b2f-8d2f662c9258 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:15.196265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f08e5-964d-4d47-a04c-3b9cb66f1972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:15.199337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c194e63-ac5b-41b6-9b2f-8d2f662c9258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:15.205215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-4c194e63-ac5b-41b6-9b2f-8d2f662c9258 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:15.205215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:15.205215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:15.205215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:15.205215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:15.205215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:15.205215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:15.205215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:15.205215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:15.205215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:15.205215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:15.205215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:15.205215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:15.205215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:15.205215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:15.205215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:15.206127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:15.206127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:15.206127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:15.206127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:15.206127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:15.206127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:15.206127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:15.206127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:15.206127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:15.206127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:15.206127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:15.206127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:15.206127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:15.206127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:15.206127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:15.206127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:15.206861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:15.206861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:15.206861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:15.206861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:15.206861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:15.206861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:15.206861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:15.206861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:15.206861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:15.206861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:15.206861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:15.206861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:15.206861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 62/122] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:11:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:15.208682 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be5f8f-e384-4d55-bb2b-bc6895738456 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:15.212201 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be5f8f-e384-4d55-bb2b-bc6895738456 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:15.212201 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be5f8f-e384-4d55-bb2b-bc6895738456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:15.212548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-206f08e5-964d-4d47-a04c-3b9cb66f1972 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:15.212548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:15.212548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:15.212548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:15.212548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:15.212548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:15.212548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:15.212548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:15.212548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:15.212548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:15.212548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:15.212548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:15.212548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:15.212548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:15.212548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:15.212548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:15.215468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:15.215468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:15.215468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:15.215468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:15.215468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:15.215468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:15.215468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:15.215468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:15.215468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:15.215468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:15.215468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:15.215468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:15.215468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:15.215468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:15.215468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:15.215468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:15.218020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:15.218020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:15.218020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:15.218020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:15.218020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:15.218020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:15.218020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:15.218020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:15.218020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:15.218020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:15.218020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:15.218020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:15.218020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 61/123] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:15.226841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f08e5-964d-4d47-a04c-3b9cb66f1972 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:15.232444 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-47be5f8f-e384-4d55-bb2b-bc6895738456 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:15.234017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-47be5f8f-e384-4d55-bb2b-bc6895738456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:15.260460 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:15.289668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:15.316854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 63/124] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:15.318047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be5f8f-e384-4d55-bb2b-bc6895738456 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:15.410176 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f08e5-964d-4d47-a04c-3b9cb66f1972 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:15.425062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be5f8f-e384-4d55-bb2b-bc6895738456 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:15.461877 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1d87f-e3b4-4078-b9c8-650923eb4388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:15.462641 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1d87f-e3b4-4078-b9c8-650923eb4388 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:15.463004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1d87f-e3b4-4078-b9c8-650923eb4388 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:15.463350 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1d87f-e3b4-4078-b9c8-650923eb4388 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:15.464283 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1d87f-e3b4-4078-b9c8-650923eb4388 None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:15.464658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1d87f-e3b4-4078-b9c8-650923eb4388 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:15.466011 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1245f5-be98-4237-9997-3521c06130ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:15.466376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1d87f-e3b4-4078-b9c8-650923eb4388 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:15.467073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1245f5-be98-4237-9997-3521c06130ba None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:15.467555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1245f5-be98-4237-9997-3521c06130ba None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:15.468039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1245f5-be98-4237-9997-3521c06130ba None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:15.468988 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1245f5-be98-4237-9997-3521c06130ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:15.469493 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1245f5-be98-4237-9997-3521c06130ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:15.471070 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1245f5-be98-4237-9997-3521c06130ba None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:15.478308 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 62/125] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:15.479417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1d87f-e3b4-4078-b9c8-650923eb4388 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:15.485989 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 64/126] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:11:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:15.492403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1245f5-be98-4237-9997-3521c06130ba None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:15.510486 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:15.600817 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1245f5-be98-4237-9997-3521c06130ba None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:15.607755 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:15.622458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1d87f-e3b4-4078-b9c8-650923eb4388 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:15.639456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ddda9-d8f3-41e1-8e6f-87536790367b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:15.640581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ddda9-d8f3-41e1-8e6f-87536790367b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:15.641421 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ddda9-d8f3-41e1-8e6f-87536790367b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:15.642033 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ddda9-d8f3-41e1-8e6f-87536790367b None admin] PATH_INFO: `/v3/users/ec0e7e1f75384c61b47651e3ecc71eb1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:15.643593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ddda9-d8f3-41e1-8e6f-87536790367b None admin] RBAC: Authorizing `identity:get_user(user_id=ec0e7e1f75384c61b47651e3ecc71eb1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:15.650135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ddda9-d8f3-41e1-8e6f-87536790367b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:15.655991 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 65/127] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:15 2022] GET /identity/v3/users/ec0e7e1f75384c61b47651e3ecc71eb1 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:15.657051 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ddda9-d8f3-41e1-8e6f-87536790367b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:15.681833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c27ba0-6c42-4aa9-84fa-6e781a381e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:15.682965 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c27ba0-6c42-4aa9-84fa-6e781a381e57 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:15.683472 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c27ba0-6c42-4aa9-84fa-6e781a381e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:15.683953 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c27ba0-6c42-4aa9-84fa-6e781a381e57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:15.703965 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c27ba0-6c42-4aa9-84fa-6e781a381e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:15.714672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-26c27ba0-6c42-4aa9-84fa-6e781a381e57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:15.714672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:15.714672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:15.714672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:15.714672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:15.714672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:15.714672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:15.714672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:15.714672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:15.714672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:15.714672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:15.714672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:15.714672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:15.714672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:15.714672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:15.714672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:15.715552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:15.715552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:15.715552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:15.715552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:15.715552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:15.715552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:15.715552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:15.715552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:15.715552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:15.715552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:15.715552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:15.715552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:15.715552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:15.715552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:15.715552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:15.715552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:15.716330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:15.716330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:15.716330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:15.716330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:15.716330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:15.716330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:15.716330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:15.716330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:15.716330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:15.716330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:15.716330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:15.716330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:15.721959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 63/128] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:11:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:15.724347 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c27ba0-6c42-4aa9-84fa-6e781a381e57 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:15.816283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:15.866541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ddda9-d8f3-41e1-8e6f-87536790367b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:15.890642 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c27ba0-6c42-4aa9-84fa-6e781a381e57 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:15.926920 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ff36c-e654-454c-9bad-21287d1586ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:15.928038 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ff36c-e654-454c-9bad-21287d1586ed None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:15.928553 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ff36c-e654-454c-9bad-21287d1586ed None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:15.929122 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ff36c-e654-454c-9bad-21287d1586ed None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:15.930602 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ff36c-e654-454c-9bad-21287d1586ed None admin] RBAC: Authorizing `identity:get_project(project_id=8c7f15d3ce55460993f520e6f8838a8a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:15.932311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ff36c-e654-454c-9bad-21287d1586ed None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:15.934611 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 64/129] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:15 2022] GET /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:15.935266 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8c42c-94ac-4b33-b552-3744f2a736b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:15.940259 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ff36c-e654-454c-9bad-21287d1586ed None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:15.940393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8c42c-94ac-4b33-b552-3744f2a736b9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:15.940393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8c42c-94ac-4b33-b552-3744f2a736b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:15.940393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8c42c-94ac-4b33-b552-3744f2a736b9 None admin] PATH_INFO: `/v3/users/ec0e7e1f75384c61b47651e3ecc71eb1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:15.941399 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8c42c-94ac-4b33-b552-3744f2a736b9 None admin] RBAC: Authorizing `identity:get_user(user_id=ec0e7e1f75384c61b47651e3ecc71eb1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:15.943543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8c42c-94ac-4b33-b552-3744f2a736b9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:15.949122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 66/130] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:15 2022] GET /identity/v3/users/ec0e7e1f75384c61b47651e3ecc71eb1 => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:15.949979 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8c42c-94ac-4b33-b552-3744f2a736b9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:15.972582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:16.051801 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ff36c-e654-454c-9bad-21287d1586ed None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:16.132428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8c42c-94ac-4b33-b552-3744f2a736b9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:16.134725 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211a5ce-785a-429f-9076-35fd190b8165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:16.135616 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211a5ce-785a-429f-9076-35fd190b8165 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:16.135913 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211a5ce-785a-429f-9076-35fd190b8165 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:16.136216 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211a5ce-785a-429f-9076-35fd190b8165 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:16.136964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211a5ce-785a-429f-9076-35fd190b8165 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:16.137278 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211a5ce-785a-429f-9076-35fd190b8165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:16.138699 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211a5ce-785a-429f-9076-35fd190b8165 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:16.165578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 65/131] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:16.166279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211a5ce-785a-429f-9076-35fd190b8165 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:16.194680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccbb93-3223-4a99-89f3-eda5e13f7170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:16.195390 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccbb93-3223-4a99-89f3-eda5e13f7170 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:16.195679 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccbb93-3223-4a99-89f3-eda5e13f7170 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:16.195965 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccbb93-3223-4a99-89f3-eda5e13f7170 None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a/users/ec0e7e1f75384c61b47651e3ecc71eb1/roles/472f2455c837486084f108ce944f1bff` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:16.205158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccbb93-3223-4a99-89f3-eda5e13f7170 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c7f15d3ce55460993f520e6f8838a8a, user_id=ec0e7e1f75384c61b47651e3ecc71eb1, role_id=472f2455c837486084f108ce944f1bff)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:16.206660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccbb93-3223-4a99-89f3-eda5e13f7170 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:16.242452 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 67/132] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:11:15 2022] PUT /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a/users/ec0e7e1f75384c61b47651e3ecc71eb1/roles/472f2455c837486084f108ce944f1bff => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:11:16.243396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccbb93-3223-4a99-89f3-eda5e13f7170 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:16.272861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:16.312632 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:16.368532 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211a5ce-785a-429f-9076-35fd190b8165 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:16.447921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005e720-24b2-4307-95f2-7a9a811c2096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:16.448718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005e720-24b2-4307-95f2-7a9a811c2096 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:16.449123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005e720-24b2-4307-95f2-7a9a811c2096 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:16.449491 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005e720-24b2-4307-95f2-7a9a811c2096 None admin] PATH_INFO: `/v3/projects/7a0263c81cf1486cbae00010d6dc63e9` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:16.457100 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005e720-24b2-4307-95f2-7a9a811c2096 None admin] RBAC: Authorizing `identity:get_project(project_id=7a0263c81cf1486cbae00010d6dc63e9)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:16.459089 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005e720-24b2-4307-95f2-7a9a811c2096 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:16.460934 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 66/133] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:16 2022] GET /identity/v3/projects/7a0263c81cf1486cbae00010d6dc63e9 => generated 312 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:16.470249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005e720-24b2-4307-95f2-7a9a811c2096 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:16.502069 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccbb93-3223-4a99-89f3-eda5e13f7170 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:16.545492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f462209-7dce-44ca-9773-2b2ff52ee5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:16.546764 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f462209-7dce-44ca-9773-2b2ff52ee5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:16.547540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f462209-7dce-44ca-9773-2b2ff52ee5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:16.548073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f462209-7dce-44ca-9773-2b2ff52ee5b2 None admin] PATH_INFO: `/v3/users/d47a57563f9b4a2aa0de495b20f1a6be` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:16.549502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f462209-7dce-44ca-9773-2b2ff52ee5b2 None admin] RBAC: Authorizing `identity:get_user(user_id=d47a57563f9b4a2aa0de495b20f1a6be)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:16.551232 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f462209-7dce-44ca-9773-2b2ff52ee5b2 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:16.553797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 68/134] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:16 2022] GET /identity/v3/users/d47a57563f9b4a2aa0de495b20f1a6be => generated 247 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:16.560546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f462209-7dce-44ca-9773-2b2ff52ee5b2 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:16.696655 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:16.717825 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f462209-7dce-44ca-9773-2b2ff52ee5b2 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:16.756696 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f17cc-1cdd-4b42-924f-a02a42838610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:16.757367 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f17cc-1cdd-4b42-924f-a02a42838610 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:16.757658 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f17cc-1cdd-4b42-924f-a02a42838610 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:16.757945 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f17cc-1cdd-4b42-924f-a02a42838610 None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:16.759171 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f17cc-1cdd-4b42-924f-a02a42838610 None admin] RBAC: Authorizing `identity:get_project(project_id=8c7f15d3ce55460993f520e6f8838a8a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:16.762340 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f17cc-1cdd-4b42-924f-a02a42838610 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:16.764276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 69/135] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:16 2022] GET /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:16.770886 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f17cc-1cdd-4b42-924f-a02a42838610 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:16.830193 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005e720-24b2-4307-95f2-7a9a811c2096 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:16.887679 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f17cc-1cdd-4b42-924f-a02a42838610 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:16.924946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a163b62-97a5-4523-90a7-14d1da8b43b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:16.925644 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a163b62-97a5-4523-90a7-14d1da8b43b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:16.926039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a163b62-97a5-4523-90a7-14d1da8b43b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:16.926990 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a163b62-97a5-4523-90a7-14d1da8b43b4 None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a/users/d47a57563f9b4a2aa0de495b20f1a6be/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:16.929061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a163b62-97a5-4523-90a7-14d1da8b43b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c7f15d3ce55460993f520e6f8838a8a, user_id=d47a57563f9b4a2aa0de495b20f1a6be, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:16.930911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a163b62-97a5-4523-90a7-14d1da8b43b4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:16.950859 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 70/136] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:11:16 2022] PUT /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a/users/d47a57563f9b4a2aa0de495b20f1a6be/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:11:16.953128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fcd11-fadf-4c88-9a4f-33ab95be6a7e None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:16.953425 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fcd11-fadf-4c88-9a4f-33ab95be6a7e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:16.953712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fcd11-fadf-4c88-9a4f-33ab95be6a7e None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:16.955022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8afa5-74f8-4d44-93dd-6e093b545b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:16.955778 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8afa5-74f8-4d44-93dd-6e093b545b68 None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:16.956073 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8afa5-74f8-4d44-93dd-6e093b545b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:16.956380 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8afa5-74f8-4d44-93dd-6e093b545b68 None admin] PATH_INFO: `/v3/projects/7a0263c81cf1486cbae00010d6dc63e9/users/ec0e7e1f75384c61b47651e3ecc71eb1/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:16.958957 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 71/137] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:16.960379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8afa5-74f8-4d44-93dd-6e093b545b68 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a0263c81cf1486cbae00010d6dc63e9, user_id=ec0e7e1f75384c61b47651e3ecc71eb1, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:16.961926 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8afa5-74f8-4d44-93dd-6e093b545b68 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:16.964666 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eb286-c37f-49ec-b061-9ef7df27289f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:16.964960 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eb286-c37f-49ec-b061-9ef7df27289f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:16.965241 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eb286-c37f-49ec-b061-9ef7df27289f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:16.992065 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:16.995524 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 67/138] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:11:16 2022] PUT /identity/v3/projects/7a0263c81cf1486cbae00010d6dc63e9/users/ec0e7e1f75384c61b47651e3ecc71eb1/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:11:17.000636 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ce5eb286-c37f-49ec-b061-9ef7df27289f None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:17.002355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ce5eb286-c37f-49ec-b061-9ef7df27289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:17.084928 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 72/139] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:17.110866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8afa5-74f8-4d44-93dd-6e093b545b68 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:17.124510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:17.234617 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8afa5-74f8-4d44-93dd-6e093b545b68 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:17.283346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe1ce6-fed2-4b67-ae67-db24f24ab17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:17.283950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe1ce6-fed2-4b67-ae67-db24f24ab17f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:17.284265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe1ce6-fed2-4b67-ae67-db24f24ab17f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:17.284556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe1ce6-fed2-4b67-ae67-db24f24ab17f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:17.286429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe1ce6-fed2-4b67-ae67-db24f24ab17f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:17.287938 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe1ce6-fed2-4b67-ae67-db24f24ab17f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:17.289680 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 68/140] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:11:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:17.295556 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eb286-c37f-49ec-b061-9ef7df27289f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:17.413252 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eb286-c37f-49ec-b061-9ef7df27289f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:17.450767 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260292d-0306-4ecf-8fac-33fe393e2ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:17.451404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260292d-0306-4ecf-8fac-33fe393e2ab9 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:17.451689 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260292d-0306-4ecf-8fac-33fe393e2ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:17.451972 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260292d-0306-4ecf-8fac-33fe393e2ab9 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:17.452714 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260292d-0306-4ecf-8fac-33fe393e2ab9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:17.454180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260292d-0306-4ecf-8fac-33fe393e2ab9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:17.463566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:17.479617 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 73/141] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Aug 4 10:11:17 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:11:17.487437 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd825cd0-0cc0-4a19-ae0e-219e8de2a1c9 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:17.487740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd825cd0-0cc0-4a19-ae0e-219e8de2a1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:17.488023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd825cd0-0cc0-4a19-ae0e-219e8de2a1c9 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:17.490040 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 69/142] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:17.496580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5924844-8ae1-418d-a37e-c3e2bc989a79 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:17.496902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5924844-8ae1-418d-a37e-c3e2bc989a79 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:17.497154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5924844-8ae1-418d-a37e-c3e2bc989a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:17.521784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c5924844-8ae1-418d-a37e-c3e2bc989a79 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:17.523096 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c5924844-8ae1-418d-a37e-c3e2bc989a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:17.615103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 74/143] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:17.637751 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd825cd0-0cc0-4a19-ae0e-219e8de2a1c9 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:17.744348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:17.777993 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd825cd0-0cc0-4a19-ae0e-219e8de2a1c9 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:17.826349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c70df-40da-4e96-af2a-5aac1f6ac705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:17.827405 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c70df-40da-4e96-af2a-5aac1f6ac705 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:17.827902 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c70df-40da-4e96-af2a-5aac1f6ac705 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:17.828480 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c70df-40da-4e96-af2a-5aac1f6ac705 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:17.849554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c70df-40da-4e96-af2a-5aac1f6ac705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:17.854970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-807c70df-40da-4e96-af2a-5aac1f6ac705 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 10:11:17.854970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:17.854970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:17.854970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:17.854970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:17.854970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:17.854970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:17.854970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:17.854970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:17.854970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:17.854970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:17.854970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:17.854970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:17.854970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:17.854970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:17.854970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:17.855824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:17.855824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:17.855824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:17.855824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:17.855824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:17.855824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:17.855824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:17.855824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:17.855824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:17.855824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:17.855824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:17.855824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:17.855824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:17.855824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:17.855824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:17.855824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:17.856654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:17.856654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:17.856654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:17.856654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:17.856654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:17.856654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:17.856654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:17.856654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:17.856654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:17.856654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:17.856654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 10:11:17.856654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:17.858989 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 70/144] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:17.865496 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5924844-8ae1-418d-a37e-c3e2bc989a79 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:18.045944 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5924844-8ae1-418d-a37e-c3e2bc989a79 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:18.087041 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:18.102091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569af2a-6e57-49b2-a886-f9e3515f1488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:18.102725 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569af2a-6e57-49b2-a886-f9e3515f1488 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:18.103008 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569af2a-6e57-49b2-a886-f9e3515f1488 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:18.103285 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569af2a-6e57-49b2-a886-f9e3515f1488 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:18.104056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569af2a-6e57-49b2-a886-f9e3515f1488 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:18.104405 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569af2a-6e57-49b2-a886-f9e3515f1488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:18.105867 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569af2a-6e57-49b2-a886-f9e3515f1488 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:18.120389 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 75/145] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:18.126116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c70df-40da-4e96-af2a-5aac1f6ac705 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:18.262854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec05445-702c-481a-8b39-09f3f427d5c5 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:18.263540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec05445-702c-481a-8b39-09f3f427d5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:18.264020 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec05445-702c-481a-8b39-09f3f427d5c5 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:18.265599 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 76/146] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:18.268188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c70df-40da-4e96-af2a-5aac1f6ac705 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:18.272510 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134d426-759f-4aff-baf2-2e07e673ebcd None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:18.273091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134d426-759f-4aff-baf2-2e07e673ebcd None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:18.273586 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134d426-759f-4aff-baf2-2e07e673ebcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:18.310322 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b134d426-759f-4aff-baf2-2e07e673ebcd None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:18.311952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b134d426-759f-4aff-baf2-2e07e673ebcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:18.317230 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea9cb5-1f9d-46ba-a7e8-da8c0305952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:18.318028 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea9cb5-1f9d-46ba-a7e8-da8c0305952a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:18.318270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea9cb5-1f9d-46ba-a7e8-da8c0305952a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:18.318561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea9cb5-1f9d-46ba-a7e8-da8c0305952a None admin] PATH_INFO: `/v3/users/e99c9c8fdc9a46ddae524ed91bd45e9b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:18.320940 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea9cb5-1f9d-46ba-a7e8-da8c0305952a None admin] RBAC: Authorizing `identity:get_user(user_id=e99c9c8fdc9a46ddae524ed91bd45e9b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:18.322533 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea9cb5-1f9d-46ba-a7e8-da8c0305952a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:18.327869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 71/147] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:18 2022] GET /identity/v3/users/e99c9c8fdc9a46ddae524ed91bd45e9b => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:18.331466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea9cb5-1f9d-46ba-a7e8-da8c0305952a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:18.340562 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:18.460581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 77/148] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:18.491124 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134d426-759f-4aff-baf2-2e07e673ebcd None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:18.532553 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea9cb5-1f9d-46ba-a7e8-da8c0305952a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:18.649567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b5850-5da6-462a-9de2-a8fb00f043eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:18.650249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b5850-5da6-462a-9de2-a8fb00f043eb None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:18.650537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b5850-5da6-462a-9de2-a8fb00f043eb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:18.650830 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b5850-5da6-462a-9de2-a8fb00f043eb None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:18.651510 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134d426-759f-4aff-baf2-2e07e673ebcd None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:18.652024 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b5850-5da6-462a-9de2-a8fb00f043eb None admin] RBAC: Authorizing `identity:get_project(project_id=8c7f15d3ce55460993f520e6f8838a8a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:18.653609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b5850-5da6-462a-9de2-a8fb00f043eb None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:18.655519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 72/149] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:18 2022] GET /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:18.669896 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b5850-5da6-462a-9de2-a8fb00f043eb None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:18.678245 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:18.720903 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662bfb3-009f-4217-ba6f-86fdf308fb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:18.721483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662bfb3-009f-4217-ba6f-86fdf308fb51 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:18.721765 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662bfb3-009f-4217-ba6f-86fdf308fb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:18.722041 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662bfb3-009f-4217-ba6f-86fdf308fb51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:18.743342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662bfb3-009f-4217-ba6f-86fdf308fb51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:18.753773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-7662bfb3-009f-4217-ba6f-86fdf308fb51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:18.753773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:18.753773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:18.753773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:18.753773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:18.753773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:18.753773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:18.753773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:18.753773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:18.753773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:18.753773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:18.753773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:18.753773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:18.753773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:18.753773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:18.753773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:18.755253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:18.755253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:18.755253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:18.755253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:18.755253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:18.755253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:18.755253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:18.755253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:18.755253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:18.755253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:18.755253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:18.755253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:18.755253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:18.755253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:18.755253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:18.755253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:18.756136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:18.756136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:18.756136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:18.756136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:18.756136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:18.756136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:18.756136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:18.756136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:18.756136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:18.756136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:18.756136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:18.756136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:18.757874 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 78/150] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:11:18.763659 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662bfb3-009f-4217-ba6f-86fdf308fb51 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:18.812549 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:18.870743 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b5850-5da6-462a-9de2-a8fb00f043eb None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:18.925934 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ad783-6aac-43c9-b814-d70dc8a97adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:18.927599 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ad783-6aac-43c9-b814-d70dc8a97adb None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:18.928034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ad783-6aac-43c9-b814-d70dc8a97adb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:18.928483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ad783-6aac-43c9-b814-d70dc8a97adb None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a/users/e99c9c8fdc9a46ddae524ed91bd45e9b/roles/439977f47a30404790859f8a0d504997` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:18.930828 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ad783-6aac-43c9-b814-d70dc8a97adb None admin] RBAC: Authorizing `identity:create_grant(project_id=8c7f15d3ce55460993f520e6f8838a8a, user_id=e99c9c8fdc9a46ddae524ed91bd45e9b, role_id=439977f47a30404790859f8a0d504997)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:18.932479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ad783-6aac-43c9-b814-d70dc8a97adb None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:18.955718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 73/151] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:11:18 2022] PUT /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a/users/e99c9c8fdc9a46ddae524ed91bd45e9b/roles/439977f47a30404790859f8a0d504997 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:11:18.980242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662bfb3-009f-4217-ba6f-86fdf308fb51 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:19.022809 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a0340-983c-4c60-b086-9fcdadd1d026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:19.023472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a0340-983c-4c60-b086-9fcdadd1d026 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:19.023757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a0340-983c-4c60-b086-9fcdadd1d026 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:19.024039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a0340-983c-4c60-b086-9fcdadd1d026 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:19.024833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a0340-983c-4c60-b086-9fcdadd1d026 None admin] RBAC: Adding query filter params (name=member) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:19.025144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a0340-983c-4c60-b086-9fcdadd1d026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:19.026583 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a0340-983c-4c60-b086-9fcdadd1d026 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:19.041378 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 79/152] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:19.047266 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ad783-6aac-43c9-b814-d70dc8a97adb None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:19.204089 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ad783-6aac-43c9-b814-d70dc8a97adb None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:19.240816 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:19.249554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76c6e0-3d83-4bc7-a41c-fb8312587892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:19.250622 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76c6e0-3d83-4bc7-a41c-fb8312587892 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:19.251105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76c6e0-3d83-4bc7-a41c-fb8312587892 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:19.251589 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76c6e0-3d83-4bc7-a41c-fb8312587892 None admin] PATH_INFO: `/v3/users/ec0e7e1f75384c61b47651e3ecc71eb1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:19.253036 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76c6e0-3d83-4bc7-a41c-fb8312587892 None admin] RBAC: Authorizing `identity:get_user(user_id=ec0e7e1f75384c61b47651e3ecc71eb1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:19.255365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76c6e0-3d83-4bc7-a41c-fb8312587892 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:19.257291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 74/153] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:19 2022] GET /identity/v3/users/ec0e7e1f75384c61b47651e3ecc71eb1 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:19.263940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a0340-983c-4c60-b086-9fcdadd1d026 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:19.320479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:19.354398 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ed53d-b9c2-47fa-8caa-b4dfa54068ea None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:19.355053 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ed53d-b9c2-47fa-8caa-b4dfa54068ea None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:19.355550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ed53d-b9c2-47fa-8caa-b4dfa54068ea None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:19.357707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 75/154] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:19.364696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63212c-5a4a-46f7-abdd-cbb60e7ae7bb None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:19.365571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63212c-5a4a-46f7-abdd-cbb60e7ae7bb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:19.366185 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63212c-5a4a-46f7-abdd-cbb60e7ae7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:19.398759 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-9e63212c-5a4a-46f7-abdd-cbb60e7ae7bb None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:19.400525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9e63212c-5a4a-46f7-abdd-cbb60e7ae7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:19.408191 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a0340-983c-4c60-b086-9fcdadd1d026 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:19.443275 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef2061-8a8a-4d39-bb10-24e2e60c6dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:19.443940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef2061-8a8a-4d39-bb10-24e2e60c6dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:19.444255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef2061-8a8a-4d39-bb10-24e2e60c6dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:19.444546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef2061-8a8a-4d39-bb10-24e2e60c6dd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:19.537003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 76/155] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:19.538643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef2061-8a8a-4d39-bb10-24e2e60c6dd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:19.540134 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef2061-8a8a-4d39-bb10-24e2e60c6dd9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:19.576211 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:19.593781 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63212c-5a4a-46f7-abdd-cbb60e7ae7bb None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:19.646694 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 80/156] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:19.652369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef2061-8a8a-4d39-bb10-24e2e60c6dd9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:19.758496 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef2061-8a8a-4d39-bb10-24e2e60c6dd9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:19.775850 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63212c-5a4a-46f7-abdd-cbb60e7ae7bb None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:19.798715 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d6870-f1fa-4b12-b342-6fe1850f1392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:19.799304 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d6870-f1fa-4b12-b342-6fe1850f1392 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:19.799594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d6870-f1fa-4b12-b342-6fe1850f1392 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:19.799874 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d6870-f1fa-4b12-b342-6fe1850f1392 None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:19.802931 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d6870-f1fa-4b12-b342-6fe1850f1392 None admin] RBAC: Authorizing `identity:get_project(project_id=8c7f15d3ce55460993f520e6f8838a8a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:19.805327 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d6870-f1fa-4b12-b342-6fe1850f1392 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:19.807095 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 81/157] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:19 2022] GET /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:19.820181 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d6870-f1fa-4b12-b342-6fe1850f1392 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:19.833167 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:19.843662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:19.858311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06e974-f443-4771-a12e-cf20b87306ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:19.859014 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06e974-f443-4771-a12e-cf20b87306ee None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:19.859325 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06e974-f443-4771-a12e-cf20b87306ee None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:19.859600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06e974-f443-4771-a12e-cf20b87306ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:19.885103 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06e974-f443-4771-a12e-cf20b87306ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:19.890394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-da06e974-f443-4771-a12e-cf20b87306ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:19.890394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:19.890394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:19.890394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:19.890394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:19.890394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:19.890394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:19.890394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:19.890394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:19.890394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:19.890394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:19.890394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:19.890394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:19.890394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:19.890394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:19.890394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:19.891348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:19.891348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:19.891348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:19.891348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:19.891348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:19.891348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:19.891348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:19.891348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:19.891348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:19.891348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:19.891348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:19.891348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:19.891348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:19.891348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:19.891348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:19.891348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:19.893043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:19.893043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:19.893043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:19.893043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:19.893043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:19.893043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:19.893043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:19.893043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:19.893043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:19.893043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:19.893043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:19.893043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:19.893043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 77/158] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:11:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:19.901501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06e974-f443-4771-a12e-cf20b87306ee None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:19.933736 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d6870-f1fa-4b12-b342-6fe1850f1392 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:19.972014 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7c71d-0961-4a31-b3c3-80f3c0278d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:19.972716 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7c71d-0961-4a31-b3c3-80f3c0278d54 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:19.973052 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7c71d-0961-4a31-b3c3-80f3c0278d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:19.973338 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7c71d-0961-4a31-b3c3-80f3c0278d54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:19.974167 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7c71d-0961-4a31-b3c3-80f3c0278d54 None admin] RBAC: Adding query filter params (role.id=50575a0d3f4340ee92356ce22ff3e62a, scope.project.id=8c7f15d3ce55460993f520e6f8838a8a, user.id=ec0e7e1f75384c61b47651e3ecc71eb1) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:19.974486 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7c71d-0961-4a31-b3c3-80f3c0278d54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:19.976067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7c71d-0961-4a31-b3c3-80f3c0278d54 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:19.982898 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 82/159] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:11:19 2022] GET /identity/v3/role_assignments?user.id=ec0e7e1f75384c61b47651e3ecc71eb1&scope.project.id=8c7f15d3ce55460993f520e6f8838a8a&role.id=50575a0d3f4340ee92356ce22ff3e62a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:20.111758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06e974-f443-4771-a12e-cf20b87306ee None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:20.161125 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea599995-7403-4870-8945-f9a6a3d48213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:20.161752 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea599995-7403-4870-8945-f9a6a3d48213 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:20.162032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea599995-7403-4870-8945-f9a6a3d48213 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:20.162305 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea599995-7403-4870-8945-f9a6a3d48213 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:20.163024 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea599995-7403-4870-8945-f9a6a3d48213 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:20.163327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea599995-7403-4870-8945-f9a6a3d48213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:20.164809 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea599995-7403-4870-8945-f9a6a3d48213 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:20.180081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 78/160] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:11:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:20.185455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7c71d-0961-4a31-b3c3-80f3c0278d54 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:20.280535 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:20.320881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7c71d-0961-4a31-b3c3-80f3c0278d54 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:20.362912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f085f18-f683-424e-94fc-9168600457be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:20.363616 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f085f18-f683-424e-94fc-9168600457be None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:20.364620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f085f18-f683-424e-94fc-9168600457be None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:20.364903 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f085f18-f683-424e-94fc-9168600457be None admin] PATH_INFO: `/v3/users/ec0e7e1f75384c61b47651e3ecc71eb1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:20.366207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f085f18-f683-424e-94fc-9168600457be None admin] RBAC: Authorizing `identity:get_user(user_id=ec0e7e1f75384c61b47651e3ecc71eb1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:20.367799 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f085f18-f683-424e-94fc-9168600457be None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:20.369479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 83/161] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:20 2022] GET /identity/v3/users/ec0e7e1f75384c61b47651e3ecc71eb1 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:20.375084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea599995-7403-4870-8945-f9a6a3d48213 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:20.445955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:20.504925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea599995-7403-4870-8945-f9a6a3d48213 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:20.549017 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b2bf3-f802-4eaf-8ed2-5d1d3c639be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:20.549680 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b2bf3-f802-4eaf-8ed2-5d1d3c639be9 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:20.550038 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b2bf3-f802-4eaf-8ed2-5d1d3c639be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:20.550329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b2bf3-f802-4eaf-8ed2-5d1d3c639be9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:20.649804 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b2bf3-f802-4eaf-8ed2-5d1d3c639be9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:20.651349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b2bf3-f802-4eaf-8ed2-5d1d3c639be9 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:20.721936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:20.781943 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 79/162] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:20.787672 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f085f18-f683-424e-94fc-9168600457be None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:20.901229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30d000-c648-45f3-9255-d956ab25bd20 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:20.901417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30d000-c648-45f3-9255-d956ab25bd20 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:20.901698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30d000-c648-45f3-9255-d956ab25bd20 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:20.903058 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 80/163] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:11:20.909511 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac115c-0afe-436c-b6f4-ffd4bb541bed None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:20.909792 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac115c-0afe-436c-b6f4-ffd4bb541bed None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:20.910124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac115c-0afe-436c-b6f4-ffd4bb541bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:20.942445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f085f18-f683-424e-94fc-9168600457be None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:20.947640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6fac115c-0afe-436c-b6f4-ffd4bb541bed None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:20.948961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6fac115c-0afe-436c-b6f4-ffd4bb541bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:21.016584 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed005ba-3f00-48a3-8cc7-a9794c48a0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:21.017293 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed005ba-3f00-48a3-8cc7-a9794c48a0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:21.017596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed005ba-3f00-48a3-8cc7-a9794c48a0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:21.017895 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed005ba-3f00-48a3-8cc7-a9794c48a0e3 None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:21.022174 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed005ba-3f00-48a3-8cc7-a9794c48a0e3 None admin] RBAC: Authorizing `identity:get_project(project_id=8c7f15d3ce55460993f520e6f8838a8a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:21.023654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed005ba-3f00-48a3-8cc7-a9794c48a0e3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:21.025598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 84/164] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:20 2022] GET /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:21.031050 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed005ba-3f00-48a3-8cc7-a9794c48a0e3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:21.042169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:21.089688 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 81/165] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:21.127585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac115c-0afe-436c-b6f4-ffd4bb541bed None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:21.281975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed005ba-3f00-48a3-8cc7-a9794c48a0e3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:21.322620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:21.361669 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac115c-0afe-436c-b6f4-ffd4bb541bed None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:21.366879 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6942e4a-2847-41a8-9406-c55aacb36c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:21.367655 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6942e4a-2847-41a8-9406-c55aacb36c71 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:21.368004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6942e4a-2847-41a8-9406-c55aacb36c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:21.368347 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6942e4a-2847-41a8-9406-c55aacb36c71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:21.369266 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6942e4a-2847-41a8-9406-c55aacb36c71 None admin] RBAC: Adding query filter params (role.id=472f2455c837486084f108ce944f1bff, scope.project.id=8c7f15d3ce55460993f520e6f8838a8a, user.id=ec0e7e1f75384c61b47651e3ecc71eb1) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:21.369623 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6942e4a-2847-41a8-9406-c55aacb36c71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:21.377072 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6942e4a-2847-41a8-9406-c55aacb36c71 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:21.387286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 85/166] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:11:21 2022] GET /identity/v3/role_assignments?user.id=ec0e7e1f75384c61b47651e3ecc71eb1&scope.project.id=8c7f15d3ce55460993f520e6f8838a8a&role.id=472f2455c837486084f108ce944f1bff => generated 608 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:21.391489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2be004-2128-43bc-ac70-191f5d95f56f None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:21.391807 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2be004-2128-43bc-ac70-191f5d95f56f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:21.392110 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2be004-2128-43bc-ac70-191f5d95f56f None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:21.397176 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 86/167] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:21.402960 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c274aa-5741-4a9e-8770-76a362dd6043 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:21.403270 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c274aa-5741-4a9e-8770-76a362dd6043 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:21.403587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c274aa-5741-4a9e-8770-76a362dd6043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:21.443033 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-07c274aa-5741-4a9e-8770-76a362dd6043 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:21.449215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-07c274aa-5741-4a9e-8770-76a362dd6043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:21.450533 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77205d2b-f92e-426a-934c-c67e56db5af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:21.451945 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77205d2b-f92e-426a-934c-c67e56db5af1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:21.452482 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77205d2b-f92e-426a-934c-c67e56db5af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:21.453024 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77205d2b-f92e-426a-934c-c67e56db5af1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:21.482525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77205d2b-f92e-426a-934c-c67e56db5af1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:21.488184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-77205d2b-f92e-426a-934c-c67e56db5af1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:21.488184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:21.488184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:21.488184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:21.488184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:21.488184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:21.488184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:21.488184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:21.488184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:21.488184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:21.488184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:21.488184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:21.488184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:21.488184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:21.488184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:21.488184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:21.489773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:21.489773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:21.489773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:21.489773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:21.489773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:21.489773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:21.489773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:21.489773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:21.489773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:21.489773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:21.489773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:21.489773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:21.489773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:21.489773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:21.489773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:21.489773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:21.490528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:21.490528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:21.490528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:21.490528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:21.490528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:21.490528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:21.490528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:21.490528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:21.490528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:21.490528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:21.490528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:21.490528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:21.498349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 82/168] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:21.512207 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77205d2b-f92e-426a-934c-c67e56db5af1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:21.579809 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:21.586306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 87/169] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:21.633427 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c274aa-5741-4a9e-8770-76a362dd6043 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:21.752409 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77205d2b-f92e-426a-934c-c67e56db5af1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:21.813046 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c274aa-5741-4a9e-8770-76a362dd6043 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:21.834636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9965a-3df2-49e9-b9f4-46a22612b54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:21.835279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9965a-3df2-49e9-b9f4-46a22612b54b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:21.835570 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9965a-3df2-49e9-b9f4-46a22612b54b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:21.835848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9965a-3df2-49e9-b9f4-46a22612b54b None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:21.836625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9965a-3df2-49e9-b9f4-46a22612b54b None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:21.836938 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9965a-3df2-49e9-b9f4-46a22612b54b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:21.838466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9965a-3df2-49e9-b9f4-46a22612b54b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:21.856088 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 83/170] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:21.862979 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9965a-3df2-49e9-b9f4-46a22612b54b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:21.871489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9ad78-d537-4716-bff7-7fff85dfd9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:21.872295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:21.875892 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9ad78-d537-4716-bff7-7fff85dfd9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:21.882930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9ad78-d537-4716-bff7-7fff85dfd9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:21.883585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9ad78-d537-4716-bff7-7fff85dfd9e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:21.902441 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9ad78-d537-4716-bff7-7fff85dfd9e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:21.908555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-09e9ad78-d537-4716-bff7-7fff85dfd9e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:21.908555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:21.908555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:21.908555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:21.908555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:21.908555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:21.908555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:21.908555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:21.908555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:21.908555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:21.908555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:21.908555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:21.908555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:21.908555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:21.908555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:21.908555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:21.909387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:21.909387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:21.909387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:21.909387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:21.909387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:21.909387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:21.909387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:21.909387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:21.909387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:21.909387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:21.909387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:21.909387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:21.909387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:21.909387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:21.909387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:21.909387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:21.910155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:21.910155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:21.910155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:21.910155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:21.910155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:21.910155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:21.910155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:21.910155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:21.910155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:21.910155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:21.910155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:21.910155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:21.921918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 88/171] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:11:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:11:21.927969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9ad78-d537-4716-bff7-7fff85dfd9e5 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:22.036829 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:22.070103 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9965a-3df2-49e9-b9f4-46a22612b54b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:22.118577 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9ad78-d537-4716-bff7-7fff85dfd9e5 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:22.173721 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f941edc-a600-498c-95e6-09582ffcd470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:22.174366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f941edc-a600-498c-95e6-09582ffcd470 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:22.174653 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f941edc-a600-498c-95e6-09582ffcd470 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:22.174932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f941edc-a600-498c-95e6-09582ffcd470 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:22.175674 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f941edc-a600-498c-95e6-09582ffcd470 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:22.176565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f941edc-a600-498c-95e6-09582ffcd470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:22.177978 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f941edc-a600-498c-95e6-09582ffcd470 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:22.191401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 89/172] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:22.201321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f941edc-a600-498c-95e6-09582ffcd470 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:22.202397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff3654-3c93-4269-982f-e79931f73be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:22.203348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff3654-3c93-4269-982f-e79931f73be1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:22.203903 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff3654-3c93-4269-982f-e79931f73be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:22.204534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff3654-3c93-4269-982f-e79931f73be1 None admin] PATH_INFO: `/v3/users/ec0e7e1f75384c61b47651e3ecc71eb1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:22.206121 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff3654-3c93-4269-982f-e79931f73be1 None admin] RBAC: Authorizing `identity:get_user(user_id=ec0e7e1f75384c61b47651e3ecc71eb1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:22.215847 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff3654-3c93-4269-982f-e79931f73be1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:22.218606 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 84/173] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:21 2022] GET /identity/v3/users/ec0e7e1f75384c61b47651e3ecc71eb1 => generated 275 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:22.224905 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff3654-3c93-4269-982f-e79931f73be1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:22.362962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f941edc-a600-498c-95e6-09582ffcd470 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:22.396670 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:22.417658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:22.438867 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873578c2-b952-460a-9599-686d179b97df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:22.439637 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873578c2-b952-460a-9599-686d179b97df None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:22.439845 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873578c2-b952-460a-9599-686d179b97df None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:22.440431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873578c2-b952-460a-9599-686d179b97df None admin] PATH_INFO: `/v3/users/d47a57563f9b4a2aa0de495b20f1a6be` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:22.448192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873578c2-b952-460a-9599-686d179b97df None admin] RBAC: Authorizing `identity:get_user(user_id=d47a57563f9b4a2aa0de495b20f1a6be)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:22.448192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873578c2-b952-460a-9599-686d179b97df None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:22.448412 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 90/174] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:22 2022] GET /identity/v3/users/d47a57563f9b4a2aa0de495b20f1a6be => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:22.457909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873578c2-b952-460a-9599-686d179b97df None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:22.471983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff3654-3c93-4269-982f-e79931f73be1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:22.510993 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0efcbf-bd7c-4815-9d65-9213799cf285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:22.512023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0efcbf-bd7c-4815-9d65-9213799cf285 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:22.512541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0efcbf-bd7c-4815-9d65-9213799cf285 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:22.513049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0efcbf-bd7c-4815-9d65-9213799cf285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:22.591320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0efcbf-bd7c-4815-9d65-9213799cf285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:22.593296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0efcbf-bd7c-4815-9d65-9213799cf285 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:22.670376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:22.705819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 85/175] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:22.708049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0cef3-52a3-42ed-80e0-60e7e805f90a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:22.708608 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0cef3-52a3-42ed-80e0-60e7e805f90a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:22.709087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0cef3-52a3-42ed-80e0-60e7e805f90a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:22.710700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 86/176] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:22.712858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0cef3-52a3-42ed-80e0-60e7e805f90a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:22.714651 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873578c2-b952-460a-9599-686d179b97df None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:22.775429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940c9b3-a1b5-4f6a-b335-1353b3e3aeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:22.776245 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940c9b3-a1b5-4f6a-b335-1353b3e3aeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:22.776537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940c9b3-a1b5-4f6a-b335-1353b3e3aeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:22.776818 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940c9b3-a1b5-4f6a-b335-1353b3e3aeb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:22.833299 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0cef3-52a3-42ed-80e0-60e7e805f90a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:22.837858 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:22.854704 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940c9b3-a1b5-4f6a-b335-1353b3e3aeb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:22.856434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940c9b3-a1b5-4f6a-b335-1353b3e3aeb7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:22.872510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316acb43-5c25-43f7-ae10-6b7808005420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:22.873242 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316acb43-5c25-43f7-ae10-6b7808005420 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:22.873527 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316acb43-5c25-43f7-ae10-6b7808005420 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:22.873802 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316acb43-5c25-43f7-ae10-6b7808005420 None admin] PATH_INFO: `/v3/projects/7a0263c81cf1486cbae00010d6dc63e9` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:22.874971 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316acb43-5c25-43f7-ae10-6b7808005420 None admin] RBAC: Authorizing `identity:get_project(project_id=7a0263c81cf1486cbae00010d6dc63e9)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:22.876634 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316acb43-5c25-43f7-ae10-6b7808005420 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:22.878931 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 87/177] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:22 2022] GET /identity/v3/projects/7a0263c81cf1486cbae00010d6dc63e9 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:22.880364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765a940-8134-4603-b3f0-9884ba30f634 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:22.880664 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765a940-8134-4603-b3f0-9884ba30f634 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:22.880939 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765a940-8134-4603-b3f0-9884ba30f634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:22.900916 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7765a940-8134-4603-b3f0-9884ba30f634 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:22.902394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7765a940-8134-4603-b3f0-9884ba30f634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:22.942385 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:22.979933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 88/178] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:22.996206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 91/179] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 10:11:22.996206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362e473-01df-4cd1-9e74-29db967bbd05 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:22.996206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362e473-01df-4cd1-9e74-29db967bbd05 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:22.996522 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc38ff-8c40-45d7-8b3d-0d4f03bee52f None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:22.996594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362e473-01df-4cd1-9e74-29db967bbd05 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:22.996664 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc38ff-8c40-45d7-8b3d-0d4f03bee52f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:22.996664 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc38ff-8c40-45d7-8b3d-0d4f03bee52f None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:22.996777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 92/180] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:22.996847 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 89/181] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:22.996911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362e473-01df-4cd1-9e74-29db967bbd05 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:22.997465 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc38ff-8c40-45d7-8b3d-0d4f03bee52f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:23.096319 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:23.110092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362e473-01df-4cd1-9e74-29db967bbd05 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:23.118886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc38ff-8c40-45d7-8b3d-0d4f03bee52f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:23.146364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee6aa3-c4dd-416d-abc4-54d666db2b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:23.147315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6aa3-c4dd-416d-abc4-54d666db2b28 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:23.147615 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6aa3-c4dd-416d-abc4-54d666db2b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:23.147904 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6aa3-c4dd-416d-abc4-54d666db2b28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:23.148730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee6aa3-c4dd-416d-abc4-54d666db2b28 None admin] RBAC: Adding query filter params (role.id=50575a0d3f4340ee92356ce22ff3e62a, scope.project.id=7a0263c81cf1486cbae00010d6dc63e9, user.id=ec0e7e1f75384c61b47651e3ecc71eb1) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:23.149039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee6aa3-c4dd-416d-abc4-54d666db2b28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:23.150474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee6aa3-c4dd-416d-abc4-54d666db2b28 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:23.154067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b1cc1-4264-4972-bb89-fea714abf13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:23.154709 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b1cc1-4264-4972-bb89-fea714abf13f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:23.154988 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b1cc1-4264-4972-bb89-fea714abf13f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:23.155265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b1cc1-4264-4972-bb89-fea714abf13f None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:23.156448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b1cc1-4264-4972-bb89-fea714abf13f None admin] RBAC: Authorizing `identity:get_project(project_id=8c7f15d3ce55460993f520e6f8838a8a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:23.156546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 93/182] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:11:22 2022] GET /identity/v3/role_assignments?user.id=ec0e7e1f75384c61b47651e3ecc71eb1&scope.project.id=7a0263c81cf1486cbae00010d6dc63e9&role.id=50575a0d3f4340ee92356ce22ff3e62a => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:23.157600 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d6ea8-41ad-4c07-823a-8c9d14588c84 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:23.157881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d6ea8-41ad-4c07-823a-8c9d14588c84 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:23.157972 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b1cc1-4264-4972-bb89-fea714abf13f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:23.158159 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d6ea8-41ad-4c07-823a-8c9d14588c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:23.159838 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 90/183] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:22 2022] GET /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:23.161482 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701054f-0a52-4000-ba3d-33512fec38bd None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:23.161729 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701054f-0a52-4000-ba3d-33512fec38bd None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:23.162007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701054f-0a52-4000-ba3d-33512fec38bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:23.185554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-fa5d6ea8-41ad-4c07-823a-8c9d14588c84 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:23.187059 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fa5d6ea8-41ad-4c07-823a-8c9d14588c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:23.190838 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8701054f-0a52-4000-ba3d-33512fec38bd None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:23.193024 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8701054f-0a52-4000-ba3d-33512fec38bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:23.228975 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:23.265919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 94/184] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:23.276389 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d6ea8-41ad-4c07-823a-8c9d14588c84 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:23.286590 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 91/185] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:23.289841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf6531-0b04-47bf-b960-2c71ab92be80 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:23.290093 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf6531-0b04-47bf-b960-2c71ab92be80 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:23.290307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf6531-0b04-47bf-b960-2c71ab92be80 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:23.291839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 92/186] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:23.292492 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf6531-0b04-47bf-b960-2c71ab92be80 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:23.375242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:23.399736 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d6ea8-41ad-4c07-823a-8c9d14588c84 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:23.423836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf6531-0b04-47bf-b960-2c71ab92be80 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:23.436780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c150656-5587-4158-ae9e-3e9f67a4f338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:23.437359 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c150656-5587-4158-ae9e-3e9f67a4f338 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:23.437637 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c150656-5587-4158-ae9e-3e9f67a4f338 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:23.437928 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c150656-5587-4158-ae9e-3e9f67a4f338 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:23.448355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c150656-5587-4158-ae9e-3e9f67a4f338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:23.453226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-6c150656-5587-4158-ae9e-3e9f67a4f338 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:23.453226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:23.453226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:23.453226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:23.453226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:23.453226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:23.453226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:23.453226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:23.453226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:23.453226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:23.453226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:23.453226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:23.453226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:23.453226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:23.453226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:23.453226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:23.454251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:23.454251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:23.454251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:23.454251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:23.454251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:23.454251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:23.454251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:23.454251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:23.454251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:23.454251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:23.454251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:23.454251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:23.454251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:23.454251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:23.454251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:23.454251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:23.455200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:23.455200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:23.455200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:23.455200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:23.455200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:23.455200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:23.455200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:23.455200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:23.455200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:23.455200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:23.455200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:23.455200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:23.455200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 95/187] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:11:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:23.455200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c150656-5587-4158-ae9e-3e9f67a4f338 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:23.467495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7b0fd-1cfe-4100-aebc-bdf5f308c023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:23.468316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7b0fd-1cfe-4100-aebc-bdf5f308c023 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:23.468484 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7b0fd-1cfe-4100-aebc-bdf5f308c023 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:23.468774 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7b0fd-1cfe-4100-aebc-bdf5f308c023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:23.469621 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7b0fd-1cfe-4100-aebc-bdf5f308c023 None admin] RBAC: Adding query filter params (role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.project.id=8c7f15d3ce55460993f520e6f8838a8a, user.id=d47a57563f9b4a2aa0de495b20f1a6be) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:23.469948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7b0fd-1cfe-4100-aebc-bdf5f308c023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:23.471386 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7b0fd-1cfe-4100-aebc-bdf5f308c023 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:23.488361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 93/188] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:11:23 2022] GET /identity/v3/role_assignments?user.id=d47a57563f9b4a2aa0de495b20f1a6be&scope.project.id=8c7f15d3ce55460993f520e6f8838a8a&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:23.488361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b287b6-eb84-4760-8590-280c4f43964d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:23.488361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b287b6-eb84-4760-8590-280c4f43964d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:23.488361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b287b6-eb84-4760-8590-280c4f43964d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:23.508493 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-20b287b6-eb84-4760-8590-280c4f43964d None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:23.509925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-20b287b6-eb84-4760-8590-280c4f43964d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:23.543887 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:23.576082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c150656-5587-4158-ae9e-3e9f67a4f338 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:23.592969 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 94/189] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:23.593908 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b287b6-eb84-4760-8590-280c4f43964d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:23.642192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2806b0-9f85-46ca-b715-9d5c3be664a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:23.642857 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2806b0-9f85-46ca-b715-9d5c3be664a5 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:23.643138 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2806b0-9f85-46ca-b715-9d5c3be664a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:23.644087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2806b0-9f85-46ca-b715-9d5c3be664a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:23.658531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2806b0-9f85-46ca-b715-9d5c3be664a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:23.663310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-9a2806b0-9f85-46ca-b715-9d5c3be664a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:23.663310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:23.663310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:23.663310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:23.663310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:23.663310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:23.663310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:23.663310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:23.663310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:23.663310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:23.663310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:23.663310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:23.663310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:23.663310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:23.663310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:23.663310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:23.664416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:23.664416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:23.664416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:23.664416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:23.664416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:23.664416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:23.664416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:23.664416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:23.664416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:23.664416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:23.664416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:23.664416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:23.664416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:23.664416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:23.664416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:23.664416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:23.665314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:23.665314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:23.665314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:23.665314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:23.665314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:23.665314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:23.665314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:23.665314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:23.665314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:23.665314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:23.665314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:23.665314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:23.665314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 96/190] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:11:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:23.666684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2806b0-9f85-46ca-b715-9d5c3be664a5 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:23.669584 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:23.729631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b287b6-eb84-4760-8590-280c4f43964d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:23.766862 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428be33-6532-4a7a-815b-439a540309b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:23.767486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428be33-6532-4a7a-815b-439a540309b8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:23.767767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428be33-6532-4a7a-815b-439a540309b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:23.768043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428be33-6532-4a7a-815b-439a540309b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:23.779410 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428be33-6532-4a7a-815b-439a540309b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:23.785291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-0428be33-6532-4a7a-815b-439a540309b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 10:11:23.785291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:23.785291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:23.785291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:23.785291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:23.785291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:23.785291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:23.785291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:23.785291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:23.785291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:23.785291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:23.785291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:23.785291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:23.785291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:23.785291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:23.785291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:23.786339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:23.786339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:23.786339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:23.786339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:23.786339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:23.786339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:23.786339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:23.786339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:23.786339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:23.786339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:23.786339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:23.786339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:23.786339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:23.786339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:23.786339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:23.786339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:23.787200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:23.787200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:23.787200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:23.787200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:23.787200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:23.787200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:23.787200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:23.787200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:23.787200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:23.787200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:23.787200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 10:11:23.787200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:23.787200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 95/191] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:23.787819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2806b0-9f85-46ca-b715-9d5c3be664a5 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:23.787888 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428be33-6532-4a7a-815b-439a540309b8 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:23.814295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:23.829794 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febd392-9d07-4aba-b050-dec56cf181c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:23.830459 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febd392-9d07-4aba-b050-dec56cf181c7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:23.830765 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febd392-9d07-4aba-b050-dec56cf181c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:23.831086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febd392-9d07-4aba-b050-dec56cf181c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:23.831874 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febd392-9d07-4aba-b050-dec56cf181c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:23.832538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febd392-9d07-4aba-b050-dec56cf181c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:23.834156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febd392-9d07-4aba-b050-dec56cf181c7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:23.847805 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 97/192] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:23.847805 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febd392-9d07-4aba-b050-dec56cf181c7 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:23.892813 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428be33-6532-4a7a-815b-439a540309b8 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:23.912726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:23.930017 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b590e1d-6f8d-417c-9fdc-c57099adf76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:23.930673 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b590e1d-6f8d-417c-9fdc-c57099adf76e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:23.930956 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b590e1d-6f8d-417c-9fdc-c57099adf76e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:23.931239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b590e1d-6f8d-417c-9fdc-c57099adf76e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:23.932430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b590e1d-6f8d-417c-9fdc-c57099adf76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:23.933910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b590e1d-6f8d-417c-9fdc-c57099adf76e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:23.935534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 96/193] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:11:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:23.937386 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b590e1d-6f8d-417c-9fdc-c57099adf76e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:23.955788 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febd392-9d07-4aba-b050-dec56cf181c7 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:23.991860 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202b308-b3ad-43db-9aa5-1fabd70a7d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:23.992446 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202b308-b3ad-43db-9aa5-1fabd70a7d6e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:23.992736 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202b308-b3ad-43db-9aa5-1fabd70a7d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:23.993013 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202b308-b3ad-43db-9aa5-1fabd70a7d6e None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:23.993788 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202b308-b3ad-43db-9aa5-1fabd70a7d6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:23.994077 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202b308-b3ad-43db-9aa5-1fabd70a7d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:23.995478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202b308-b3ad-43db-9aa5-1fabd70a7d6e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:24.003621 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 98/194] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:11:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:24.005120 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202b308-b3ad-43db-9aa5-1fabd70a7d6e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:24.036838 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:24.048097 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b590e1d-6f8d-417c-9fdc-c57099adf76e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:24.084543 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114ca10-b318-40b2-b68a-8d4987a0151c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:24.085174 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114ca10-b318-40b2-b68a-8d4987a0151c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:24.085457 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114ca10-b318-40b2-b68a-8d4987a0151c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:24.085762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114ca10-b318-40b2-b68a-8d4987a0151c None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:24.086453 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114ca10-b318-40b2-b68a-8d4987a0151c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:24.086755 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114ca10-b318-40b2-b68a-8d4987a0151c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:24.088148 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114ca10-b318-40b2-b68a-8d4987a0151c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:24.096379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 97/195] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:24.097152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114ca10-b318-40b2-b68a-8d4987a0151c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:24.118487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202b308-b3ad-43db-9aa5-1fabd70a7d6e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:24.148145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:24.157880 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a491f5-f8a3-43d7-b500-1b57d1dddb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:24.158658 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a491f5-f8a3-43d7-b500-1b57d1dddb64 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:24.159027 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a491f5-f8a3-43d7-b500-1b57d1dddb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:24.159442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a491f5-f8a3-43d7-b500-1b57d1dddb64 None admin] PATH_INFO: `/v3/users/c092dc758a014f28971bc69711168cb3` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:24.174660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a491f5-f8a3-43d7-b500-1b57d1dddb64 None admin] RBAC: Authorizing `identity:get_user(user_id=c092dc758a014f28971bc69711168cb3)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:24.176738 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a491f5-f8a3-43d7-b500-1b57d1dddb64 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:24.178453 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 99/196] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:24 2022] GET /identity/v3/users/c092dc758a014f28971bc69711168cb3 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:24.179220 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a491f5-f8a3-43d7-b500-1b57d1dddb64 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:24.209003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114ca10-b318-40b2-b68a-8d4987a0151c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:24.244950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ab421-b947-4983-8ece-f5bb9ff2905b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:24.245640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ab421-b947-4983-8ece-f5bb9ff2905b None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:24.245995 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ab421-b947-4983-8ece-f5bb9ff2905b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:24.246321 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ab421-b947-4983-8ece-f5bb9ff2905b None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:24.247173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ab421-b947-4983-8ece-f5bb9ff2905b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:24.248942 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ab421-b947-4983-8ece-f5bb9ff2905b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:24.292202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 98/197] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Aug 4 10:11:24 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:11:24.292202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ab421-b947-4983-8ece-f5bb9ff2905b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:24.292497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a491f5-f8a3-43d7-b500-1b57d1dddb64 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:24.296497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:24.330011 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73018b49-9e66-47f9-96d7-35685e17edde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:24.330850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73018b49-9e66-47f9-96d7-35685e17edde None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:24.331209 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73018b49-9e66-47f9-96d7-35685e17edde None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:24.331559 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73018b49-9e66-47f9-96d7-35685e17edde None admin] PATH_INFO: `/v3/users/c092dc758a014f28971bc69711168cb3` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:24.333109 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73018b49-9e66-47f9-96d7-35685e17edde None admin] RBAC: Authorizing `identity:get_user(user_id=c092dc758a014f28971bc69711168cb3)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:24.334690 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73018b49-9e66-47f9-96d7-35685e17edde None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:24.336876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 100/198] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:24 2022] GET /identity/v3/users/c092dc758a014f28971bc69711168cb3 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:24.337602 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73018b49-9e66-47f9-96d7-35685e17edde None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:24.398306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:24.430638 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ab421-b947-4983-8ece-f5bb9ff2905b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:24.461091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73018b49-9e66-47f9-96d7-35685e17edde None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:24.474673 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5f944-72c0-49d9-b08d-71d6e8fa98fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:24.475030 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5f944-72c0-49d9-b08d-71d6e8fa98fc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:24.475341 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5f944-72c0-49d9-b08d-71d6e8fa98fc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:24.475665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5f944-72c0-49d9-b08d-71d6e8fa98fc None admin] PATH_INFO: `/v3/users/e99c9c8fdc9a46ddae524ed91bd45e9b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:24.477103 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5f944-72c0-49d9-b08d-71d6e8fa98fc None admin] RBAC: Authorizing `identity:get_user(user_id=e99c9c8fdc9a46ddae524ed91bd45e9b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:24.478708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5f944-72c0-49d9-b08d-71d6e8fa98fc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:24.480610 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 99/199] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:24 2022] GET /identity/v3/users/e99c9c8fdc9a46ddae524ed91bd45e9b => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:24.481463 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5f944-72c0-49d9-b08d-71d6e8fa98fc None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:24.504580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca64d51-7278-4591-bf2f-a0d2a07440f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:24.505194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca64d51-7278-4591-bf2f-a0d2a07440f7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:24.505521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca64d51-7278-4591-bf2f-a0d2a07440f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:24.505817 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca64d51-7278-4591-bf2f-a0d2a07440f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:24.600939 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca64d51-7278-4591-bf2f-a0d2a07440f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:24.606353 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca64d51-7278-4591-bf2f-a0d2a07440f7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:24.609077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:24.638038 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5f944-72c0-49d9-b08d-71d6e8fa98fc None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:24.684145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2c334-5ffd-44d5-99b6-e8420233f7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:24.684832 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2c334-5ffd-44d5-99b6-e8420233f7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:24.685115 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2c334-5ffd-44d5-99b6-e8420233f7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:24.685395 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2c334-5ffd-44d5-99b6-e8420233f7f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:24.700139 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:24.753910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 101/200] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:24.755023 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca64d51-7278-4591-bf2f-a0d2a07440f7 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:24.781795 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2c334-5ffd-44d5-99b6-e8420233f7f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:24.784270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2c334-5ffd-44d5-99b6-e8420233f7f1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:24.884578 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca64d51-7278-4591-bf2f-a0d2a07440f7 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:24.909656 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 100/201] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:24.911713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2c334-5ffd-44d5-99b6-e8420233f7f1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:24.926833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232b216-734d-4e5d-9c2c-291a448ff309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:24.927573 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232b216-734d-4e5d-9c2c-291a448ff309 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:24.927948 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232b216-734d-4e5d-9c2c-291a448ff309 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:24.928805 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232b216-734d-4e5d-9c2c-291a448ff309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:24.946935 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:24.956475 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:25.020712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232b216-734d-4e5d-9c2c-291a448ff309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:25.023399 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232b216-734d-4e5d-9c2c-291a448ff309 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:25.056099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2c334-5ffd-44d5-99b6-e8420233f7f1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:25.098952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8163f32-f568-4bff-b9c2-af1bdda8e4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:25.099846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8163f32-f568-4bff-b9c2-af1bdda8e4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:25.100322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8163f32-f568-4bff-b9c2-af1bdda8e4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:25.100756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8163f32-f568-4bff-b9c2-af1bdda8e4c0 None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:25.102534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8163f32-f568-4bff-b9c2-af1bdda8e4c0 None admin] RBAC: Authorizing `identity:get_project(project_id=13b307d54e4e48ef84790ab15f5ceb39)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:25.104953 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8163f32-f568-4bff-b9c2-af1bdda8e4c0 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:25.107849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 101/202] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:24 2022] GET /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:25.114510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8163f32-f568-4bff-b9c2-af1bdda8e4c0 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:25.172797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 102/203] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:25.178037 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232b216-734d-4e5d-9c2c-291a448ff309 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:25.183921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:25.249369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8163f32-f568-4bff-b9c2-af1bdda8e4c0 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:25.264667 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:25.291057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a4e9d-d5bd-4049-9d4c-805078f4bbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:25.292077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4e9d-d5bd-4049-9d4c-805078f4bbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:25.292652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4e9d-d5bd-4049-9d4c-805078f4bbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:25.293130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4e9d-d5bd-4049-9d4c-805078f4bbf1 None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:25.294615 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a4e9d-d5bd-4049-9d4c-805078f4bbf1 None admin] RBAC: Authorizing `identity:get_project(project_id=13b307d54e4e48ef84790ab15f5ceb39)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:25.296483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a4e9d-d5bd-4049-9d4c-805078f4bbf1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:25.298617 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 102/204] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:25 2022] GET /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:25.300639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a4e9d-d5bd-4049-9d4c-805078f4bbf1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:25.331422 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232b216-734d-4e5d-9c2c-291a448ff309 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:25.377836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa705d-f480-49d6-a61a-d00b2beb126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:25.378458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa705d-f480-49d6-a61a-d00b2beb126b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:25.378739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa705d-f480-49d6-a61a-d00b2beb126b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:25.379042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa705d-f480-49d6-a61a-d00b2beb126b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:25.379846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa705d-f480-49d6-a61a-d00b2beb126b None admin] RBAC: Adding query filter params (role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.project.id=13b307d54e4e48ef84790ab15f5ceb39, user.id=c092dc758a014f28971bc69711168cb3) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:25.380155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa705d-f480-49d6-a61a-d00b2beb126b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:25.381970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa705d-f480-49d6-a61a-d00b2beb126b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:25.392337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 103/205] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:11:25 2022] GET /identity/v3/role_assignments?user.id=c092dc758a014f28971bc69711168cb3&scope.project.id=13b307d54e4e48ef84790ab15f5ceb39&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:25.394072 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa705d-f480-49d6-a61a-d00b2beb126b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:25.442181 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a4e9d-d5bd-4049-9d4c-805078f4bbf1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:25.469220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:25.519108 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e50db9-e009-4589-8470-d9c9c3506c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:25.521005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e50db9-e009-4589-8470-d9c9c3506c8d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:25.521005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e50db9-e009-4589-8470-d9c9c3506c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:25.521168 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e50db9-e009-4589-8470-d9c9c3506c8d None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:25.523618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e50db9-e009-4589-8470-d9c9c3506c8d None admin] RBAC: Authorizing `identity:get_project(project_id=8c7f15d3ce55460993f520e6f8838a8a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:25.525137 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e50db9-e009-4589-8470-d9c9c3506c8d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:25.526920 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 103/206] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:25 2022] GET /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:25.537512 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e50db9-e009-4589-8470-d9c9c3506c8d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:25.623308 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa705d-f480-49d6-a61a-d00b2beb126b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:25.649196 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:25.688690 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e50db9-e009-4589-8470-d9c9c3506c8d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:25.693635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b0696-8c9e-4d85-97ce-035ce7d5d7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:25.694274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b0696-8c9e-4d85-97ce-035ce7d5d7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:25.694562 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b0696-8c9e-4d85-97ce-035ce7d5d7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:25.694845 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b0696-8c9e-4d85-97ce-035ce7d5d7a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:25.695659 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b0696-8c9e-4d85-97ce-035ce7d5d7a0 None admin] RBAC: Adding query filter params (role.id=472f2455c837486084f108ce944f1bff, scope.project.id=13b307d54e4e48ef84790ab15f5ceb39, user.id=c092dc758a014f28971bc69711168cb3) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:25.695978 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b0696-8c9e-4d85-97ce-035ce7d5d7a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:25.697469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b0696-8c9e-4d85-97ce-035ce7d5d7a0 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:25.712316 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 104/207] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:11:25 2022] GET /identity/v3/role_assignments?user.id=c092dc758a014f28971bc69711168cb3&scope.project.id=13b307d54e4e48ef84790ab15f5ceb39&role.id=472f2455c837486084f108ce944f1bff => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:25.743023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf35f1-1e56-42e4-9547-755bc364fcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:25.744026 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf35f1-1e56-42e4-9547-755bc364fcd6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:25.744396 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf35f1-1e56-42e4-9547-755bc364fcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:25.744686 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf35f1-1e56-42e4-9547-755bc364fcd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:25.745527 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf35f1-1e56-42e4-9547-755bc364fcd6 None admin] RBAC: Adding query filter params (role.id=439977f47a30404790859f8a0d504997, scope.project.id=8c7f15d3ce55460993f520e6f8838a8a, user.id=e99c9c8fdc9a46ddae524ed91bd45e9b) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:25.745846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf35f1-1e56-42e4-9547-755bc364fcd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:25.747366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf35f1-1e56-42e4-9547-755bc364fcd6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:25.755605 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 104/208] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:11:25 2022] GET /identity/v3/role_assignments?user.id=e99c9c8fdc9a46ddae524ed91bd45e9b&scope.project.id=8c7f15d3ce55460993f520e6f8838a8a&role.id=439977f47a30404790859f8a0d504997 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:26.620660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef600794-984c-4182-a8ff-89329c184df5 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:26.620908 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef600794-984c-4182-a8ff-89329c184df5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:26.621036 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef600794-984c-4182-a8ff-89329c184df5 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:26.622366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 105/209] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:26.637171 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc69b-4143-49da-b2b1-17d9e2398845 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:26.637978 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc69b-4143-49da-b2b1-17d9e2398845 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:26.638705 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc69b-4143-49da-b2b1-17d9e2398845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:26.668777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-843fc69b-4143-49da-b2b1-17d9e2398845 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:26.671172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-843fc69b-4143-49da-b2b1-17d9e2398845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:26.743585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:26.788590 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 105/210] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:26.827451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef600794-984c-4182-a8ff-89329c184df5 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:26.970853 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef600794-984c-4182-a8ff-89329c184df5 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:26.998531 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098906da-80f1-405e-9b16-7579dd611ffc None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:26.998838 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098906da-80f1-405e-9b16-7579dd611ffc None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:26.999101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098906da-80f1-405e-9b16-7579dd611ffc None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:27.000525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 106/211] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:27.006504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045de52-2a6f-4802-9e7c-13595be7b0a9 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:27.007085 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045de52-2a6f-4802-9e7c-13595be7b0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:27.007569 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045de52-2a6f-4802-9e7c-13595be7b0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:27.012111 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb047b-c679-4ffc-9fcf-623878ddea68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:27.012789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb047b-c679-4ffc-9fcf-623878ddea68 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:27.013151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb047b-c679-4ffc-9fcf-623878ddea68 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:27.013430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb047b-c679-4ffc-9fcf-623878ddea68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:27.025937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb047b-c679-4ffc-9fcf-623878ddea68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:27.028576 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f045de52-2a6f-4802-9e7c-13595be7b0a9 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:27.030072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f045de52-2a6f-4802-9e7c-13595be7b0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:27.031540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-68fb047b-c679-4ffc-9fcf-623878ddea68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:27.031540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:27.031540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:27.031540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:27.031540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:27.031540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:27.031540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:27.031540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:27.031540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:27.031540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:27.031540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:27.031540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:27.031540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:27.031540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:27.031540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:27.031540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:27.032455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:27.032455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:27.032455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:27.032455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:27.032455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:27.032455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:27.032455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:27.032455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:27.032455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:27.032455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:27.032455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:27.032455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:27.032455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:27.032455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:27.032455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:27.032455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:27.033298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:27.033298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:27.033298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:27.033298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:27.033298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:27.033298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:27.033298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:27.033298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:27.033298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:27.033298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:27.033298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:27.033298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:27.033298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 106/212] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:11:27.039590 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb047b-c679-4ffc-9fcf-623878ddea68 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:27.084998 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:27.111429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 107/213] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:27.137802 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045de52-2a6f-4802-9e7c-13595be7b0a9 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:27.148381 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb047b-c679-4ffc-9fcf-623878ddea68 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:27.187447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33322b-61dd-46aa-a504-2e9bcb5b3548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:27.188068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33322b-61dd-46aa-a504-2e9bcb5b3548 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:27.188387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33322b-61dd-46aa-a504-2e9bcb5b3548 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:27.188669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33322b-61dd-46aa-a504-2e9bcb5b3548 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:27.189393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33322b-61dd-46aa-a504-2e9bcb5b3548 None admin] RBAC: Adding query filter params (name=member) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:27.189702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33322b-61dd-46aa-a504-2e9bcb5b3548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:27.191577 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33322b-61dd-46aa-a504-2e9bcb5b3548 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:27.200472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 107/214] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:27.205940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33322b-61dd-46aa-a504-2e9bcb5b3548 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:27.250709 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045de52-2a6f-4802-9e7c-13595be7b0a9 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:27.253624 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:27.297059 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ec39f-7bf2-4017-ac42-b00714643519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:27.298657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ec39f-7bf2-4017-ac42-b00714643519 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:27.299321 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ec39f-7bf2-4017-ac42-b00714643519 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:27.299991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ec39f-7bf2-4017-ac42-b00714643519 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:27.303481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ec39f-7bf2-4017-ac42-b00714643519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:27.307095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ec39f-7bf2-4017-ac42-b00714643519 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:27.312276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 108/215] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:11:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:27.318666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ec39f-7bf2-4017-ac42-b00714643519 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:27.319392 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33322b-61dd-46aa-a504-2e9bcb5b3548 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:27.332784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:27.361023 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb36797-fdfd-4842-ad23-f17da9a24e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:27.362061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb36797-fdfd-4842-ad23-f17da9a24e5c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:27.362530 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb36797-fdfd-4842-ad23-f17da9a24e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:27.362982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb36797-fdfd-4842-ad23-f17da9a24e5c None admin] PATH_INFO: `/v3/users/4683edfccc8b4b4c8b99266907ff1082` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:27.380587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb36797-fdfd-4842-ad23-f17da9a24e5c None admin] RBAC: Authorizing `identity:get_user(user_id=4683edfccc8b4b4c8b99266907ff1082)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:27.382329 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb36797-fdfd-4842-ad23-f17da9a24e5c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:27.384438 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 108/216] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:27 2022] GET /identity/v3/users/4683edfccc8b4b4c8b99266907ff1082 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:27.390242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb36797-fdfd-4842-ad23-f17da9a24e5c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:27.473602 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ec39f-7bf2-4017-ac42-b00714643519 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:27.514574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a76c0-30e2-481a-ba76-6b8a37c46fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:27.515520 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a76c0-30e2-481a-ba76-6b8a37c46fb5 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:27.516278 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a76c0-30e2-481a-ba76-6b8a37c46fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:27.516756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a76c0-30e2-481a-ba76-6b8a37c46fb5 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:27.518611 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a76c0-30e2-481a-ba76-6b8a37c46fb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:27.520836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a76c0-30e2-481a-ba76-6b8a37c46fb5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:27.551610 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 109/217] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Aug 4 10:11:27 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:11:27.583211 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb36797-fdfd-4842-ad23-f17da9a24e5c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:27.656041 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b3a24-06b8-4131-8f92-5011531c111f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:27.657310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b3a24-06b8-4131-8f92-5011531c111f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:27.657816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b3a24-06b8-4131-8f92-5011531c111f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:27.658300 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b3a24-06b8-4131-8f92-5011531c111f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:27.714632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:27.789536 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b3a24-06b8-4131-8f92-5011531c111f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:27.792244 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b3a24-06b8-4131-8f92-5011531c111f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:27.968183 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 109/218] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:27.975398 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a76c0-30e2-481a-ba76-6b8a37c46fb5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:28.011428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:28.158146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a76c0-30e2-481a-ba76-6b8a37c46fb5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:28.223921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2d23d-2141-4ba1-9fa0-34349b8997f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:28.225151 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2d23d-2141-4ba1-9fa0-34349b8997f8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:28.225650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2d23d-2141-4ba1-9fa0-34349b8997f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:28.226170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2d23d-2141-4ba1-9fa0-34349b8997f8 None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:28.232908 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2d23d-2141-4ba1-9fa0-34349b8997f8 None admin] RBAC: Authorizing `identity:get_project(project_id=13b307d54e4e48ef84790ab15f5ceb39)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:28.234647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2d23d-2141-4ba1-9fa0-34349b8997f8 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:28.236599 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 110/219] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:27 2022] GET /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:28.246445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b3a24-06b8-4131-8f92-5011531c111f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:28.367009 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc40108-662e-4461-8071-8f46001bd51e None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:28.367364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc40108-662e-4461-8071-8f46001bd51e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:28.367615 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc40108-662e-4461-8071-8f46001bd51e None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:28.369242 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 111/220] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:28.373565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:28.375415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83eee4-820f-4a79-8303-b9ed716826df None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:28.375801 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83eee4-820f-4a79-8303-b9ed716826df None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:28.376188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83eee4-820f-4a79-8303-b9ed716826df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:28.421360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-0b83eee4-820f-4a79-8303-b9ed716826df None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:28.422502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0b83eee4-820f-4a79-8303-b9ed716826df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:28.450706 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b3a24-06b8-4131-8f92-5011531c111f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:28.512759 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691d614-4397-4bff-bcb3-3a5099be9494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:28.513805 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691d614-4397-4bff-bcb3-3a5099be9494 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:28.514295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691d614-4397-4bff-bcb3-3a5099be9494 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:28.514774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691d614-4397-4bff-bcb3-3a5099be9494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:28.516391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691d614-4397-4bff-bcb3-3a5099be9494 None admin] RBAC: Adding query filter params (role.id=50575a0d3f4340ee92356ce22ff3e62a, scope.project.id=13b307d54e4e48ef84790ab15f5ceb39, user.id=4683edfccc8b4b4c8b99266907ff1082) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:28.517107 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691d614-4397-4bff-bcb3-3a5099be9494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:28.520357 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691d614-4397-4bff-bcb3-3a5099be9494 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:28.530944 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 110/221] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:11:28 2022] GET /identity/v3/role_assignments?user.id=4683edfccc8b4b4c8b99266907ff1082&scope.project.id=13b307d54e4e48ef84790ab15f5ceb39&role.id=50575a0d3f4340ee92356ce22ff3e62a => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:28.588598 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 112/222] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:28.625261 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691d614-4397-4bff-bcb3-3a5099be9494 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:28.710806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acedbda-f6dd-4e6e-961c-86baf8260825 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:28.710806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acedbda-f6dd-4e6e-961c-86baf8260825 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:28.710806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acedbda-f6dd-4e6e-961c-86baf8260825 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:28.710806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 113/223] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:11:28.716274 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17be07f-07dc-4a43-9676-df50b95f42fc None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:28.716839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17be07f-07dc-4a43-9676-df50b95f42fc None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:28.717338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17be07f-07dc-4a43-9676-df50b95f42fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:28.757165 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b17be07f-07dc-4a43-9676-df50b95f42fc None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:28.758715 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b17be07f-07dc-4a43-9676-df50b95f42fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:28.798491 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:28.825409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691d614-4397-4bff-bcb3-3a5099be9494 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:28.868536 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:28.872629 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 114/224] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:28.887236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d082b-c334-4910-8452-c0675e99393b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:28.888606 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d082b-c334-4910-8452-c0675e99393b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:28.889284 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d082b-c334-4910-8452-c0675e99393b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:28.889948 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d082b-c334-4910-8452-c0675e99393b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:28.904463 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17be07f-07dc-4a43-9676-df50b95f42fc None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:28.908403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d082b-c334-4910-8452-c0675e99393b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:28.919748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-209d082b-c334-4910-8452-c0675e99393b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:28.919748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:28.919748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:28.919748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:28.919748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:28.919748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:28.919748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:28.919748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:28.919748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:28.919748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:28.919748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:28.919748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:28.919748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:28.919748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:28.919748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:28.919748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:28.921461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:28.921461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:28.921461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:28.921461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:28.921461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:28.921461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:28.921461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:28.921461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:28.921461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:28.921461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:28.921461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:28.921461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:28.921461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:28.921461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:28.921461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:28.921461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:28.922950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:28.922950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:28.922950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:28.922950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:28.922950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:28.922950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:28.922950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:28.922950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:28.922950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:28.922950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:28.922950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:28.922950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:28.927633 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 111/225] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:11:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:28.937678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d082b-c334-4910-8452-c0675e99393b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:29.107528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17be07f-07dc-4a43-9676-df50b95f42fc None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:29.166301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d082b-c334-4910-8452-c0675e99393b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:29.200895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7138d6-3bf0-4794-81fb-9a4bb5f77490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:29.201563 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7138d6-3bf0-4794-81fb-9a4bb5f77490 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:29.201886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7138d6-3bf0-4794-81fb-9a4bb5f77490 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:29.202119 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7138d6-3bf0-4794-81fb-9a4bb5f77490 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:29.218496 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7138d6-3bf0-4794-81fb-9a4bb5f77490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:29.224071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-1c7138d6-3bf0-4794-81fb-9a4bb5f77490 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:29.224071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:29.224071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:29.224071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:29.224071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:29.224071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:29.224071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:29.224071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:29.224071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:29.224071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:29.224071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:29.224071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:29.224071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:29.224071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:29.224071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:29.224071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:29.225627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:29.225627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:29.225627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:29.225627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:29.225627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:29.225627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:29.225627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:29.225627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:29.225627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:29.225627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:29.225627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:29.225627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:29.225627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:29.225627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:29.225627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:29.225627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:29.227037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:29.227037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:29.227037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:29.227037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:29.227037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:29.227037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:29.227037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:29.227037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:29.227037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:29.227037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:29.227037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:29.227037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:29.233753 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 115/226] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:11:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:11:29.238320 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ce74f-4b8e-4cc4-bf2a-543375d7890b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:29.239664 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ce74f-4b8e-4cc4-bf2a-543375d7890b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:29.240451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ce74f-4b8e-4cc4-bf2a-543375d7890b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:29.240879 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7138d6-3bf0-4794-81fb-9a4bb5f77490 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:29.241489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ce74f-4b8e-4cc4-bf2a-543375d7890b None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:29.243282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ce74f-4b8e-4cc4-bf2a-543375d7890b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:29.244126 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ce74f-4b8e-4cc4-bf2a-543375d7890b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:29.247268 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ce74f-4b8e-4cc4-bf2a-543375d7890b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:29.260595 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:29.265633 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 112/227] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:29.272125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ce74f-4b8e-4cc4-bf2a-543375d7890b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:29.352833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:29.443429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ce74f-4b8e-4cc4-bf2a-543375d7890b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:29.452894 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7138d6-3bf0-4794-81fb-9a4bb5f77490 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:29.503467 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ced8e-623e-49d0-b0f0-bdf5fa5d4977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:29.503467 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ced8e-623e-49d0-b0f0-bdf5fa5d4977 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:29.503467 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ced8e-623e-49d0-b0f0-bdf5fa5d4977 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:29.503467 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ced8e-623e-49d0-b0f0-bdf5fa5d4977 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:29.504580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ced8e-623e-49d0-b0f0-bdf5fa5d4977 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:29.504580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ced8e-623e-49d0-b0f0-bdf5fa5d4977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:29.504580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ced8e-623e-49d0-b0f0-bdf5fa5d4977 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:29.511546 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 116/228] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:11:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:29.518675 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdefca-7cd0-4314-86c0-9e0ca4733c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:29.520665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdefca-7cd0-4314-86c0-9e0ca4733c82 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:29.521385 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdefca-7cd0-4314-86c0-9e0ca4733c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:29.521550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ced8e-623e-49d0-b0f0-bdf5fa5d4977 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:29.522245 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdefca-7cd0-4314-86c0-9e0ca4733c82 None admin] PATH_INFO: `/v3/users/c092dc758a014f28971bc69711168cb3` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:29.524531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdefca-7cd0-4314-86c0-9e0ca4733c82 None admin] RBAC: Authorizing `identity:get_user(user_id=c092dc758a014f28971bc69711168cb3)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:29.527366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdefca-7cd0-4314-86c0-9e0ca4733c82 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:29.530349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 113/229] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:29 2022] GET /identity/v3/users/c092dc758a014f28971bc69711168cb3 => generated 283 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:29.547786 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdefca-7cd0-4314-86c0-9e0ca4733c82 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:29.612848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:29.637146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ced8e-623e-49d0-b0f0-bdf5fa5d4977 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:29.684424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d76cd-cc8b-4c92-b007-180fa69a3cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:29.685113 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d76cd-cc8b-4c92-b007-180fa69a3cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:29.685400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d76cd-cc8b-4c92-b007-180fa69a3cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:29.685680 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d76cd-cc8b-4c92-b007-180fa69a3cc5 None admin] PATH_INFO: `/v3/users/c092dc758a014f28971bc69711168cb3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:29.687152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d76cd-cc8b-4c92-b007-180fa69a3cc5 None admin] RBAC: Authorizing `identity:get_user(user_id=c092dc758a014f28971bc69711168cb3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:29.691140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d76cd-cc8b-4c92-b007-180fa69a3cc5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:29.697088 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 117/230] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:29 2022] GET /identity/v3/users/c092dc758a014f28971bc69711168cb3 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:29.704003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d76cd-cc8b-4c92-b007-180fa69a3cc5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:29.810114 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdefca-7cd0-4314-86c0-9e0ca4733c82 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:29.825688 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:29.856229 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f973c18-6d08-4f1f-b6bc-e25d7f219924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:29.856902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f973c18-6d08-4f1f-b6bc-e25d7f219924 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:29.857191 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f973c18-6d08-4f1f-b6bc-e25d7f219924 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:29.857411 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d76cd-cc8b-4c92-b007-180fa69a3cc5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:29.857548 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f973c18-6d08-4f1f-b6bc-e25d7f219924 None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:29.864940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f973c18-6d08-4f1f-b6bc-e25d7f219924 None admin] RBAC: Authorizing `identity:get_project(project_id=13b307d54e4e48ef84790ab15f5ceb39)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:29.866493 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f973c18-6d08-4f1f-b6bc-e25d7f219924 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:29.868250 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 114/231] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:29 2022] GET /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39 => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:29.882455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f973c18-6d08-4f1f-b6bc-e25d7f219924 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:29.906659 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaebd6-9f87-482a-bff2-86e3b59390de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:29.907790 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaebd6-9f87-482a-bff2-86e3b59390de None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:29.909361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaebd6-9f87-482a-bff2-86e3b59390de None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:29.909651 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaebd6-9f87-482a-bff2-86e3b59390de None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:29.912419 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aaebd6-9f87-482a-bff2-86e3b59390de None admin] RBAC: Authorizing `identity:get_project(project_id=13b307d54e4e48ef84790ab15f5ceb39)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:29.916496 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aaebd6-9f87-482a-bff2-86e3b59390de None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:29.920573 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 118/232] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:29 2022] GET /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:29.926721 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaebd6-9f87-482a-bff2-86e3b59390de None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:29.992780 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:30.019363 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f973c18-6d08-4f1f-b6bc-e25d7f219924 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:30.060944 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e54375-2fea-4bc8-af66-5b8d52b5f82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:30.063256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e54375-2fea-4bc8-af66-5b8d52b5f82f None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:30.063545 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e54375-2fea-4bc8-af66-5b8d52b5f82f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:30.063820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e54375-2fea-4bc8-af66-5b8d52b5f82f None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39/users/c092dc758a014f28971bc69711168cb3/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:30.069838 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e54375-2fea-4bc8-af66-5b8d52b5f82f None admin] RBAC: Authorizing `identity:create_grant(project_id=13b307d54e4e48ef84790ab15f5ceb39, user_id=c092dc758a014f28971bc69711168cb3, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:30.071304 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e54375-2fea-4bc8-af66-5b8d52b5f82f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:30.094112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 115/233] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:11:29 2022] PUT /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39/users/c092dc758a014f28971bc69711168cb3/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:11:30.177998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaebd6-9f87-482a-bff2-86e3b59390de None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:30.223350 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfc215-3145-4d3d-88c5-72f0c4ed6b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:30.224249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfc215-3145-4d3d-88c5-72f0c4ed6b7f None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:30.224535 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfc215-3145-4d3d-88c5-72f0c4ed6b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:30.224815 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfc215-3145-4d3d-88c5-72f0c4ed6b7f None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39/users/c092dc758a014f28971bc69711168cb3/roles/472f2455c837486084f108ce944f1bff` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:30.227168 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfc215-3145-4d3d-88c5-72f0c4ed6b7f None admin] RBAC: Authorizing `identity:create_grant(project_id=13b307d54e4e48ef84790ab15f5ceb39, user_id=c092dc758a014f28971bc69711168cb3, role_id=472f2455c837486084f108ce944f1bff)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:30.228709 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfc215-3145-4d3d-88c5-72f0c4ed6b7f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:30.246447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 119/234] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:11:29 2022] PUT /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39/users/c092dc758a014f28971bc69711168cb3/roles/472f2455c837486084f108ce944f1bff => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:11:30.358450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93461af6-cfcc-4045-a712-80cae8849770 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:30.359127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93461af6-cfcc-4045-a712-80cae8849770 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:30.359127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93461af6-cfcc-4045-a712-80cae8849770 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:30.360404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 116/235] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:30.366462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c226123-3610-42fc-b7bb-1f06f1ad6d60 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:30.366816 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c226123-3610-42fc-b7bb-1f06f1ad6d60 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:30.367028 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c226123-3610-42fc-b7bb-1f06f1ad6d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:30.388356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7c226123-3610-42fc-b7bb-1f06f1ad6d60 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:30.389595 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7c226123-3610-42fc-b7bb-1f06f1ad6d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:30.471998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 120/236] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:30.496032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93461af6-cfcc-4045-a712-80cae8849770 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:30.550105 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:30.637854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93461af6-cfcc-4045-a712-80cae8849770 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:30.687529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469f0df-fca9-4967-a30d-f78256527dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:30.688210 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469f0df-fca9-4967-a30d-f78256527dfe None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:30.688496 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469f0df-fca9-4967-a30d-f78256527dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:30.688778 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469f0df-fca9-4967-a30d-f78256527dfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:30.689935 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469f0df-fca9-4967-a30d-f78256527dfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:30.691496 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469f0df-fca9-4967-a30d-f78256527dfe None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:30.693736 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 117/237] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:11:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:30.699517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c226123-3610-42fc-b7bb-1f06f1ad6d60 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:30.702981 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:30.736748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b96cd2-56c2-4124-b4c4-2be1fe65e1f7 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:30.737007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b96cd2-56c2-4124-b4c4-2be1fe65e1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:30.737310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b96cd2-56c2-4124-b4c4-2be1fe65e1f7 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:30.739705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 118/238] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:11:30.750905 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a01a50-bc6c-4434-86e2-0c0a661d97cb None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:30.751259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a01a50-bc6c-4434-86e2-0c0a661d97cb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:30.751480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a01a50-bc6c-4434-86e2-0c0a661d97cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:30.796116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-09a01a50-bc6c-4434-86e2-0c0a661d97cb None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:30.797366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-09a01a50-bc6c-4434-86e2-0c0a661d97cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:30.816717 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c226123-3610-42fc-b7bb-1f06f1ad6d60 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:30.855794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d319919-af72-4393-ba59-ae6996261034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:30.856476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d319919-af72-4393-ba59-ae6996261034 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:30.856762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d319919-af72-4393-ba59-ae6996261034 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:30.857058 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d319919-af72-4393-ba59-ae6996261034 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:30.857812 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d319919-af72-4393-ba59-ae6996261034 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:30.860012 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d319919-af72-4393-ba59-ae6996261034 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:30.888492 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 121/239] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Aug 4 10:11:30 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:11:30.986621 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 119/240] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:31.015895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d319919-af72-4393-ba59-ae6996261034 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:31.096759 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:31.139660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d319919-af72-4393-ba59-ae6996261034 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:31.177486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38c19b-5bb9-4efb-b855-4638fcb7c211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:31.178149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38c19b-5bb9-4efb-b855-4638fcb7c211 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:31.178880 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38c19b-5bb9-4efb-b855-4638fcb7c211 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:31.178880 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38c19b-5bb9-4efb-b855-4638fcb7c211 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:31.190131 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38c19b-5bb9-4efb-b855-4638fcb7c211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:31.196571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-6b38c19b-5bb9-4efb-b855-4638fcb7c211 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 10:11:31.196571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:31.196571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:31.196571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:31.196571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:31.196571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:31.196571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:31.196571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:31.196571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:31.196571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:31.196571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:31.196571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:31.196571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:31.196571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:31.196571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:31.196571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:31.197918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:31.197918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:31.197918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:31.197918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:31.197918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:31.197918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:31.197918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:31.197918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:31.197918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:31.197918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:31.197918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:31.197918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:31.197918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:31.197918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:31.197918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:31.197918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:31.199191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:31.199191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:31.199191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:31.199191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:31.199191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:31.199191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:31.199191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:31.199191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:31.199191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:31.199191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:31.199191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 10:11:31.199191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:31.199191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 122/241] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:31.205271 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a01a50-bc6c-4434-86e2-0c0a661d97cb None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:31.258614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:31.323516 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a01a50-bc6c-4434-86e2-0c0a661d97cb None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:31.361090 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bb7ae-a41b-4832-93a9-51027878eb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:31.362422 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bb7ae-a41b-4832-93a9-51027878eb23 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:31.362872 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bb7ae-a41b-4832-93a9-51027878eb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:31.363947 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bb7ae-a41b-4832-93a9-51027878eb23 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:31.365063 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89bb7ae-a41b-4832-93a9-51027878eb23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:31.365562 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89bb7ae-a41b-4832-93a9-51027878eb23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:31.367121 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89bb7ae-a41b-4832-93a9-51027878eb23 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:31.376448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 120/242] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:31.384279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38c19b-5bb9-4efb-b855-4638fcb7c211 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:31.503738 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38c19b-5bb9-4efb-b855-4638fcb7c211 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:31.527958 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:31.550381 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45ce2d-ee17-47a0-8734-3b3c55c98f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:31.551090 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45ce2d-ee17-47a0-8734-3b3c55c98f78 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:31.551376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45ce2d-ee17-47a0-8734-3b3c55c98f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:31.551658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45ce2d-ee17-47a0-8734-3b3c55c98f78 None admin] PATH_INFO: `/v3/users/dd5036fd39f54c0fb13b3ef10114b352` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:31.568230 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45ce2d-ee17-47a0-8734-3b3c55c98f78 None admin] RBAC: Authorizing `identity:get_user(user_id=dd5036fd39f54c0fb13b3ef10114b352)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:31.569798 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45ce2d-ee17-47a0-8734-3b3c55c98f78 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:31.571552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 123/243] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:31 2022] GET /identity/v3/users/dd5036fd39f54c0fb13b3ef10114b352 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:31.577309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bb7ae-a41b-4832-93a9-51027878eb23 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:31.705737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bb7ae-a41b-4832-93a9-51027878eb23 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:31.707896 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:31.748573 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e8063-eb1e-438a-bc89-b0ab01462fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:31.749240 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e8063-eb1e-438a-bc89-b0ab01462fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:31.749521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e8063-eb1e-438a-bc89-b0ab01462fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:31.749796 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e8063-eb1e-438a-bc89-b0ab01462fd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:31.825179 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e8063-eb1e-438a-bc89-b0ab01462fd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:31.826654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e8063-eb1e-438a-bc89-b0ab01462fd7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:31.844988 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9dc20-1d39-43b9-9a50-e9d91d60486c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:31.845599 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9dc20-1d39-43b9-9a50-e9d91d60486c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:31.846082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9dc20-1d39-43b9-9a50-e9d91d60486c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:31.848577 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 124/244] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:31.855541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e47ac-9cf2-4bf6-a02f-2bf7f26deb13 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:31.856134 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e47ac-9cf2-4bf6-a02f-2bf7f26deb13 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:31.856642 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e47ac-9cf2-4bf6-a02f-2bf7f26deb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:31.883618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-df8e47ac-9cf2-4bf6-a02f-2bf7f26deb13 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:31.885242 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-df8e47ac-9cf2-4bf6-a02f-2bf7f26deb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:31.933710 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 121/245] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:31.939768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e8063-eb1e-438a-bc89-b0ab01462fd7 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:31.944492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:32.024442 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 125/246] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:32.061266 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e8063-eb1e-438a-bc89-b0ab01462fd7 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:32.084134 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e47ac-9cf2-4bf6-a02f-2bf7f26deb13 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:32.118678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ad48b-b2be-4090-8a22-9d57be16820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:32.119342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ad48b-b2be-4090-8a22-9d57be16820f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:32.119624 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ad48b-b2be-4090-8a22-9d57be16820f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:32.124080 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ad48b-b2be-4090-8a22-9d57be16820f None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:32.125440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ad48b-b2be-4090-8a22-9d57be16820f None admin] RBAC: Authorizing `identity:get_project(project_id=13b307d54e4e48ef84790ab15f5ceb39)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:32.126983 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ad48b-b2be-4090-8a22-9d57be16820f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:32.132704 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 122/247] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:31 2022] GET /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:32.146278 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ad48b-b2be-4090-8a22-9d57be16820f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:32.304623 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:32.320160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e47ac-9cf2-4bf6-a02f-2bf7f26deb13 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:32.342434 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:32.370443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ad48b-b2be-4090-8a22-9d57be16820f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:32.373373 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ca36f-5766-494b-b8c4-400f7d948a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:32.374303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ca36f-5766-494b-b8c4-400f7d948a19 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:32.374799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ca36f-5766-494b-b8c4-400f7d948a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:32.375271 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ca36f-5766-494b-b8c4-400f7d948a19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:32.389312 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ca36f-5766-494b-b8c4-400f7d948a19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:32.395360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-b31ca36f-5766-494b-b8c4-400f7d948a19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:32.395360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:32.395360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:32.395360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:32.395360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:32.395360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:32.395360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:32.395360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:32.395360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:32.395360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:32.395360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:32.395360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:32.395360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:32.395360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:32.395360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:32.395360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:32.396327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:32.396327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:32.396327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:32.396327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:32.396327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:32.396327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:32.396327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:32.396327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:32.396327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:32.396327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:32.396327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:32.396327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:32.396327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:32.396327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:32.396327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:32.396327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:32.397197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:32.397197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:32.397197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:32.397197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:32.397197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:32.397197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:32.397197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:32.397197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:32.397197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:32.397197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:32.397197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:32.397197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:32.399555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 126/248] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:32.407719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ca36f-5766-494b-b8c4-400f7d948a19 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:32.456148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5386f-d706-47ba-8b99-71bda2d56769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:32.456822 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5386f-d706-47ba-8b99-71bda2d56769 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:32.457834 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5386f-d706-47ba-8b99-71bda2d56769 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:32.458164 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5386f-d706-47ba-8b99-71bda2d56769 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:32.458930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5386f-d706-47ba-8b99-71bda2d56769 None admin] RBAC: Adding query filter params (role.id=439977f47a30404790859f8a0d504997, scope.project.id=13b307d54e4e48ef84790ab15f5ceb39, user.id=dd5036fd39f54c0fb13b3ef10114b352) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:32.459244 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5386f-d706-47ba-8b99-71bda2d56769 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:32.464237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5386f-d706-47ba-8b99-71bda2d56769 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:32.466886 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 123/249] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:11:32 2022] GET /identity/v3/role_assignments?user.id=dd5036fd39f54c0fb13b3ef10114b352&scope.project.id=13b307d54e4e48ef84790ab15f5ceb39&role.id=439977f47a30404790859f8a0d504997 => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:32.656725 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ca36f-5766-494b-b8c4-400f7d948a19 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:32.710085 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d14c12-3012-48ee-bf4b-9dd27f3fcd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:32.710742 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d14c12-3012-48ee-bf4b-9dd27f3fcd36 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:32.711023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d14c12-3012-48ee-bf4b-9dd27f3fcd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:32.711299 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d14c12-3012-48ee-bf4b-9dd27f3fcd36 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:32.712044 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d14c12-3012-48ee-bf4b-9dd27f3fcd36 None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:32.712376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d14c12-3012-48ee-bf4b-9dd27f3fcd36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:32.713818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d14c12-3012-48ee-bf4b-9dd27f3fcd36 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:32.727069 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 127/250] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:32.734454 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5386f-d706-47ba-8b99-71bda2d56769 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:32.866895 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5386f-d706-47ba-8b99-71bda2d56769 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:32.935909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b517f-bf04-411d-be6d-bbe9dafe98ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:32.937088 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b517f-bf04-411d-be6d-bbe9dafe98ad None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:32.937514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b517f-bf04-411d-be6d-bbe9dafe98ad None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:32.937966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b517f-bf04-411d-be6d-bbe9dafe98ad None admin] PATH_INFO: `/v3/users/4683edfccc8b4b4c8b99266907ff1082` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:32.943550 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b517f-bf04-411d-be6d-bbe9dafe98ad None admin] RBAC: Authorizing `identity:get_user(user_id=4683edfccc8b4b4c8b99266907ff1082)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:32.945967 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b517f-bf04-411d-be6d-bbe9dafe98ad None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:32.948827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 124/251] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:32 2022] GET /identity/v3/users/4683edfccc8b4b4c8b99266907ff1082 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:32.956406 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d14c12-3012-48ee-bf4b-9dd27f3fcd36 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:33.012044 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:33.104336 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d14c12-3012-48ee-bf4b-9dd27f3fcd36 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:33.155241 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2451f8d-9dcc-4a7f-8b37-5cc25c85a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:33.155907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2451f8d-9dcc-4a7f-8b37-5cc25c85a392 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:33.156301 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2451f8d-9dcc-4a7f-8b37-5cc25c85a392 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:33.156580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2451f8d-9dcc-4a7f-8b37-5cc25c85a392 None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:33.157777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2451f8d-9dcc-4a7f-8b37-5cc25c85a392 None admin] RBAC: Authorizing `identity:get_project(project_id=13b307d54e4e48ef84790ab15f5ceb39)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:33.159228 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2451f8d-9dcc-4a7f-8b37-5cc25c85a392 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:33.162974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 128/252] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:32 2022] GET /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:33.170029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b517f-bf04-411d-be6d-bbe9dafe98ad None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:33.176612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:33.231818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4227db6-eeee-4265-be26-ee11732ac0f2 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:33.232225 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4227db6-eeee-4265-be26-ee11732ac0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:33.232514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4227db6-eeee-4265-be26-ee11732ac0f2 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:33.234423 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 129/253] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:11:33.243056 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9bef1-a27f-4de1-9db1-fec12809e634 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:33.243360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9bef1-a27f-4de1-9db1-fec12809e634 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:33.243618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9bef1-a27f-4de1-9db1-fec12809e634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:33.281756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a6a9bef1-a27f-4de1-9db1-fec12809e634 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:33.283259 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a6a9bef1-a27f-4de1-9db1-fec12809e634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:33.361402 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 130/254] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:33.363761 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4659fe5-055d-4660-85f3-075002270317 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:33.364341 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4659fe5-055d-4660-85f3-075002270317 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:33.364834 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4659fe5-055d-4660-85f3-075002270317 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:33.366673 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 131/255] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:33.371713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0b5c8-6eaf-41bc-9902-3cd44a2f4f72 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:33.372298 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0b5c8-6eaf-41bc-9902-3cd44a2f4f72 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:33.372817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0b5c8-6eaf-41bc-9902-3cd44a2f4f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:33.393446 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e7a0b5c8-6eaf-41bc-9902-3cd44a2f4f72 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:33.396213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e7a0b5c8-6eaf-41bc-9902-3cd44a2f4f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:33.432282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:33.437756 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b517f-bf04-411d-be6d-bbe9dafe98ad None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:33.477782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 132/256] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:33.478744 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0b5c8-6eaf-41bc-9902-3cd44a2f4f72 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:33.529787 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ebbbc-33be-4db7-bb66-3d69480ddb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:33.531304 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ebbbc-33be-4db7-bb66-3d69480ddb5c None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:33.532010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ebbbc-33be-4db7-bb66-3d69480ddb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:33.549331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ebbbc-33be-4db7-bb66-3d69480ddb5c None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39/users/4683edfccc8b4b4c8b99266907ff1082/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:33.553720 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ebbbc-33be-4db7-bb66-3d69480ddb5c None admin] RBAC: Authorizing `identity:create_grant(project_id=13b307d54e4e48ef84790ab15f5ceb39, user_id=4683edfccc8b4b4c8b99266907ff1082, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:33.556639 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ebbbc-33be-4db7-bb66-3d69480ddb5c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:33.592012 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 125/257] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:11:33 2022] PUT /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39/users/4683edfccc8b4b4c8b99266907ff1082/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:11:33.593665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ebbbc-33be-4db7-bb66-3d69480ddb5c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:33.600202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0b5c8-6eaf-41bc-9902-3cd44a2f4f72 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:33.688995 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed88091-57ba-49f2-a8af-344537e04e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:33.689680 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed88091-57ba-49f2-a8af-344537e04e52 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:33.689967 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed88091-57ba-49f2-a8af-344537e04e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:33.690245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed88091-57ba-49f2-a8af-344537e04e52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:33.724738 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed88091-57ba-49f2-a8af-344537e04e52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:33.727557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-6ed88091-57ba-49f2-a8af-344537e04e52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:33.727557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:33.727557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:33.727557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:33.727557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:33.727557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:33.727557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:33.727557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:33.727557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:33.727557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:33.727557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:33.727557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:33.727557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:33.727557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:33.727557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:33.727557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:33.729001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:33.729001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:33.729001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:33.729001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:33.729001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:33.729001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:33.729001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:33.729001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:33.729001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:33.729001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:33.729001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:33.729001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:33.729001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:33.729001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:33.729001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:33.729001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:33.730236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:33.730236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:33.730236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:33.730236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:33.730236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:33.730236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:33.730236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:33.730236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:33.730236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:33.730236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:33.730236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:33.730236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:33.730236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 133/258] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:11:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:33.741278 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed88091-57ba-49f2-a8af-344537e04e52 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:33.780816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:33.809670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:33.865813 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ebbbc-33be-4db7-bb66-3d69480ddb5c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:33.966633 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8b90b-660c-4271-bcc1-2c0ecc089af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:33.967660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8b90b-660c-4271-bcc1-2c0ecc089af0 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:33.968089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8b90b-660c-4271-bcc1-2c0ecc089af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:33.968537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8b90b-660c-4271-bcc1-2c0ecc089af0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:33.992402 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8b90b-660c-4271-bcc1-2c0ecc089af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:34.007996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-cba8b90b-660c-4271-bcc1-2c0ecc089af0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:34.007996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:34.007996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:34.007996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:34.007996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:34.007996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:34.007996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:34.007996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:34.007996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:34.007996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:34.007996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:34.007996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:34.007996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:34.007996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:34.007996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:34.007996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:34.009009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:34.009009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:34.009009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:34.009009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:34.009009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:34.009009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:34.009009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:34.009009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:34.009009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:34.009009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:34.009009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:34.009009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:34.009009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:34.009009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:34.009009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:34.009009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:34.009784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:34.009784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:34.009784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:34.009784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:34.009784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:34.009784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:34.009784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:34.009784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:34.009784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:34.009784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:34.009784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:34.009784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:34.010384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 126/259] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:11:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:34.016511 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8b90b-660c-4271-bcc1-2c0ecc089af0 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:34.054466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed88091-57ba-49f2-a8af-344537e04e52 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:34.130658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4431427-0d3e-4a2b-8966-f6c91eca84cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:34.131315 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4431427-0d3e-4a2b-8966-f6c91eca84cd None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:34.131594 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4431427-0d3e-4a2b-8966-f6c91eca84cd None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:34.131866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4431427-0d3e-4a2b-8966-f6c91eca84cd None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:34.132639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4431427-0d3e-4a2b-8966-f6c91eca84cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:34.132944 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4431427-0d3e-4a2b-8966-f6c91eca84cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:34.134376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4431427-0d3e-4a2b-8966-f6c91eca84cd None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:34.150363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 134/260] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:34.156500 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4431427-0d3e-4a2b-8966-f6c91eca84cd None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:34.266341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8b90b-660c-4271-bcc1-2c0ecc089af0 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:34.290116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:34.303739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:34.337062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fecc1-106d-4d75-a12c-c4c42732c2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:34.337904 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fecc1-106d-4d75-a12c-c4c42732c2ac None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:34.338333 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fecc1-106d-4d75-a12c-c4c42732c2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:34.338762 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fecc1-106d-4d75-a12c-c4c42732c2ac None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:34.339891 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fecc1-106d-4d75-a12c-c4c42732c2ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:34.340392 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fecc1-106d-4d75-a12c-c4c42732c2ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:34.342626 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fecc1-106d-4d75-a12c-c4c42732c2ac None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:34.350682 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4431427-0d3e-4a2b-8966-f6c91eca84cd None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:34.373748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 127/261] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:11:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:34.381628 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fecc1-106d-4d75-a12c-c4c42732c2ac None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:34.420922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81245360-49b7-46df-9009-2382541d7bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:34.421647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81245360-49b7-46df-9009-2382541d7bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:34.421877 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81245360-49b7-46df-9009-2382541d7bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:34.422153 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81245360-49b7-46df-9009-2382541d7bc1 None admin] PATH_INFO: `/v3/users/c092dc758a014f28971bc69711168cb3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:34.423397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81245360-49b7-46df-9009-2382541d7bc1 None admin] RBAC: Authorizing `identity:get_user(user_id=c092dc758a014f28971bc69711168cb3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:34.424906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81245360-49b7-46df-9009-2382541d7bc1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:34.428474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 135/262] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:34 2022] GET /identity/v3/users/c092dc758a014f28971bc69711168cb3 => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:34.433255 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81245360-49b7-46df-9009-2382541d7bc1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:34.656199 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fecc1-106d-4d75-a12c-c4c42732c2ac None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:34.709597 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81245360-49b7-46df-9009-2382541d7bc1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:34.761799 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1513e8-e1bf-4cbe-a591-39974b39c527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:34.762469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1513e8-e1bf-4cbe-a591-39974b39c527 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:34.762755 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1513e8-e1bf-4cbe-a591-39974b39c527 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:34.763032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1513e8-e1bf-4cbe-a591-39974b39c527 None admin] PATH_INFO: `/v3/users/c092dc758a014f28971bc69711168cb3` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:34.764274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1513e8-e1bf-4cbe-a591-39974b39c527 None admin] RBAC: Authorizing `identity:get_user(user_id=c092dc758a014f28971bc69711168cb3)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:34.765749 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1513e8-e1bf-4cbe-a591-39974b39c527 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:34.767615 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 128/263] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:34 2022] GET /identity/v3/users/c092dc758a014f28971bc69711168cb3 => generated 283 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:34.769147 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c62c7b-0326-4a82-bd32-4a80253d0561 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:34.769467 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c62c7b-0326-4a82-bd32-4a80253d0561 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:34.769743 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c62c7b-0326-4a82-bd32-4a80253d0561 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:34.771019 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 129/264] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:34.773696 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c62c7b-0326-4a82-bd32-4a80253d0561 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:34.798495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47833a-be12-4198-bcb2-f1fd0461125e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:34.799124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47833a-be12-4198-bcb2-f1fd0461125e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:34.799409 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47833a-be12-4198-bcb2-f1fd0461125e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:34.799685 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47833a-be12-4198-bcb2-f1fd0461125e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:34.828407 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:34.849213 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:34.897587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47833a-be12-4198-bcb2-f1fd0461125e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:34.898987 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47833a-be12-4198-bcb2-f1fd0461125e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:34.908337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c62c7b-0326-4a82-bd32-4a80253d0561 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:34.954854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac95d72-03c5-48f4-b15e-f11dd2703253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:34.956368 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac95d72-03c5-48f4-b15e-f11dd2703253 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:34.957105 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac95d72-03c5-48f4-b15e-f11dd2703253 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:34.957559 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac95d72-03c5-48f4-b15e-f11dd2703253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:35.015509 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 136/265] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 10:11:35.017329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcc572-8560-432d-8871-4eb3e70e345c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:35.017791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcc572-8560-432d-8871-4eb3e70e345c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:35.018234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcc572-8560-432d-8871-4eb3e70e345c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:35.037654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-dfdcc572-8560-432d-8871-4eb3e70e345c None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:35.039188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-dfdcc572-8560-432d-8871-4eb3e70e345c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:35.045578 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac95d72-03c5-48f4-b15e-f11dd2703253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:35.047169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac95d72-03c5-48f4-b15e-f11dd2703253 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:35.096371 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:35.110059 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:35.131165 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 137/266] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:35.133491 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6861d15-92c4-4c6e-9c5a-98817ec3d7dc None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:35.133966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6861d15-92c4-4c6e-9c5a-98817ec3d7dc None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:35.134447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6861d15-92c4-4c6e-9c5a-98817ec3d7dc None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:35.135965 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 138/267] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:35.136964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6861d15-92c4-4c6e-9c5a-98817ec3d7dc None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:35.190161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 130/268] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:35.192691 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855ec18-36b1-444c-9723-4ef709900909 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:35.193267 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855ec18-36b1-444c-9723-4ef709900909 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:35.193714 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855ec18-36b1-444c-9723-4ef709900909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:35.213016 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-6855ec18-36b1-444c-9723-4ef709900909 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:35.214533 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6855ec18-36b1-444c-9723-4ef709900909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:35.287197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6861d15-92c4-4c6e-9c5a-98817ec3d7dc None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:35.295788 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 131/269] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:35.297365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855ec18-36b1-444c-9723-4ef709900909 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:35.326366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d8d3b-e524-4554-8aa7-3f27552897ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:35.327406 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d8d3b-e524-4554-8aa7-3f27552897ac None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:35.327961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d8d3b-e524-4554-8aa7-3f27552897ac None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:35.328534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d8d3b-e524-4554-8aa7-3f27552897ac None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:35.330479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d8d3b-e524-4554-8aa7-3f27552897ac None admin] RBAC: Authorizing `identity:get_project(project_id=13b307d54e4e48ef84790ab15f5ceb39)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:35.332869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d8d3b-e524-4554-8aa7-3f27552897ac None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:35.335039 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 139/270] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:35 2022] GET /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:35.336152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d8d3b-e524-4554-8aa7-3f27552897ac None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:35.391571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:35.407152 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:35.430981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855ec18-36b1-444c-9723-4ef709900909 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:35.458006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d8d3b-e524-4554-8aa7-3f27552897ac None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:35.483453 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bdc55-2e7c-460e-9241-2ef74d9aab4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:35.484488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bdc55-2e7c-460e-9241-2ef74d9aab4a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:35.484934 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bdc55-2e7c-460e-9241-2ef74d9aab4a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:35.485390 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bdc55-2e7c-460e-9241-2ef74d9aab4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:35.498907 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bdc55-2e7c-460e-9241-2ef74d9aab4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:35.504498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-714bdc55-2e7c-460e-9241-2ef74d9aab4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:35.504498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:35.504498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:35.504498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:35.504498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:35.504498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:35.504498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:35.504498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:35.504498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:35.504498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:35.504498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:35.504498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:35.504498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:35.504498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:35.504498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:35.504498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:35.505349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:35.505349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:35.505349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:35.505349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:35.505349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:35.505349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:35.505349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:35.505349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:35.505349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:35.505349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:35.505349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:35.505349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:35.505349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:35.505349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:35.505349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:35.505349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:35.506116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:35.506116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:35.506116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:35.506116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:35.506116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:35.506116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:35.506116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:35.506116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:35.506116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:35.506116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:35.506116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:35.506116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:35.507219 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99112931-261d-4d3d-9059-5ffe94ca819e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:35.507983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99112931-261d-4d3d-9059-5ffe94ca819e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:35.508376 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 132/271] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:35.508484 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99112931-261d-4d3d-9059-5ffe94ca819e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:35.508838 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99112931-261d-4d3d-9059-5ffe94ca819e None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:35.509525 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bdc55-2e7c-460e-9241-2ef74d9aab4a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:35.514948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99112931-261d-4d3d-9059-5ffe94ca819e None admin] RBAC: Authorizing `identity:get_project(project_id=13b307d54e4e48ef84790ab15f5ceb39)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:35.516545 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99112931-261d-4d3d-9059-5ffe94ca819e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:35.524046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 140/272] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:35 2022] GET /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:35.525820 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af07bc7-ae0a-47d7-96d4-df4bfb7b19d5 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:35.526173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af07bc7-ae0a-47d7-96d4-df4bfb7b19d5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:35.526575 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af07bc7-ae0a-47d7-96d4-df4bfb7b19d5 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:35.532065 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 141/273] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:35.532065 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af07bc7-ae0a-47d7-96d4-df4bfb7b19d5 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:35.654200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bdc55-2e7c-460e-9241-2ef74d9aab4a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:35.663205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af07bc7-ae0a-47d7-96d4-df4bfb7b19d5 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:35.685221 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:35.703719 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73305a58-8f38-4f63-a259-ad7a67992271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:35.704600 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73305a58-8f38-4f63-a259-ad7a67992271 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:35.704823 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73305a58-8f38-4f63-a259-ad7a67992271 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:35.705104 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73305a58-8f38-4f63-a259-ad7a67992271 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:35.706387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73305a58-8f38-4f63-a259-ad7a67992271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:35.708641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73305a58-8f38-4f63-a259-ad7a67992271 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:35.710487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 133/274] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:11:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:35.711243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73305a58-8f38-4f63-a259-ad7a67992271 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:35.712514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5d777-26cf-4502-8f25-c3645f8b31cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:35.713267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5d777-26cf-4502-8f25-c3645f8b31cc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:35.713671 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5d777-26cf-4502-8f25-c3645f8b31cc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:35.714116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5d777-26cf-4502-8f25-c3645f8b31cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:35.715398 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5d777-26cf-4502-8f25-c3645f8b31cc None admin] RBAC: Adding query filter params (role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.project.id=13b307d54e4e48ef84790ab15f5ceb39, user.id=c092dc758a014f28971bc69711168cb3) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:35.715915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5d777-26cf-4502-8f25-c3645f8b31cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:35.717731 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5d777-26cf-4502-8f25-c3645f8b31cc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:35.728494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 142/275] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:11:35 2022] GET /identity/v3/role_assignments?user.id=c092dc758a014f28971bc69711168cb3&scope.project.id=13b307d54e4e48ef84790ab15f5ceb39&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:35.728494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5d777-26cf-4502-8f25-c3645f8b31cc None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:35.729818 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:35.913625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5d777-26cf-4502-8f25-c3645f8b31cc None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:35.925300 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73305a58-8f38-4f63-a259-ad7a67992271 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:35.967105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a675762-0935-44a1-93f1-d36016374175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:35.967592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a675762-0935-44a1-93f1-d36016374175 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:35.967743 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a675762-0935-44a1-93f1-d36016374175 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:35.968050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a675762-0935-44a1-93f1-d36016374175 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:35.969624 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a675762-0935-44a1-93f1-d36016374175 None admin] RBAC: Adding query filter params (role.id=472f2455c837486084f108ce944f1bff, scope.project.id=13b307d54e4e48ef84790ab15f5ceb39, user.id=c092dc758a014f28971bc69711168cb3) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:35.969937 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a675762-0935-44a1-93f1-d36016374175 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:35.972333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a675762-0935-44a1-93f1-d36016374175 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:35.981544 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 143/276] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:11:35 2022] GET /identity/v3/role_assignments?user.id=c092dc758a014f28971bc69711168cb3&scope.project.id=13b307d54e4e48ef84790ab15f5ceb39&role.id=472f2455c837486084f108ce944f1bff => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:35.982569 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77e356-31f3-456e-bb0b-beae683f9ff2 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:35.982864 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77e356-31f3-456e-bb0b-beae683f9ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:35.983152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77e356-31f3-456e-bb0b-beae683f9ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:35.986595 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a57cea-0077-43af-b8fd-be7abb667402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:35.987964 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a57cea-0077-43af-b8fd-be7abb667402 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:35.988469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a57cea-0077-43af-b8fd-be7abb667402 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:35.988924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a57cea-0077-43af-b8fd-be7abb667402 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:35.990396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a57cea-0077-43af-b8fd-be7abb667402 None admin] RBAC: Adding query filter params (name=member) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:35.992135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a57cea-0077-43af-b8fd-be7abb667402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:35.994590 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a57cea-0077-43af-b8fd-be7abb667402 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:36.003809 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5a77e356-31f3-456e-bb0b-beae683f9ff2 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:36.005095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5a77e356-31f3-456e-bb0b-beae683f9ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:36.013844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 134/277] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:36.015131 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a57cea-0077-43af-b8fd-be7abb667402 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:36.064677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:36.101880 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:36.127093 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 144/278] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:36.129351 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77e356-31f3-456e-bb0b-beae683f9ff2 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:36.158075 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a57cea-0077-43af-b8fd-be7abb667402 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:36.202554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3a777-d7e5-45b1-a5bc-0cdc6eac6f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:36.203191 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3a777-d7e5-45b1-a5bc-0cdc6eac6f06 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:36.203476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3a777-d7e5-45b1-a5bc-0cdc6eac6f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:36.203751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3a777-d7e5-45b1-a5bc-0cdc6eac6f06 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:36.204486 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3a777-d7e5-45b1-a5bc-0cdc6eac6f06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:36.205989 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3a777-d7e5-45b1-a5bc-0cdc6eac6f06 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:36.233185 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 135/279] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Aug 4 10:11:36 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:11:36.233857 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3a777-d7e5-45b1-a5bc-0cdc6eac6f06 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:36.335001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77e356-31f3-456e-bb0b-beae683f9ff2 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:36.359565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3a777-d7e5-45b1-a5bc-0cdc6eac6f06 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:36.391448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:36.403724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf815d41-a26a-4115-b060-cc850e4ff4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:36.404558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf815d41-a26a-4115-b060-cc850e4ff4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:36.404845 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf815d41-a26a-4115-b060-cc850e4ff4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:36.405177 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf815d41-a26a-4115-b060-cc850e4ff4c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:36.414469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545777e6-4c0c-4cd1-a38d-9b22018441a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:36.416075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545777e6-4c0c-4cd1-a38d-9b22018441a4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:36.416585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545777e6-4c0c-4cd1-a38d-9b22018441a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:36.417053 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545777e6-4c0c-4cd1-a38d-9b22018441a4 None admin] PATH_INFO: `/v3/users/ac5a9381a1e44f72982df5a878aac9e4` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:36.419476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf815d41-a26a-4115-b060-cc850e4ff4c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:36.426112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-cf815d41-a26a-4115-b060-cc850e4ff4c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 10:11:36.426112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:36.426112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:36.426112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:36.426112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:36.426112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:36.426112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:36.426112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:36.426112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:36.426112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:36.426112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:36.426112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:36.426112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:36.426112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:36.426112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:36.426112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:36.427750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:36.427750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:36.427750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:36.427750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:36.427750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:36.427750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:36.427750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:36.427750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:36.427750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:36.427750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:36.427750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:36.427750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:36.427750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:36.427750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:36.427750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:36.427750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:36.429305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:36.429305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:36.429305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:36.429305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:36.429305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:36.429305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:36.429305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:36.429305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:36.429305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:36.429305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:36.429305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 10:11:36.429305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:36.429305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 136/280] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:36.433372 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf815d41-a26a-4115-b060-cc850e4ff4c3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:36.447288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545777e6-4c0c-4cd1-a38d-9b22018441a4 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5a9381a1e44f72982df5a878aac9e4)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:36.451679 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545777e6-4c0c-4cd1-a38d-9b22018441a4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:36.457498 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 145/281] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:36 2022] GET /identity/v3/users/ac5a9381a1e44f72982df5a878aac9e4 => generated 293 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:36.463997 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545777e6-4c0c-4cd1-a38d-9b22018441a4 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:36.546831 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:36.599895 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf815d41-a26a-4115-b060-cc850e4ff4c3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:36.647989 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0585d-5fb3-4096-af86-90f0effdc3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:36.649016 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0585d-5fb3-4096-af86-90f0effdc3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:36.649492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0585d-5fb3-4096-af86-90f0effdc3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:36.649981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0585d-5fb3-4096-af86-90f0effdc3d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:36.650900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0585d-5fb3-4096-af86-90f0effdc3d0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:36.651424 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0585d-5fb3-4096-af86-90f0effdc3d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:36.653148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0585d-5fb3-4096-af86-90f0effdc3d0 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:36.662737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 137/282] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:36.668332 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0585d-5fb3-4096-af86-90f0effdc3d0 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:36.673422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545777e6-4c0c-4cd1-a38d-9b22018441a4 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:36.732877 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b48826-d742-4dc4-810e-656160ad0e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:36.733852 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b48826-d742-4dc4-810e-656160ad0e5a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:36.734266 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b48826-d742-4dc4-810e-656160ad0e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:36.734701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b48826-d742-4dc4-810e-656160ad0e5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:36.735668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b48826-d742-4dc4-810e-656160ad0e5a None admin] RBAC: Adding query filter params (role.id=50575a0d3f4340ee92356ce22ff3e62a, user.id=ac5a9381a1e44f72982df5a878aac9e4, scope.system=all) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:36.735838 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b48826-d742-4dc4-810e-656160ad0e5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:36.737317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b48826-d742-4dc4-810e-656160ad0e5a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:36.747614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 146/283] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Aug 4 10:11:36 2022] GET /identity/v3/role_assignments?user.id=ac5a9381a1e44f72982df5a878aac9e4&scope.system=all&role.id=50575a0d3f4340ee92356ce22ff3e62a => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:36.750738 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbd542-4abc-4116-9212-6e789720743e None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:36.751197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbd542-4abc-4116-9212-6e789720743e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:36.751675 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbd542-4abc-4116-9212-6e789720743e None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:36.756236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 147/284] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:36.758842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:36.764853 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dc68e-5eeb-4ab6-ad6e-69bbb96c2a8f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:36.765320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dc68e-5eeb-4ab6-ad6e-69bbb96c2a8f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:36.765731 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dc68e-5eeb-4ab6-ad6e-69bbb96c2a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:36.795055 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-297dc68e-5eeb-4ab6-ad6e-69bbb96c2a8f None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:36.796945 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-297dc68e-5eeb-4ab6-ad6e-69bbb96c2a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:36.862501 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0585d-5fb3-4096-af86-90f0effdc3d0 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:36.893896 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 148/285] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:36.920362 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dc68e-5eeb-4ab6-ad6e-69bbb96c2a8f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:36.937741 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0607f4-bf82-498e-911d-01e49cd6529d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:36.938826 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0607f4-bf82-498e-911d-01e49cd6529d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:36.939529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0607f4-bf82-498e-911d-01e49cd6529d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:36.939778 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0607f4-bf82-498e-911d-01e49cd6529d None admin] PATH_INFO: `/v3/users/dd5036fd39f54c0fb13b3ef10114b352` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:36.950318 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0607f4-bf82-498e-911d-01e49cd6529d None admin] RBAC: Authorizing `identity:get_user(user_id=dd5036fd39f54c0fb13b3ef10114b352)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:36.953337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0607f4-bf82-498e-911d-01e49cd6529d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:36.959184 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 138/286] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:36 2022] GET /identity/v3/users/dd5036fd39f54c0fb13b3ef10114b352 => generated 297 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:36.966598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0607f4-bf82-498e-911d-01e49cd6529d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:36.973224 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:37.064621 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dc68e-5eeb-4ab6-ad6e-69bbb96c2a8f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:37.107003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f152a-487f-465a-8604-cb8a79989871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:37.108914 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f152a-487f-465a-8604-cb8a79989871 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:37.111266 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f152a-487f-465a-8604-cb8a79989871 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:37.111835 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f152a-487f-465a-8604-cb8a79989871 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:37.136034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f152a-487f-465a-8604-cb8a79989871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:37.149144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-ba4f152a-487f-465a-8604-cb8a79989871 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:37.149144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:37.149144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:37.149144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:37.149144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:37.149144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:37.149144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:37.149144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:37.149144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:37.149144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:37.149144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:37.149144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:37.149144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:37.149144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:37.149144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:37.149144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:37.150078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:37.150078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:37.150078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:37.150078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:37.150078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:37.150078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:37.150078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:37.150078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:37.150078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:37.150078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:37.150078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:37.150078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:37.150078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:37.150078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:37.150078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:37.150078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:37.150845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:37.150845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:37.150845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:37.150845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:37.150845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:37.150845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:37.150845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:37.150845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:37.150845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:37.150845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:37.150845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:37.150845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:37.155785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 149/287] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:37.170513 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f152a-487f-465a-8604-cb8a79989871 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:37.209764 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0607f4-bf82-498e-911d-01e49cd6529d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:37.275913 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:37.276915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:37.314786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f152a-487f-465a-8604-cb8a79989871 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:37.320864 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12000102-9e33-4a6c-a6d8-2ff8c9a0fad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:37.321211 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12000102-9e33-4a6c-a6d8-2ff8c9a0fad8 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:37.321455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12000102-9e33-4a6c-a6d8-2ff8c9a0fad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:37.321724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12000102-9e33-4a6c-a6d8-2ff8c9a0fad8 None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:37.328063 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12000102-9e33-4a6c-a6d8-2ff8c9a0fad8 None admin] RBAC: Authorizing `identity:get_project(project_id=13b307d54e4e48ef84790ab15f5ceb39)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:37.329569 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12000102-9e33-4a6c-a6d8-2ff8c9a0fad8 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:37.331350 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 139/288] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:36 2022] GET /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39 => generated 302 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:37.340221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12000102-9e33-4a6c-a6d8-2ff8c9a0fad8 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:37.389045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfafd1-b81c-438e-9b8a-943e711e22cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:37.389681 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfafd1-b81c-438e-9b8a-943e711e22cf None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:37.389959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfafd1-b81c-438e-9b8a-943e711e22cf None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:37.390233 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfafd1-b81c-438e-9b8a-943e711e22cf None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:37.390953 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfafd1-b81c-438e-9b8a-943e711e22cf None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:37.391256 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfafd1-b81c-438e-9b8a-943e711e22cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:37.392685 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfafd1-b81c-438e-9b8a-943e711e22cf None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:37.417894 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 150/289] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:37.426431 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfafd1-b81c-438e-9b8a-943e711e22cf None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:37.493767 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12000102-9e33-4a6c-a6d8-2ff8c9a0fad8 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:37.546674 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f934467-d33e-408d-a5b4-a8aae0c76081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:37.547361 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f934467-d33e-408d-a5b4-a8aae0c76081 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:37.547639 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f934467-d33e-408d-a5b4-a8aae0c76081 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:37.547913 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f934467-d33e-408d-a5b4-a8aae0c76081 None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39/users/dd5036fd39f54c0fb13b3ef10114b352/roles/439977f47a30404790859f8a0d504997` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:37.553487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f934467-d33e-408d-a5b4-a8aae0c76081 None admin] RBAC: Authorizing `identity:create_grant(project_id=13b307d54e4e48ef84790ab15f5ceb39, user_id=dd5036fd39f54c0fb13b3ef10114b352, role_id=439977f47a30404790859f8a0d504997)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:37.554950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f934467-d33e-408d-a5b4-a8aae0c76081 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:37.618755 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 140/290] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:11:37 2022] PUT /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39/users/dd5036fd39f54c0fb13b3ef10114b352/roles/439977f47a30404790859f8a0d504997 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:11:37.620214 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfafd1-b81c-438e-9b8a-943e711e22cf None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:37.662559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e3d4d-3e4d-4a04-bb2b-3f06ddbc71a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:37.663919 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e3d4d-3e4d-4a04-bb2b-3f06ddbc71a5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:37.664569 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e3d4d-3e4d-4a04-bb2b-3f06ddbc71a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:37.665107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e3d4d-3e4d-4a04-bb2b-3f06ddbc71a5 None admin] PATH_INFO: `/v3/users/4683edfccc8b4b4c8b99266907ff1082` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:37.666854 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e3d4d-3e4d-4a04-bb2b-3f06ddbc71a5 None admin] RBAC: Authorizing `identity:get_user(user_id=4683edfccc8b4b4c8b99266907ff1082)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:37.668761 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e3d4d-3e4d-4a04-bb2b-3f06ddbc71a5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:37.670734 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 151/291] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:37 2022] GET /identity/v3/users/4683edfccc8b4b4c8b99266907ff1082 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:37.677687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f934467-d33e-408d-a5b4-a8aae0c76081 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:37.818120 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:37.941394 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f934467-d33e-408d-a5b4-a8aae0c76081 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:38.022671 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841374df-0040-4f3c-a0f2-e29948845bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:38.023695 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841374df-0040-4f3c-a0f2-e29948845bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:38.024154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841374df-0040-4f3c-a0f2-e29948845bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:38.024616 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841374df-0040-4f3c-a0f2-e29948845bb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:38.148856 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841374df-0040-4f3c-a0f2-e29948845bb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:38.151571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841374df-0040-4f3c-a0f2-e29948845bb3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:38.233726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:38.298331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 141/292] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:38.304087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e3d4d-3e4d-4a04-bb2b-3f06ddbc71a5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:38.325518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:38.444451 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e3d4d-3e4d-4a04-bb2b-3f06ddbc71a5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:38.479437 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6e801-dccc-4904-a0c1-db3c81192b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:38.480145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6e801-dccc-4904-a0c1-db3c81192b85 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:38.480463 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6e801-dccc-4904-a0c1-db3c81192b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:38.480797 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6e801-dccc-4904-a0c1-db3c81192b85 None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:38.481981 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6e801-dccc-4904-a0c1-db3c81192b85 None admin] RBAC: Authorizing `identity:get_project(project_id=13b307d54e4e48ef84790ab15f5ceb39)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:38.483441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6e801-dccc-4904-a0c1-db3c81192b85 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:38.485544 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 152/293] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:38 2022] GET /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:38.491700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841374df-0040-4f3c-a0f2-e29948845bb3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:38.677376 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841374df-0040-4f3c-a0f2-e29948845bb3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:38.746653 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572680d-7827-4168-ab2d-a81f4ae70f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:38.748462 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572680d-7827-4168-ab2d-a81f4ae70f4a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:38.749246 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572680d-7827-4168-ab2d-a81f4ae70f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:38.749983 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572680d-7827-4168-ab2d-a81f4ae70f4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:38.751769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572680d-7827-4168-ab2d-a81f4ae70f4a None admin] RBAC: Adding query filter params (role.id=50575a0d3f4340ee92356ce22ff3e62a, scope.project.id=13b307d54e4e48ef84790ab15f5ceb39, user.id=4683edfccc8b4b4c8b99266907ff1082) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:38.752645 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572680d-7827-4168-ab2d-a81f4ae70f4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:38.756096 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572680d-7827-4168-ab2d-a81f4ae70f4a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:38.767788 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 142/294] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:11:38 2022] GET /identity/v3/role_assignments?user.id=4683edfccc8b4b4c8b99266907ff1082&scope.project.id=13b307d54e4e48ef84790ab15f5ceb39&role.id=50575a0d3f4340ee92356ce22ff3e62a => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:39.292276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c049bf-841a-4fbe-9b14-a2f81891f7c6 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:39.293042 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c049bf-841a-4fbe-9b14-a2f81891f7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:39.293042 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c049bf-841a-4fbe-9b14-a2f81891f7c6 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:39.294429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 153/295] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:11:39.300031 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9a191-db57-4639-97aa-b4d30b249bbc None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:39.301419 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9a191-db57-4639-97aa-b4d30b249bbc None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:39.301419 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9a191-db57-4639-97aa-b4d30b249bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:39.323692 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-bca9a191-db57-4639-97aa-b4d30b249bbc None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:39.325003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-bca9a191-db57-4639-97aa-b4d30b249bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:39.330041 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:39.417556 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 143/296] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:39.444981 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c049bf-841a-4fbe-9b14-a2f81891f7c6 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:39.554658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:39.592720 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c049bf-841a-4fbe-9b14-a2f81891f7c6 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:39.652407 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f57e1-a33a-4186-915c-e713f49afb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:39.653090 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f57e1-a33a-4186-915c-e713f49afb90 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:39.653372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f57e1-a33a-4186-915c-e713f49afb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:39.653656 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f57e1-a33a-4186-915c-e713f49afb90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:39.665525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f57e1-a33a-4186-915c-e713f49afb90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:39.670655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-f88f57e1-a33a-4186-915c-e713f49afb90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:39.670655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:39.670655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:39.670655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:39.670655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:39.670655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:39.670655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:39.670655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:39.670655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:39.670655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:39.670655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:39.670655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:39.670655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:39.670655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:39.670655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:39.670655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:39.671534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:39.671534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:39.671534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:39.671534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:39.671534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:39.671534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:39.671534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:39.671534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:39.671534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:39.671534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:39.671534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:39.671534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:39.671534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:39.671534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:39.671534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:39.671534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:39.672345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:39.672345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:39.672345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:39.672345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:39.672345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:39.672345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:39.672345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:39.672345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:39.672345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:39.672345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:39.672345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:39.672345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:39.676296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 154/297] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:11:39.678819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9a191-db57-4639-97aa-b4d30b249bbc None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:39.790426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9a191-db57-4639-97aa-b4d30b249bbc None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:39.827592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c79f2a-d82c-4415-9477-e41443b59fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:39.828620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c79f2a-d82c-4415-9477-e41443b59fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:39.829096 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c79f2a-d82c-4415-9477-e41443b59fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:39.829564 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c79f2a-d82c-4415-9477-e41443b59fa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:39.830502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c79f2a-d82c-4415-9477-e41443b59fa2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:39.830997 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c79f2a-d82c-4415-9477-e41443b59fa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:39.832716 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c79f2a-d82c-4415-9477-e41443b59fa2 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:39.837054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b673337-a0df-4b3b-9632-d891b0ea8fb0 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:39.837338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b673337-a0df-4b3b-9632-d891b0ea8fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:39.838430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b673337-a0df-4b3b-9632-d891b0ea8fb0 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:39.840337 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 155/298] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:39.843123 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 144/299] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:39.846592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacad632-bf09-4799-8bea-132c1f3c0a33 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:39.847609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacad632-bf09-4799-8bea-132c1f3c0a33 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:39.848099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacad632-bf09-4799-8bea-132c1f3c0a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:39.852502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c79f2a-d82c-4415-9477-e41443b59fa2 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:39.855477 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:39.870728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-bacad632-bf09-4799-8bea-132c1f3c0a33 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:39.872124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-bacad632-bf09-4799-8bea-132c1f3c0a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:39.957811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 156/300] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:39.957811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38fe53-af0d-410a-8da3-01e2bc9cd780 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:39.957811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38fe53-af0d-410a-8da3-01e2bc9cd780 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:39.957811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38fe53-af0d-410a-8da3-01e2bc9cd780 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:39.957811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 157/301] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:39.962143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aadb6b-1e8b-4eb5-b2c4-925c193930f6 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:39.962436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aadb6b-1e8b-4eb5-b2c4-925c193930f6 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:39.962715 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aadb6b-1e8b-4eb5-b2c4-925c193930f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:39.968669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c79f2a-d82c-4415-9477-e41443b59fa2 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:39.981527 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-70aadb6b-1e8b-4eb5-b2c4-925c193930f6 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:39.983160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-70aadb6b-1e8b-4eb5-b2c4-925c193930f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:40.014465 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52def04-5746-4e90-9dba-f36c2d0cc4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:40.015129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52def04-5746-4e90-9dba-f36c2d0cc4ea None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:40.015391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52def04-5746-4e90-9dba-f36c2d0cc4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:40.015663 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52def04-5746-4e90-9dba-f36c2d0cc4ea None admin] PATH_INFO: `/v3/users/ac5a9381a1e44f72982df5a878aac9e4` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:40.016912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52def04-5746-4e90-9dba-f36c2d0cc4ea None admin] RBAC: Authorizing `identity:get_user(user_id=ac5a9381a1e44f72982df5a878aac9e4)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:40.018386 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52def04-5746-4e90-9dba-f36c2d0cc4ea None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:40.020302 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 145/302] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:39 2022] GET /identity/v3/users/ac5a9381a1e44f72982df5a878aac9e4 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:40.021022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52def04-5746-4e90-9dba-f36c2d0cc4ea None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:40.062393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 158/303] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:40.063238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aadb6b-1e8b-4eb5-b2c4-925c193930f6 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:40.076523 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:40.112623 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:40.146963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52def04-5746-4e90-9dba-f36c2d0cc4ea None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:40.174718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aadb6b-1e8b-4eb5-b2c4-925c193930f6 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:40.190391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161904fb-1903-4c0a-8276-095a1cfde6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:40.191583 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161904fb-1903-4c0a-8276-095a1cfde6cc None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:40.192134 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161904fb-1903-4c0a-8276-095a1cfde6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:40.192661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161904fb-1903-4c0a-8276-095a1cfde6cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:40.205633 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161904fb-1903-4c0a-8276-095a1cfde6cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:40.211665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-161904fb-1903-4c0a-8276-095a1cfde6cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 10:11:40.211665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:40.211665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:40.211665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:40.211665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:40.211665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:40.211665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:40.211665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:40.211665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:40.211665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:40.211665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:40.211665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:40.211665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:40.211665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:40.211665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:40.211665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:40.212561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:40.212561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:40.212561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:40.212561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:40.212561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:40.212561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:40.212561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:40.212561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:40.212561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:40.212561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:40.212561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:40.212561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:40.212561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:40.212561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:40.212561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:40.212561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:40.213337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:40.213337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:40.213337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:40.213337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:40.213337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:40.213337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:40.213337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:40.213337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:40.213337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:40.213337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:40.213337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 10:11:40.213337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:40.213921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed97a5-5152-48e1-81fa-25caa39fc669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:40.214015 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 146/304] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:40.214081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed97a5-5152-48e1-81fa-25caa39fc669 None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:40.214081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed97a5-5152-48e1-81fa-25caa39fc669 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:40.214194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161904fb-1903-4c0a-8276-095a1cfde6cc None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:40.214265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed97a5-5152-48e1-81fa-25caa39fc669 None admin] PATH_INFO: `/v3/system/users/ac5a9381a1e44f72982df5a878aac9e4/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:40.215727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed97a5-5152-48e1-81fa-25caa39fc669 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ac5a9381a1e44f72982df5a878aac9e4, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:40.217583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed97a5-5152-48e1-81fa-25caa39fc669 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:40.230278 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 159/305] 10.222.0.48 () {58 vars in 1334 bytes} [Thu Aug 4 10:11:40 2022] PUT /identity/v3/system/users/ac5a9381a1e44f72982df5a878aac9e4/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:11:40.237234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed97a5-5152-48e1-81fa-25caa39fc669 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:40.353221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161904fb-1903-4c0a-8276-095a1cfde6cc None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:40.378776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:40.406010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:40.421669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc3fb8-b63f-4af9-a4dd-f4d9fcb77878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:40.423305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3fb8-b63f-4af9-a4dd-f4d9fcb77878 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:40.424210 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3fb8-b63f-4af9-a4dd-f4d9fcb77878 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:40.425064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3fb8-b63f-4af9-a4dd-f4d9fcb77878 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:40.427308 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc3fb8-b63f-4af9-a4dd-f4d9fcb77878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:40.430320 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc3fb8-b63f-4af9-a4dd-f4d9fcb77878 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:40.432434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 147/306] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:11:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:40.432607 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed97a5-5152-48e1-81fa-25caa39fc669 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:40.439233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc3fb8-b63f-4af9-a4dd-f4d9fcb77878 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:40.475870 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4822d7-a0f7-4887-bd80-7699753742e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:40.476549 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4822d7-a0f7-4887-bd80-7699753742e5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:40.476886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4822d7-a0f7-4887-bd80-7699753742e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:40.477163 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4822d7-a0f7-4887-bd80-7699753742e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:40.477942 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4822d7-a0f7-4887-bd80-7699753742e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:40.478257 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4822d7-a0f7-4887-bd80-7699753742e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:40.479726 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4822d7-a0f7-4887-bd80-7699753742e5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:40.493852 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 160/307] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:40.494885 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4822d7-a0f7-4887-bd80-7699753742e5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:40.574851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc3fb8-b63f-4af9-a4dd-f4d9fcb77878 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:40.616399 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79972ea3-e16d-4e56-88c9-7bdfe3267a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:40.617202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79972ea3-e16d-4e56-88c9-7bdfe3267a12 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:40.617493 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79972ea3-e16d-4e56-88c9-7bdfe3267a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:40.617770 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79972ea3-e16d-4e56-88c9-7bdfe3267a12 None admin] PATH_INFO: `/v3/groups` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:40.618451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79972ea3-e16d-4e56-88c9-7bdfe3267a12 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:40.619915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79972ea3-e16d-4e56-88c9-7bdfe3267a12 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:40.644912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 148/308] 10.222.0.48 () {60 vars in 1134 bytes} [Thu Aug 4 10:11:40 2022] POST /identity/v3/groups => generated 229 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:11:40.646389 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8901904-bcba-4dfe-b635-279c6ef86375 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:40.646701 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8901904-bcba-4dfe-b635-279c6ef86375 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:40.647011 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8901904-bcba-4dfe-b635-279c6ef86375 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:40.647108 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4822d7-a0f7-4887-bd80-7699753742e5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:40.652455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 149/309] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:40.655128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32528ab6-8e20-4915-8960-405c28c18784 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:40.655128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32528ab6-8e20-4915-8960-405c28c18784 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:40.655128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32528ab6-8e20-4915-8960-405c28c18784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:40.678552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-32528ab6-8e20-4915-8960-405c28c18784 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:40.679918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-32528ab6-8e20-4915-8960-405c28c18784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:40.691492 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:40.704978 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a96895-caf0-4df8-b887-0418eeb932c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:40.706284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a96895-caf0-4df8-b887-0418eeb932c3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:40.707418 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a96895-caf0-4df8-b887-0418eeb932c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:40.707737 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a96895-caf0-4df8-b887-0418eeb932c3 None admin] PATH_INFO: `/v3/users/a6b3888e47c445f9918998021693754d` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:40.728765 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a96895-caf0-4df8-b887-0418eeb932c3 None admin] RBAC: Authorizing `identity:get_user(user_id=a6b3888e47c445f9918998021693754d)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:40.730309 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a96895-caf0-4df8-b887-0418eeb932c3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:40.736388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 161/310] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:40 2022] GET /identity/v3/users/a6b3888e47c445f9918998021693754d => generated 293 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:40.741918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a96895-caf0-4df8-b887-0418eeb932c3 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:40.764537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:40.797226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 150/311] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:40.819417 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32528ab6-8e20-4915-8960-405c28c18784 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:40.895531 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a96895-caf0-4df8-b887-0418eeb932c3 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:40.942932 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a6930-f79c-4af8-ba34-46f98586fc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:40.943931 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a6930-f79c-4af8-ba34-46f98586fc11 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:40.944576 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a6930-f79c-4af8-ba34-46f98586fc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:40.944925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a6930-f79c-4af8-ba34-46f98586fc11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:40.945807 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a6930-f79c-4af8-ba34-46f98586fc11 None admin] RBAC: Adding query filter params (role.id=439977f47a30404790859f8a0d504997, user.id=a6b3888e47c445f9918998021693754d, scope.system=all) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:40.946212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a6930-f79c-4af8-ba34-46f98586fc11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:40.947879 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a6930-f79c-4af8-ba34-46f98586fc11 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:40.954382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 162/312] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Aug 4 10:11:40 2022] GET /identity/v3/role_assignments?user.id=a6b3888e47c445f9918998021693754d&scope.system=all&role.id=439977f47a30404790859f8a0d504997 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:40.969850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32528ab6-8e20-4915-8960-405c28c18784 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:41.012883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcca472-ba79-4354-839f-add2386a4c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:41.013903 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcca472-ba79-4354-839f-add2386a4c17 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:41.014383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcca472-ba79-4354-839f-add2386a4c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:41.014872 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcca472-ba79-4354-839f-add2386a4c17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:41.029838 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcca472-ba79-4354-839f-add2386a4c17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:41.036739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-6dcca472-ba79-4354-839f-add2386a4c17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 10:11:41.036739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:41.036739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:41.036739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:41.036739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:41.036739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:41.036739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:41.036739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:41.036739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:41.036739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:41.036739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:41.036739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:41.036739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:41.036739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:41.036739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:41.036739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:41.037851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:41.037851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:41.037851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:41.037851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:41.037851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:41.037851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:41.037851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:41.037851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:41.037851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:41.037851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:41.037851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:41.037851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:41.037851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:41.037851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:41.037851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:41.037851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:41.038812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:41.038812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:41.038812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:41.038812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:41.038812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:41.038812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:41.038812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:41.038812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:41.038812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:41.038812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:41.038812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 10:11:41.038812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:41.041011 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 151/313] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:11:41.047644 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a6930-f79c-4af8-ba34-46f98586fc11 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:41.110977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:41.168232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a6930-f79c-4af8-ba34-46f98586fc11 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:41.204490 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cc455-876b-4926-961f-57333e6e2651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:41.205176 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cc455-876b-4926-961f-57333e6e2651 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:41.205515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cc455-876b-4926-961f-57333e6e2651 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:41.205804 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cc455-876b-4926-961f-57333e6e2651 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:41.207106 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cc455-876b-4926-961f-57333e6e2651 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:41.207421 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cc455-876b-4926-961f-57333e6e2651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:41.208865 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cc455-876b-4926-961f-57333e6e2651 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:41.217932 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 163/314] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:41.225539 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcca472-ba79-4354-839f-add2386a4c17 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:41.280189 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:41.337561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcca472-ba79-4354-839f-add2386a4c17 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:41.373701 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488e4e0-09ed-4986-8007-43cceaecdf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:41.374429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488e4e0-09ed-4986-8007-43cceaecdf60 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:41.374712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488e4e0-09ed-4986-8007-43cceaecdf60 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:41.374994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488e4e0-09ed-4986-8007-43cceaecdf60 None admin] PATH_INFO: `/v3/users/dd5036fd39f54c0fb13b3ef10114b352` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:41.376256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488e4e0-09ed-4986-8007-43cceaecdf60 None admin] RBAC: Authorizing `identity:get_user(user_id=dd5036fd39f54c0fb13b3ef10114b352)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:41.377722 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488e4e0-09ed-4986-8007-43cceaecdf60 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:41.380084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 152/315] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:41 2022] GET /identity/v3/users/dd5036fd39f54c0fb13b3ef10114b352 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:41.385626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cc455-876b-4926-961f-57333e6e2651 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:41.497734 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cc455-876b-4926-961f-57333e6e2651 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:41.512243 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:41.542893 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0b6c5-7d2b-4725-bba5-bbd4342b7a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:41.543528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0b6c5-7d2b-4725-bba5-bbd4342b7a3c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:41.543809 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0b6c5-7d2b-4725-bba5-bbd4342b7a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:41.544091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0b6c5-7d2b-4725-bba5-bbd4342b7a3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:41.616335 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0b6c5-7d2b-4725-bba5-bbd4342b7a3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:41.622615 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0b6c5-7d2b-4725-bba5-bbd4342b7a3c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:41.731224 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 164/316] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:41.736918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488e4e0-09ed-4986-8007-43cceaecdf60 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:41.844973 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488e4e0-09ed-4986-8007-43cceaecdf60 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:41.865504 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:41.887419 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2d323-874a-4c5b-95f1-0f3220a7d9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:41.888098 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2d323-874a-4c5b-95f1-0f3220a7d9ab None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:41.888415 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2d323-874a-4c5b-95f1-0f3220a7d9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:41.888696 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2d323-874a-4c5b-95f1-0f3220a7d9ab None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:41.890009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2d323-874a-4c5b-95f1-0f3220a7d9ab None admin] RBAC: Authorizing `identity:get_project(project_id=13b307d54e4e48ef84790ab15f5ceb39)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:41.891524 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2d323-874a-4c5b-95f1-0f3220a7d9ab None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:41.893367 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 153/317] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:41 2022] GET /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:41.899557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0b6c5-7d2b-4725-bba5-bbd4342b7a3c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:41.916206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:42.012522 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0b6c5-7d2b-4725-bba5-bbd4342b7a3c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:42.049219 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d6e1d-7258-450b-99d8-10639ef65207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:42.049842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d6e1d-7258-450b-99d8-10639ef65207 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:42.050159 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d6e1d-7258-450b-99d8-10639ef65207 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:42.050986 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d6e1d-7258-450b-99d8-10639ef65207 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:42.051809 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d6e1d-7258-450b-99d8-10639ef65207 None admin] RBAC: Adding query filter params (role.id=439977f47a30404790859f8a0d504997, scope.project.id=13b307d54e4e48ef84790ab15f5ceb39, user.id=dd5036fd39f54c0fb13b3ef10114b352) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:42.052097 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d6e1d-7258-450b-99d8-10639ef65207 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:42.053563 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d6e1d-7258-450b-99d8-10639ef65207 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:42.060043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 165/318] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:11:41 2022] GET /identity/v3/role_assignments?user.id=dd5036fd39f54c0fb13b3ef10114b352&scope.project.id=13b307d54e4e48ef84790ab15f5ceb39&role.id=439977f47a30404790859f8a0d504997 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:42.344919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e49f9-90fc-4379-aa3d-dc9ca384bcb6 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:42.345289 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e49f9-90fc-4379-aa3d-dc9ca384bcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:42.345488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e49f9-90fc-4379-aa3d-dc9ca384bcb6 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:42.347641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 154/319] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:42.352766 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dab790-c789-4c18-a013-8308aaa7c035 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:42.353061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dab790-c789-4c18-a013-8308aaa7c035 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:42.353344 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dab790-c789-4c18-a013-8308aaa7c035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:42.372100 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-92dab790-c789-4c18-a013-8308aaa7c035 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:42.373327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-92dab790-c789-4c18-a013-8308aaa7c035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:42.443417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 166/320] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:42.466404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e49f9-90fc-4379-aa3d-dc9ca384bcb6 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:42.576179 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e49f9-90fc-4379-aa3d-dc9ca384bcb6 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:42.611135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f7da0-f5ba-461c-a706-48cbad55d76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:42.611708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f7da0-f5ba-461c-a706-48cbad55d76d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:42.611987 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f7da0-f5ba-461c-a706-48cbad55d76d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:42.612291 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f7da0-f5ba-461c-a706-48cbad55d76d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:42.629538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f7da0-f5ba-461c-a706-48cbad55d76d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:42.634506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-d23f7da0-f5ba-461c-a706-48cbad55d76d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:42.634506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:42.634506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:42.634506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:42.634506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:42.634506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:42.634506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:42.634506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:42.634506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:42.634506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:42.634506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:42.634506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:42.634506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:42.634506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:42.634506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:42.634506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:42.635480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:42.635480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:42.635480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:42.635480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:42.635480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:42.635480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:42.635480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:42.635480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:42.635480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:42.635480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:42.635480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:42.635480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:42.635480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:42.635480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:42.635480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:42.635480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:42.636705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:42.636705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:42.636705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:42.636705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:42.636705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:42.636705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:42.636705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:42.636705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:42.636705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:42.636705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:42.636705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:42.636705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:42.640262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 155/321] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:42.641890 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dab790-c789-4c18-a013-8308aaa7c035 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:42.650379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:42.746713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dab790-c789-4c18-a013-8308aaa7c035 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:42.781295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762b372-2cb7-4435-9e6a-5113b5e70fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:42.781915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762b372-2cb7-4435-9e6a-5113b5e70fbb None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:42.782195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762b372-2cb7-4435-9e6a-5113b5e70fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:42.782466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762b372-2cb7-4435-9e6a-5113b5e70fbb None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:42.783173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762b372-2cb7-4435-9e6a-5113b5e70fbb None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:42.783475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762b372-2cb7-4435-9e6a-5113b5e70fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:42.785534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762b372-2cb7-4435-9e6a-5113b5e70fbb None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:42.798628 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 167/322] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:42.799922 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f7da0-f5ba-461c-a706-48cbad55d76d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:42.849538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:42.861830 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79039b6b-2e68-45f3-b436-da1cc90da667 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:42.862084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79039b6b-2e68-45f3-b436-da1cc90da667 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:42.862328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79039b6b-2e68-45f3-b436-da1cc90da667 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:42.864682 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 168/323] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:42.870065 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1483a26-d26e-49e1-a281-aa548343fd53 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:42.870581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1483a26-d26e-49e1-a281-aa548343fd53 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:42.871068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1483a26-d26e-49e1-a281-aa548343fd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:42.893738 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b1483a26-d26e-49e1-a281-aa548343fd53 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:42.895671 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b1483a26-d26e-49e1-a281-aa548343fd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:42.910233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f7da0-f5ba-461c-a706-48cbad55d76d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:42.945741 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45295e2-1d60-4e95-aa18-c056781edd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:42.946392 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45295e2-1d60-4e95-aa18-c056781edd06 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:42.946677 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45295e2-1d60-4e95-aa18-c056781edd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:42.946958 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45295e2-1d60-4e95-aa18-c056781edd06 None admin] PATH_INFO: `/v3/users/ac5a9381a1e44f72982df5a878aac9e4` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:42.948159 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45295e2-1d60-4e95-aa18-c056781edd06 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5a9381a1e44f72982df5a878aac9e4)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:42.949649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45295e2-1d60-4e95-aa18-c056781edd06 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:42.951359 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 156/324] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:42 2022] GET /identity/v3/users/ac5a9381a1e44f72982df5a878aac9e4 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:42.957202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45295e2-1d60-4e95-aa18-c056781edd06 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:42.978235 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:42.992307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 169/325] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:43.008145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1483a26-d26e-49e1-a281-aa548343fd53 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:43.063598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45295e2-1d60-4e95-aa18-c056781edd06 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:43.077870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:43.101642 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c56d7-d0e2-4f12-9dde-3131590cd7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:43.102271 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c56d7-d0e2-4f12-9dde-3131590cd7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:43.102555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c56d7-d0e2-4f12-9dde-3131590cd7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:43.103188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c56d7-d0e2-4f12-9dde-3131590cd7b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:43.103634 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c56d7-d0e2-4f12-9dde-3131590cd7b4 None admin] RBAC: Adding query filter params (role.id=50575a0d3f4340ee92356ce22ff3e62a, user.id=ac5a9381a1e44f72982df5a878aac9e4, scope.system=all) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:43.103947 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c56d7-d0e2-4f12-9dde-3131590cd7b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:43.105453 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c56d7-d0e2-4f12-9dde-3131590cd7b4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:43.115843 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1483a26-d26e-49e1-a281-aa548343fd53 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:43.118247 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 157/326] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Aug 4 10:11:42 2022] GET /identity/v3/role_assignments?user.id=ac5a9381a1e44f72982df5a878aac9e4&scope.system=all&role.id=50575a0d3f4340ee92356ce22ff3e62a => generated 510 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:43.119452 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c618e5-ee0f-4d14-9326-55f18ad4eadd None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:43.119743 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c618e5-ee0f-4d14-9326-55f18ad4eadd None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:43.120024 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c618e5-ee0f-4d14-9326-55f18ad4eadd None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:43.121299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 158/327] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:43.127092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51604a57-a9e5-422b-a65d-22bcdbcbc3e1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:43.127383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51604a57-a9e5-422b-a65d-22bcdbcbc3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:43.127669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51604a57-a9e5-422b-a65d-22bcdbcbc3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:43.147461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-51604a57-a9e5-422b-a65d-22bcdbcbc3e1 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:43.148736 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-51604a57-a9e5-422b-a65d-22bcdbcbc3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:43.159924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f4f51-c9a5-4e81-ab35-5968a0b267de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:43.161107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f4f51-c9a5-4e81-ab35-5968a0b267de None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:43.161107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f4f51-c9a5-4e81-ab35-5968a0b267de None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:43.161299 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f4f51-c9a5-4e81-ab35-5968a0b267de None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:43.162479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f4f51-c9a5-4e81-ab35-5968a0b267de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:43.164019 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f4f51-c9a5-4e81-ab35-5968a0b267de None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:43.168729 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 170/328] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:11:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:43.172509 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f4f51-c9a5-4e81-ab35-5968a0b267de None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:43.230589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 159/329] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:43.250700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:43.253572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51604a57-a9e5-422b-a65d-22bcdbcbc3e1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:43.293357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f4f51-c9a5-4e81-ab35-5968a0b267de None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:43.337236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284377e7-5f3e-4575-a991-142c5e63ca3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:43.337862 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284377e7-5f3e-4575-a991-142c5e63ca3b None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:43.338147 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284377e7-5f3e-4575-a991-142c5e63ca3b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:43.338422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284377e7-5f3e-4575-a991-142c5e63ca3b None admin] PATH_INFO: `/v3/groups` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:43.339097 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284377e7-5f3e-4575-a991-142c5e63ca3b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:43.340571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284377e7-5f3e-4575-a991-142c5e63ca3b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:43.356687 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 171/330] 10.222.0.48 () {60 vars in 1134 bytes} [Thu Aug 4 10:11:43 2022] POST /identity/v3/groups => generated 226 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:11:43.370044 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:43.373157 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51604a57-a9e5-422b-a65d-22bcdbcbc3e1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:43.412740 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc4677-e7ca-4681-a985-397d78ee6532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:43.413421 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc4677-e7ca-4681-a985-397d78ee6532 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:43.413706 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc4677-e7ca-4681-a985-397d78ee6532 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:43.413984 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc4677-e7ca-4681-a985-397d78ee6532 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:43.425757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc4677-e7ca-4681-a985-397d78ee6532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:43.430937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-d5bc4677-e7ca-4681-a985-397d78ee6532 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 10:11:43.430937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:43.430937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:43.430937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:43.430937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:43.430937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:43.430937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:43.430937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:43.430937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:43.430937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:43.430937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:43.430937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:43.430937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:43.430937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:43.430937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:43.430937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:43.432007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:43.432007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:43.432007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:43.432007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:43.432007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:43.432007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:43.432007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:43.432007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:43.432007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:43.432007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:43.432007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:43.432007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:43.432007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:43.432007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:43.432007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:43.432007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:43.433092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:43.433092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:43.433092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:43.433092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:43.433092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:43.433092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:43.433092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:43.433092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:43.433092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:43.433092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:43.433092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 10:11:43.433092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:43.433092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 160/331] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:43.438384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284377e7-5f3e-4575-a991-142c5e63ca3b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:43.542402 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284377e7-5f3e-4575-a991-142c5e63ca3b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:43.569644 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:43.579632 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe8fe3-5ac4-4dc1-a42e-1ccfc04c8ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:43.580346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe8fe3-5ac4-4dc1-a42e-1ccfc04c8ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:43.580641 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe8fe3-5ac4-4dc1-a42e-1ccfc04c8ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:43.580920 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe8fe3-5ac4-4dc1-a42e-1ccfc04c8ad1 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:43.582201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe8fe3-5ac4-4dc1-a42e-1ccfc04c8ad1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:43.582505 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe8fe3-5ac4-4dc1-a42e-1ccfc04c8ad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:43.583890 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe8fe3-5ac4-4dc1-a42e-1ccfc04c8ad1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:43.592539 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 172/332] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:43.598400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc4677-e7ca-4681-a985-397d78ee6532 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:43.715276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc4677-e7ca-4681-a985-397d78ee6532 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:43.756611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1406a62-93bb-4b52-8519-61d0e041fcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:43.757275 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1406a62-93bb-4b52-8519-61d0e041fcad None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:43.757552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1406a62-93bb-4b52-8519-61d0e041fcad None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:43.757829 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1406a62-93bb-4b52-8519-61d0e041fcad None admin] PATH_INFO: `/v3/users/a6b3888e47c445f9918998021693754d` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:43.759071 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1406a62-93bb-4b52-8519-61d0e041fcad None admin] RBAC: Authorizing `identity:get_user(user_id=a6b3888e47c445f9918998021693754d)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:43.760553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1406a62-93bb-4b52-8519-61d0e041fcad None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:43.762530 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 161/333] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:43 2022] GET /identity/v3/users/a6b3888e47c445f9918998021693754d => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:43.767713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe8fe3-5ac4-4dc1-a42e-1ccfc04c8ad1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:43.882088 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe8fe3-5ac4-4dc1-a42e-1ccfc04c8ad1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:43.923367 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77f377-8147-4be8-a669-5af0b8ecb48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:43.924044 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77f377-8147-4be8-a669-5af0b8ecb48e None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:43.924359 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77f377-8147-4be8-a669-5af0b8ecb48e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:43.924641 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77f377-8147-4be8-a669-5af0b8ecb48e None admin] PATH_INFO: `/v3/system/users/a6b3888e47c445f9918998021693754d/roles/439977f47a30404790859f8a0d504997` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:43.927168 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77f377-8147-4be8-a669-5af0b8ecb48e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a6b3888e47c445f9918998021693754d, role_id=439977f47a30404790859f8a0d504997)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:43.928622 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77f377-8147-4be8-a669-5af0b8ecb48e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:43.937998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 173/334] 10.222.0.48 () {58 vars in 1334 bytes} [Thu Aug 4 10:11:43 2022] PUT /identity/v3/system/users/a6b3888e47c445f9918998021693754d/roles/439977f47a30404790859f8a0d504997 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:11:45.651148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bca14-1f60-40a6-a416-1054aba27e49 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:45.652094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bca14-1f60-40a6-a416-1054aba27e49 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:45.652612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bca14-1f60-40a6-a416-1054aba27e49 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:45.654466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 162/335] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:45.659675 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c9335-9624-420b-851e-3c70643731ad None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:45.660246 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c9335-9624-420b-851e-3c70643731ad None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:45.660246 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c9335-9624-420b-851e-3c70643731ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:45.689249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e33c9335-9624-420b-851e-3c70643731ad None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:45.690446 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e33c9335-9624-420b-851e-3c70643731ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:45.755330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:45.781470 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 174/336] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:45.829818 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bca14-1f60-40a6-a416-1054aba27e49 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:45.869868 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:45.960863 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bca14-1f60-40a6-a416-1054aba27e49 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:46.003647 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27c7af-5390-4fbd-b130-c68c518feabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:46.004768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27c7af-5390-4fbd-b130-c68c518feabc None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:46.005266 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27c7af-5390-4fbd-b130-c68c518feabc None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:46.005753 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27c7af-5390-4fbd-b130-c68c518feabc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:46.017072 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27c7af-5390-4fbd-b130-c68c518feabc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:46.022849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-ca27c7af-5390-4fbd-b130-c68c518feabc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:46.022849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:46.022849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:46.022849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:46.022849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:46.022849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:46.022849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:46.022849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:46.022849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:46.022849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:46.022849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:46.022849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:46.022849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:46.022849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:46.022849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:46.022849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:46.023711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:46.023711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:46.023711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:46.023711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:46.023711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:46.023711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:46.023711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:46.023711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:46.023711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:46.023711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:46.023711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:46.023711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:46.023711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:46.023711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:46.023711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:46.023711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:46.024518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:46.024518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:46.024518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:46.024518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:46.024518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:46.024518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:46.024518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:46.024518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:46.024518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:46.024518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:46.024518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:46.024518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:46.027186 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 163/337] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:46.033328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c9335-9624-420b-851e-3c70643731ad None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:46.173187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c9335-9624-420b-851e-3c70643731ad None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:46.218190 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595be719-d406-47e6-b6ce-bcfd76164f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:46.218748 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595be719-d406-47e6-b6ce-bcfd76164f6f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:46.219029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595be719-d406-47e6-b6ce-bcfd76164f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:46.219304 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595be719-d406-47e6-b6ce-bcfd76164f6f None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:46.220020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595be719-d406-47e6-b6ce-bcfd76164f6f None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:46.220357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595be719-d406-47e6-b6ce-bcfd76164f6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:46.222230 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595be719-d406-47e6-b6ce-bcfd76164f6f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:46.231639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 175/338] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:46.237065 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27c7af-5390-4fbd-b130-c68c518feabc None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:46.330629 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d43ec-c963-42ba-87e6-b85c4a703dfb None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:46.330944 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d43ec-c963-42ba-87e6-b85c4a703dfb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:46.331749 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d43ec-c963-42ba-87e6-b85c4a703dfb None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:46.333150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 176/339] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:46.341156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776ad4d-6641-4594-b03e-75454f7a268b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:46.341444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776ad4d-6641-4594-b03e-75454f7a268b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:46.341726 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776ad4d-6641-4594-b03e-75454f7a268b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:46.360755 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:46.376282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2776ad4d-6641-4594-b03e-75454f7a268b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:46.376826 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27c7af-5390-4fbd-b130-c68c518feabc None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:46.377478 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2776ad4d-6641-4594-b03e-75454f7a268b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:46.416216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044a4df-69f6-4d3d-bdd1-5e90637d8788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:46.417226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044a4df-69f6-4d3d-bdd1-5e90637d8788 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:46.417706 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044a4df-69f6-4d3d-bdd1-5e90637d8788 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:46.418176 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044a4df-69f6-4d3d-bdd1-5e90637d8788 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:46.464671 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:46.523058 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 177/340] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:46.524278 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97bbb5-9f6e-438f-b3ca-030c74b60a81 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:46.524565 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97bbb5-9f6e-438f-b3ca-030c74b60a81 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:46.524839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97bbb5-9f6e-438f-b3ca-030c74b60a81 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:46.526093 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 178/341] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:46.549943 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67dad9-ff7c-45e7-a7d5-1d4081ff581c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:46.551003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67dad9-ff7c-45e7-a7d5-1d4081ff581c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:46.551292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67dad9-ff7c-45e7-a7d5-1d4081ff581c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:46.570222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044a4df-69f6-4d3d-bdd1-5e90637d8788 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:46.571692 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044a4df-69f6-4d3d-bdd1-5e90637d8788 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:46.587103 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6a67dad9-ff7c-45e7-a7d5-1d4081ff581c None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:46.588318 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6a67dad9-ff7c-45e7-a7d5-1d4081ff581c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:46.720938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:46.737144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 179/342] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:46.738093 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67dad9-ff7c-45e7-a7d5-1d4081ff581c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:46.755668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 164/343] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:46.761993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044a4df-69f6-4d3d-bdd1-5e90637d8788 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:46.898068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67dad9-ff7c-45e7-a7d5-1d4081ff581c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:46.900469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:46.940003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6aea2-dc79-4207-ba63-94644742cfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:46.941385 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6aea2-dc79-4207-ba63-94644742cfba None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:46.941675 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6aea2-dc79-4207-ba63-94644742cfba None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:46.941953 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6aea2-dc79-4207-ba63-94644742cfba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:46.954040 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6aea2-dc79-4207-ba63-94644742cfba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:46.959426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-20d6aea2-dc79-4207-ba63-94644742cfba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:46.959426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:46.959426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:46.959426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:46.959426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:46.959426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:46.959426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:46.959426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:46.959426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:46.959426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:46.959426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:46.959426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:46.959426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:46.959426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:46.959426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:46.959426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:46.960327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:46.960327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:46.960327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:46.960327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:46.960327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:46.960327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:46.960327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:46.960327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:46.960327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:46.960327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:46.960327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:46.960327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:46.960327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:46.960327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:46.960327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:46.960327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:46.961096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:46.961096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:46.961096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:46.961096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:46.961096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:46.961096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:46.961096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:46.961096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:46.961096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:46.961096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:46.961096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:46.961096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:46.961096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 180/344] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:11:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:46.962506 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6aea2-dc79-4207-ba63-94644742cfba None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:46.970381 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044a4df-69f6-4d3d-bdd1-5e90637d8788 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:47.059233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6689c-ea11-4340-9387-5827beead8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:47.059900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6689c-ea11-4340-9387-5827beead8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:47.060194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6689c-ea11-4340-9387-5827beead8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:47.060504 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6689c-ea11-4340-9387-5827beead8d3 None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:47.065096 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6689c-ea11-4340-9387-5827beead8d3 None admin] RBAC: Authorizing `identity:get_project(project_id=8c7f15d3ce55460993f520e6f8838a8a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:47.067180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6689c-ea11-4340-9387-5827beead8d3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:47.071306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 165/345] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:46 2022] GET /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:47.072119 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6689c-ea11-4340-9387-5827beead8d3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:47.117651 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6aea2-dc79-4207-ba63-94644742cfba None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:47.162441 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:47.175821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dfddf-f333-4967-9e45-8f66fc1776df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:47.176616 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dfddf-f333-4967-9e45-8f66fc1776df None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:47.176916 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dfddf-f333-4967-9e45-8f66fc1776df None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:47.177179 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dfddf-f333-4967-9e45-8f66fc1776df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:47.197421 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576dfddf-f333-4967-9e45-8f66fc1776df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:47.203187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-576dfddf-f333-4967-9e45-8f66fc1776df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:47.203187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:47.203187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:47.203187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:47.203187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:47.203187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:47.203187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:47.203187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:47.203187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:47.203187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:47.203187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:47.203187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:47.203187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:47.203187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:47.203187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:47.203187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:47.204054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:47.204054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:47.204054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:47.204054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:47.204054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:47.204054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:47.204054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:47.204054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:47.204054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:47.204054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:47.204054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:47.204054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:47.204054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:47.204054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:47.204054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:47.204054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:47.204895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:47.204895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:47.204895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:47.204895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:47.204895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:47.204895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:47.204895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:47.204895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:47.204895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:47.204895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:47.204895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:47.204895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:47.207215 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 181/346] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:47.208029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dfddf-f333-4967-9e45-8f66fc1776df None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:47.221611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6689c-ea11-4340-9387-5827beead8d3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:47.236649 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:47.265288 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5fe92-d522-4629-ac70-e9ec985c7865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:47.265979 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5fe92-d522-4629-ac70-e9ec985c7865 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:47.266280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5fe92-d522-4629-ac70-e9ec985c7865 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:47.266669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5fe92-d522-4629-ac70-e9ec985c7865 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:47.267390 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5fe92-d522-4629-ac70-e9ec985c7865 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:47.267699 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5fe92-d522-4629-ac70-e9ec985c7865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:47.269662 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5fe92-d522-4629-ac70-e9ec985c7865 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:47.280856 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 166/347] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:11:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:47.282212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279d682-3697-42f8-9a84-40ad2ff875a9 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:47.282506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279d682-3697-42f8-9a84-40ad2ff875a9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:47.282785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279d682-3697-42f8-9a84-40ad2ff875a9 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:47.284335 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 167/348] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:47.285717 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279d682-3697-42f8-9a84-40ad2ff875a9 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:47.326007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dfddf-f333-4967-9e45-8f66fc1776df None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:47.373168 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78539244-7499-4acf-bd89-3d81e67717dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:47.374213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78539244-7499-4acf-bd89-3d81e67717dd None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:47.374711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78539244-7499-4acf-bd89-3d81e67717dd None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:47.375235 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78539244-7499-4acf-bd89-3d81e67717dd None admin] PATH_INFO: `/v3/groups/31431e6befa84fe1a76b88ff2f303c50` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:47.382356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78539244-7499-4acf-bd89-3d81e67717dd None admin] RBAC: Authorizing `identity:get_group(group_id=31431e6befa84fe1a76b88ff2f303c50)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:47.384272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78539244-7499-4acf-bd89-3d81e67717dd None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:47.386543 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 182/349] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Aug 4 10:11:47 2022] GET /identity/v3/groups/31431e6befa84fe1a76b88ff2f303c50 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:47.387972 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7ce56-c953-450d-a9ec-e899a98b4578 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:47.388628 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7ce56-c953-450d-a9ec-e899a98b4578 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:47.389313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7ce56-c953-450d-a9ec-e899a98b4578 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:47.391076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 183/350] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:47.391974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7ce56-c953-450d-a9ec-e899a98b4578 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:47.408919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279d682-3697-42f8-9a84-40ad2ff875a9 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:47.435089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:47.465844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad255465-e265-473c-8aca-6f6a860e4d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:47.465844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad255465-e265-473c-8aca-6f6a860e4d12 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:47.466374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad255465-e265-473c-8aca-6f6a860e4d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:47.466662 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad255465-e265-473c-8aca-6f6a860e4d12 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:47.467395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad255465-e265-473c-8aca-6f6a860e4d12 None admin] RBAC: Adding query filter params (name=member) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:47.467704 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad255465-e265-473c-8aca-6f6a860e4d12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:47.469158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad255465-e265-473c-8aca-6f6a860e4d12 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:47.478962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 168/351] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:47.480227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588fbfb-05b9-44f5-aa2e-c00c3757a3bb None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:47.480518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588fbfb-05b9-44f5-aa2e-c00c3757a3bb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:47.480795 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588fbfb-05b9-44f5-aa2e-c00c3757a3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:47.502221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d588fbfb-05b9-44f5-aa2e-c00c3757a3bb None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:47.504049 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d588fbfb-05b9-44f5-aa2e-c00c3757a3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:47.510023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:47.532016 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7ce56-c953-450d-a9ec-e899a98b4578 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:47.577719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e09921-1093-4ba6-b819-47d0d1455ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:47.578465 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e09921-1093-4ba6-b819-47d0d1455ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:47.578817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e09921-1093-4ba6-b819-47d0d1455ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:47.579164 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e09921-1093-4ba6-b819-47d0d1455ac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:47.596550 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 169/352] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:47.597950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588fbfb-05b9-44f5-aa2e-c00c3757a3bb None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:47.681368 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e09921-1093-4ba6-b819-47d0d1455ac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:47.683007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e09921-1093-4ba6-b819-47d0d1455ac4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:47.726898 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588fbfb-05b9-44f5-aa2e-c00c3757a3bb None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:47.740738 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:47.770610 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e141aad-f0c4-4d2e-987e-9d89f0c7f0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:47.771240 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e141aad-f0c4-4d2e-987e-9d89f0c7f0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:47.771524 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e141aad-f0c4-4d2e-987e-9d89f0c7f0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:47.771802 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e141aad-f0c4-4d2e-987e-9d89f0c7f0a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:47.772642 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e141aad-f0c4-4d2e-987e-9d89f0c7f0a9 None admin] RBAC: Adding query filter params (group.id=31431e6befa84fe1a76b88ff2f303c50, role.id=50575a0d3f4340ee92356ce22ff3e62a, scope.project.id=8c7f15d3ce55460993f520e6f8838a8a) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:47.772954 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e141aad-f0c4-4d2e-987e-9d89f0c7f0a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:47.776283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e141aad-f0c4-4d2e-987e-9d89f0c7f0a9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:47.782120 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 170/353] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Aug 4 10:11:47 2022] GET /identity/v3/role_assignments?group.id=31431e6befa84fe1a76b88ff2f303c50&scope.project.id=8c7f15d3ce55460993f520e6f8838a8a&role.id=50575a0d3f4340ee92356ce22ff3e62a => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:47.787105 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7313a-ff2d-4ec9-8905-a391451d1a53 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:47.787105 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7313a-ff2d-4ec9-8905-a391451d1a53 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:47.787105 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7313a-ff2d-4ec9-8905-a391451d1a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:47.806841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:47.817902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-6af7313a-ff2d-4ec9-8905-a391451d1a53 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:47.819249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6af7313a-ff2d-4ec9-8905-a391451d1a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:47.824711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 184/354] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:47.825594 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e09921-1093-4ba6-b819-47d0d1455ac4 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:47.922079 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 171/355] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:47.922988 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7313a-ff2d-4ec9-8905-a391451d1a53 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:47.974488 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e09921-1093-4ba6-b819-47d0d1455ac4 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:48.017801 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8dbfb4-15f4-4926-84f5-b41d0d40db00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:48.019245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dbfb4-15f4-4926-84f5-b41d0d40db00 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:48.019593 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dbfb4-15f4-4926-84f5-b41d0d40db00 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:48.019874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dbfb4-15f4-4926-84f5-b41d0d40db00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:48.061523 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7313a-ff2d-4ec9-8905-a391451d1a53 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:48.064278 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:48.103019 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:48.112473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a874bb8-4d90-4084-9ddc-127ca04c651d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:48.113141 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a874bb8-4d90-4084-9ddc-127ca04c651d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:48.113420 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a874bb8-4d90-4084-9ddc-127ca04c651d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:48.113696 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a874bb8-4d90-4084-9ddc-127ca04c651d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:48.117983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dbfb4-15f4-4926-84f5-b41d0d40db00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:48.121007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dbfb4-15f4-4926-84f5-b41d0d40db00 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:48.130124 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a874bb8-4d90-4084-9ddc-127ca04c651d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:48.138117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-1a874bb8-4d90-4084-9ddc-127ca04c651d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 10:11:48.138117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:48.138117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:48.138117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:48.138117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:48.138117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:48.138117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:48.138117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:48.138117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:48.138117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:48.138117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:48.138117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:48.138117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:48.138117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:48.138117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:48.138117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:48.139207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:48.139207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:48.139207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:48.139207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:48.139207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:48.139207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:48.139207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:48.139207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:48.139207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:48.139207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:48.139207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:48.139207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:48.139207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:48.139207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:48.139207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:48.139207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:48.140006 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:48.140006 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:48.140006 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:48.140006 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:48.140006 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:48.140006 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:48.140006 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:48.140006 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:48.140006 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:48.140006 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:48.140006 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 10:11:48.140006 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:48.140006 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 172/356] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:48.140747 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a874bb8-4d90-4084-9ddc-127ca04c651d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:48.272199 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a874bb8-4d90-4084-9ddc-127ca04c651d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:48.276245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 185/357] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:48.277971 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c69e2-87a5-40c7-8616-b0d325f4088a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:48.278479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c69e2-87a5-40c7-8616-b0d325f4088a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:48.278946 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c69e2-87a5-40c7-8616-b0d325f4088a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:48.280926 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 186/358] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:48.281868 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c69e2-87a5-40c7-8616-b0d325f4088a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:48.327290 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24952b0-b0b3-4625-bdee-b3cd1c4e1257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:48.327290 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24952b0-b0b3-4625-bdee-b3cd1c4e1257 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:48.327290 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24952b0-b0b3-4625-bdee-b3cd1c4e1257 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:48.327290 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24952b0-b0b3-4625-bdee-b3cd1c4e1257 None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:48.328610 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24952b0-b0b3-4625-bdee-b3cd1c4e1257 None admin] RBAC: Authorizing `identity:get_project(project_id=8c7f15d3ce55460993f520e6f8838a8a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:48.330176 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24952b0-b0b3-4625-bdee-b3cd1c4e1257 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:48.332551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 173/359] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:48 2022] GET /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:48.333320 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24952b0-b0b3-4625-bdee-b3cd1c4e1257 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:48.373196 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:48.412057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:48.433751 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c69e2-87a5-40c7-8616-b0d325f4088a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:48.466374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24952b0-b0b3-4625-bdee-b3cd1c4e1257 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:48.486152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb49e1-9d81-4978-bdee-89eaefcb5aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:48.486733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb49e1-9d81-4978-bdee-89eaefcb5aea None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:48.487016 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb49e1-9d81-4978-bdee-89eaefcb5aea None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:48.487953 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb49e1-9d81-4978-bdee-89eaefcb5aea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:48.500669 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb49e1-9d81-4978-bdee-89eaefcb5aea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:48.506591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-5cfb49e1-9d81-4978-bdee-89eaefcb5aea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:48.506591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:48.506591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:48.506591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:48.506591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:48.506591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:48.506591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:48.506591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:48.506591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:48.506591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:48.506591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:48.506591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:48.506591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:48.506591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:48.506591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:48.506591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:48.507501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:48.507501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:48.507501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:48.507501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:48.507501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:48.507501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:48.507501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:48.507501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:48.507501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:48.507501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:48.507501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:48.507501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:48.507501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:48.507501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:48.507501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:48.507501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:48.508837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:48.508837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:48.508837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:48.508837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:48.508837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:48.508837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:48.508837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:48.508837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:48.508837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:48.508837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:48.508837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:48.508837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:48.508837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 187/360] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:11:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:48.511815 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb49e1-9d81-4978-bdee-89eaefcb5aea None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:48.523730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b8fb8-2428-4a3c-9f65-bfd318459ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:48.524902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b8fb8-2428-4a3c-9f65-bfd318459ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:48.525399 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b8fb8-2428-4a3c-9f65-bfd318459ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:48.525845 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b8fb8-2428-4a3c-9f65-bfd318459ab2 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:48.526726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b8fb8-2428-4a3c-9f65-bfd318459ab2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:48.527178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b8fb8-2428-4a3c-9f65-bfd318459ab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:48.528824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b8fb8-2428-4a3c-9f65-bfd318459ab2 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:48.540514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 174/361] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:48.541996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db638bc0-bd54-4108-883e-018e2c7fb912 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:48.542283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db638bc0-bd54-4108-883e-018e2c7fb912 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:48.542718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db638bc0-bd54-4108-883e-018e2c7fb912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:48.563089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-db638bc0-bd54-4108-883e-018e2c7fb912 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:48.564299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-db638bc0-bd54-4108-883e-018e2c7fb912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:48.656431 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb49e1-9d81-4978-bdee-89eaefcb5aea None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:48.660981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 175/362] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:48.661933 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db638bc0-bd54-4108-883e-018e2c7fb912 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:48.689025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:48.695394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d69516-527e-41b3-869d-67f43f696710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:48.696049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d69516-527e-41b3-869d-67f43f696710 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:48.696357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d69516-527e-41b3-869d-67f43f696710 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:48.696632 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d69516-527e-41b3-869d-67f43f696710 None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:48.697794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d69516-527e-41b3-869d-67f43f696710 None admin] RBAC: Authorizing `identity:get_project(project_id=13b307d54e4e48ef84790ab15f5ceb39)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:48.699241 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d69516-527e-41b3-869d-67f43f696710 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:48.701110 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 188/363] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:48 2022] GET /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:48.701770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d69516-527e-41b3-869d-67f43f696710 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:48.730377 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:48.791974 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db638bc0-bd54-4108-883e-018e2c7fb912 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:48.834535 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3cf653-0fd7-46c1-9d49-dc5cc7950a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:48.835440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3cf653-0fd7-46c1-9d49-dc5cc7950a1e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:48.835869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3cf653-0fd7-46c1-9d49-dc5cc7950a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:48.836332 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3cf653-0fd7-46c1-9d49-dc5cc7950a1e None admin] PATH_INFO: `/v3/groups/31431e6befa84fe1a76b88ff2f303c50` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:48.837629 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3cf653-0fd7-46c1-9d49-dc5cc7950a1e None admin] RBAC: Authorizing `identity:get_group(group_id=31431e6befa84fe1a76b88ff2f303c50)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:48.839373 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3cf653-0fd7-46c1-9d49-dc5cc7950a1e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:48.841438 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 176/364] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Aug 4 10:11:48 2022] GET /identity/v3/groups/31431e6befa84fe1a76b88ff2f303c50 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:48.841568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d69516-527e-41b3-869d-67f43f696710 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:48.843246 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3cf653-0fd7-46c1-9d49-dc5cc7950a1e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:48.890218 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c316e1-5b1f-421a-b25f-f1f0045e3407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:48.891515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c316e1-5b1f-421a-b25f-f1f0045e3407 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:48.891515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c316e1-5b1f-421a-b25f-f1f0045e3407 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:48.891515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c316e1-5b1f-421a-b25f-f1f0045e3407 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:48.892073 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c316e1-5b1f-421a-b25f-f1f0045e3407 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:48.892410 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c316e1-5b1f-421a-b25f-f1f0045e3407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:48.893830 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c316e1-5b1f-421a-b25f-f1f0045e3407 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:48.908724 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 189/365] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:11:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:48.910248 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c316e1-5b1f-421a-b25f-f1f0045e3407 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:48.976651 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:48.987774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3cf653-0fd7-46c1-9d49-dc5cc7950a1e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:49.008846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:49.036925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76581d-8b2c-428f-91d4-cb2dbf681a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:49.037413 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c316e1-5b1f-421a-b25f-f1f0045e3407 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:49.038124 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76581d-8b2c-428f-91d4-cb2dbf681a75 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:49.038583 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76581d-8b2c-428f-91d4-cb2dbf681a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:49.039266 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76581d-8b2c-428f-91d4-cb2dbf681a75 None admin] PATH_INFO: `/v3/users/a6b3888e47c445f9918998021693754d` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:49.041653 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76581d-8b2c-428f-91d4-cb2dbf681a75 None admin] RBAC: Authorizing `identity:get_user(user_id=a6b3888e47c445f9918998021693754d)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:49.043353 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76581d-8b2c-428f-91d4-cb2dbf681a75 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:49.045864 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 177/366] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:11:48 2022] GET /identity/v3/users/a6b3888e47c445f9918998021693754d => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:49.046871 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76581d-8b2c-428f-91d4-cb2dbf681a75 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:49.081680 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f7fb3-6c83-4cc1-8fb9-b24f10ead536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:49.082430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f7fb3-6c83-4cc1-8fb9-b24f10ead536 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:49.082708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f7fb3-6c83-4cc1-8fb9-b24f10ead536 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:49.082983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f7fb3-6c83-4cc1-8fb9-b24f10ead536 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:49.100286 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f7fb3-6c83-4cc1-8fb9-b24f10ead536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:49.106194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-f00f7fb3-6c83-4cc1-8fb9-b24f10ead536 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:49.106194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:49.106194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:49.106194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:49.106194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:49.106194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:49.106194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:49.106194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:49.106194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:49.106194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:49.106194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:49.106194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:49.106194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:49.106194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:49.106194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:49.106194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:49.107079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:49.107079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:49.107079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:49.107079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:49.107079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:49.107079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:49.107079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:49.107079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:49.107079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:49.107079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:49.107079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:49.107079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:49.107079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:49.107079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:49.107079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:49.107079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:49.107876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:49.107876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:49.107876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:49.107876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:49.107876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:49.107876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:49.107876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:49.107876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:49.107876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:49.107876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:49.107876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:49.107876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:49.107876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 190/367] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:11:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:49.112933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f7fb3-6c83-4cc1-8fb9-b24f10ead536 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:49.189729 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76581d-8b2c-428f-91d4-cb2dbf681a75 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:49.238005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac17d92-52f9-4177-a5cf-bfe12170f9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:49.238852 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac17d92-52f9-4177-a5cf-bfe12170f9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:49.239579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac17d92-52f9-4177-a5cf-bfe12170f9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:49.239579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac17d92-52f9-4177-a5cf-bfe12170f9b2 None admin] PATH_INFO: `/v3/groups/31431e6befa84fe1a76b88ff2f303c50` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:49.241856 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac17d92-52f9-4177-a5cf-bfe12170f9b2 None admin] RBAC: Authorizing `identity:get_group(group_id=31431e6befa84fe1a76b88ff2f303c50)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:49.243473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac17d92-52f9-4177-a5cf-bfe12170f9b2 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:49.245333 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 178/368] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Aug 4 10:11:49 2022] GET /identity/v3/groups/31431e6befa84fe1a76b88ff2f303c50 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:49.246234 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac17d92-52f9-4177-a5cf-bfe12170f9b2 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:49.246854 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f7fb3-6c83-4cc1-8fb9-b24f10ead536 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:49.282674 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:49.294408 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b3904-af24-46a9-9ed5-6157e494d592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:49.295440 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b3904-af24-46a9-9ed5-6157e494d592 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:49.295911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b3904-af24-46a9-9ed5-6157e494d592 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:49.296218 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b3904-af24-46a9-9ed5-6157e494d592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:49.297032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b3904-af24-46a9-9ed5-6157e494d592 None admin] RBAC: Adding query filter params (group.id=31431e6befa84fe1a76b88ff2f303c50, role.id=472f2455c837486084f108ce944f1bff, scope.project.id=8c7f15d3ce55460993f520e6f8838a8a) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:49.297347 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b3904-af24-46a9-9ed5-6157e494d592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:49.298792 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b3904-af24-46a9-9ed5-6157e494d592 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:49.306309 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 191/369] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Aug 4 10:11:49 2022] GET /identity/v3/role_assignments?group.id=31431e6befa84fe1a76b88ff2f303c50&scope.project.id=8c7f15d3ce55460993f520e6f8838a8a&role.id=472f2455c837486084f108ce944f1bff => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:49.307583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b3904-af24-46a9-9ed5-6157e494d592 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:49.310661 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:49.371881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac17d92-52f9-4177-a5cf-bfe12170f9b2 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:49.413567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca5fc9-c17e-4f75-9780-0f851ae3b3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:49.414214 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca5fc9-c17e-4f75-9780-0f851ae3b3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:49.414498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca5fc9-c17e-4f75-9780-0f851ae3b3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:49.414783 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca5fc9-c17e-4f75-9780-0f851ae3b3d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:49.434889 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b3904-af24-46a9-9ed5-6157e494d592 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:49.476011 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e79086-32ca-4e8f-8650-ad6ab6a67cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:49.478095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e79086-32ca-4e8f-8650-ad6ab6a67cce None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:49.478620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e79086-32ca-4e8f-8650-ad6ab6a67cce None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:49.479110 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e79086-32ca-4e8f-8650-ad6ab6a67cce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:49.480307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e79086-32ca-4e8f-8650-ad6ab6a67cce None admin] RBAC: Adding query filter params (role.id=439977f47a30404790859f8a0d504997, user.id=a6b3888e47c445f9918998021693754d, scope.system=all) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:49.480950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e79086-32ca-4e8f-8650-ad6ab6a67cce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:49.482642 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e79086-32ca-4e8f-8650-ad6ab6a67cce None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:49.496488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca5fc9-c17e-4f75-9780-0f851ae3b3d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:49.498049 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca5fc9-c17e-4f75-9780-0f851ae3b3d2 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:49.498502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 192/370] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Aug 4 10:11:49 2022] GET /identity/v3/role_assignments?user.id=a6b3888e47c445f9918998021693754d&scope.system=all&role.id=439977f47a30404790859f8a0d504997 => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:49.499557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e79086-32ca-4e8f-8650-ad6ab6a67cce None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:49.532774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:49.575244 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:49.627235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 179/371] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:49.627235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca5fc9-c17e-4f75-9780-0f851ae3b3d2 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:49.634282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e79086-32ca-4e8f-8650-ad6ab6a67cce None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:49.675430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4963d3-991d-48dd-ae7e-8621746e4484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:49.676518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4963d3-991d-48dd-ae7e-8621746e4484 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:49.677017 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4963d3-991d-48dd-ae7e-8621746e4484 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:49.677602 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4963d3-991d-48dd-ae7e-8621746e4484 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:49.678636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4963d3-991d-48dd-ae7e-8621746e4484 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:49.679147 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4963d3-991d-48dd-ae7e-8621746e4484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:49.680858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4963d3-991d-48dd-ae7e-8621746e4484 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:49.691362 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 193/372] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:49.692857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4963d3-991d-48dd-ae7e-8621746e4484 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:49.745155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca5fc9-c17e-4f75-9780-0f851ae3b3d2 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:49.807247 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:49.819609 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4db9e-4e25-4b35-baf0-8af7bdbfae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:49.820683 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4db9e-4e25-4b35-baf0-8af7bdbfae5d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:49.821971 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4db9e-4e25-4b35-baf0-8af7bdbfae5d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:49.822461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4db9e-4e25-4b35-baf0-8af7bdbfae5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:49.823478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4db9e-4e25-4b35-baf0-8af7bdbfae5d None admin] RBAC: Adding query filter params (group.id=31431e6befa84fe1a76b88ff2f303c50, role.id=50575a0d3f4340ee92356ce22ff3e62a, scope.project.id=13b307d54e4e48ef84790ab15f5ceb39) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:49.824013 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4db9e-4e25-4b35-baf0-8af7bdbfae5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:49.825778 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4db9e-4e25-4b35-baf0-8af7bdbfae5d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:49.832350 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 180/373] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Aug 4 10:11:49 2022] GET /identity/v3/role_assignments?group.id=31431e6befa84fe1a76b88ff2f303c50&scope.project.id=13b307d54e4e48ef84790ab15f5ceb39&role.id=50575a0d3f4340ee92356ce22ff3e62a => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:49.833680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4db9e-4e25-4b35-baf0-8af7bdbfae5d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:49.840585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4963d3-991d-48dd-ae7e-8621746e4484 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:49.876826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:49.905281 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b50a4-9fbf-4041-bd08-d3056a202b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:49.906053 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b50a4-9fbf-4041-bd08-d3056a202b04 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:49.906406 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b50a4-9fbf-4041-bd08-d3056a202b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:49.906774 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b50a4-9fbf-4041-bd08-d3056a202b04 None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:49.913223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b50a4-9fbf-4041-bd08-d3056a202b04 None admin] RBAC: Authorizing `identity:get_project(project_id=13b307d54e4e48ef84790ab15f5ceb39)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:49.914917 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b50a4-9fbf-4041-bd08-d3056a202b04 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:49.917951 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 194/374] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:49 2022] GET /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:49.927515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b50a4-9fbf-4041-bd08-d3056a202b04 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:49.957417 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4db9e-4e25-4b35-baf0-8af7bdbfae5d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:50.001423 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0c545-4668-4b2d-9d62-1226e423c385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:50.002420 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0c545-4668-4b2d-9d62-1226e423c385 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:50.002917 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0c545-4668-4b2d-9d62-1226e423c385 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:50.003379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0c545-4668-4b2d-9d62-1226e423c385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:50.077117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:50.090551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0c545-4668-4b2d-9d62-1226e423c385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:50.093464 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0c545-4668-4b2d-9d62-1226e423c385 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:50.127095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b50a4-9fbf-4041-bd08-d3056a202b04 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:50.164651 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7cb62-fc83-4697-83eb-a6d11882b46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:50.165715 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7cb62-fc83-4697-83eb-a6d11882b46c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:50.166230 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7cb62-fc83-4697-83eb-a6d11882b46c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:50.166733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7cb62-fc83-4697-83eb-a6d11882b46c None admin] PATH_INFO: `/v3/groups/31431e6befa84fe1a76b88ff2f303c50` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:50.168110 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7cb62-fc83-4697-83eb-a6d11882b46c None admin] RBAC: Authorizing `identity:get_group(group_id=31431e6befa84fe1a76b88ff2f303c50)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:50.169795 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7cb62-fc83-4697-83eb-a6d11882b46c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:50.171976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 195/375] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Aug 4 10:11:49 2022] GET /identity/v3/groups/31431e6befa84fe1a76b88ff2f303c50 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:50.173424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb25ef2-9f7e-4844-9c70-c87b5321466e None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:50.173924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb25ef2-9f7e-4844-9c70-c87b5321466e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:50.174387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb25ef2-9f7e-4844-9c70-c87b5321466e None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:50.175841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 196/376] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:50.178202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb25ef2-9f7e-4844-9c70-c87b5321466e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:50.216969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 181/377] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:50.218595 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13aef8-6271-4845-840e-512068108644 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:50.218731 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13aef8-6271-4845-840e-512068108644 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:50.218965 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13aef8-6271-4845-840e-512068108644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:50.252730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:50.258734 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-eb13aef8-6271-4845-840e-512068108644 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:50.259957 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-eb13aef8-6271-4845-840e-512068108644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:50.310469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb25ef2-9f7e-4844-9c70-c87b5321466e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:50.349804 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 182/378] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:50.357093 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13aef8-6271-4845-840e-512068108644 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:50.358489 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957ffe5-13ad-496c-a710-624152b54429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:50.359110 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957ffe5-13ad-496c-a710-624152b54429 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:50.359544 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957ffe5-13ad-496c-a710-624152b54429 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:50.359828 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957ffe5-13ad-496c-a710-624152b54429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:50.360674 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957ffe5-13ad-496c-a710-624152b54429 None admin] RBAC: Adding query filter params (group.id=31431e6befa84fe1a76b88ff2f303c50, role.id=472f2455c837486084f108ce944f1bff, scope.project.id=13b307d54e4e48ef84790ab15f5ceb39) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:50.360988 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957ffe5-13ad-496c-a710-624152b54429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:50.363026 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957ffe5-13ad-496c-a710-624152b54429 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:50.370138 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 197/379] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Aug 4 10:11:50 2022] GET /identity/v3/role_assignments?group.id=31431e6befa84fe1a76b88ff2f303c50&scope.project.id=13b307d54e4e48ef84790ab15f5ceb39&role.id=472f2455c837486084f108ce944f1bff => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:50.388911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957ffe5-13ad-496c-a710-624152b54429 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:50.412560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:50.559231 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13aef8-6271-4845-840e-512068108644 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:50.577743 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957ffe5-13ad-496c-a710-624152b54429 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:50.606268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:50.620427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3e3b5-c65c-4dc7-a28f-05dc1ca01c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:50.620427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3e3b5-c65c-4dc7-a28f-05dc1ca01c94 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:50.620427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3e3b5-c65c-4dc7-a28f-05dc1ca01c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:50.620760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3e3b5-c65c-4dc7-a28f-05dc1ca01c94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:50.635762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3e3b5-c65c-4dc7-a28f-05dc1ca01c94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:50.636189 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29129a-f6ad-4220-abb8-b79eb49b34d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:50.637084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29129a-f6ad-4220-abb8-b79eb49b34d5 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:50.637579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29129a-f6ad-4220-abb8-b79eb49b34d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:50.638075 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29129a-f6ad-4220-abb8-b79eb49b34d5 None admin] PATH_INFO: `/v3/projects/ed5a4d067698404b8e986636ba77adc9` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:50.639488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29129a-f6ad-4220-abb8-b79eb49b34d5 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5a4d067698404b8e986636ba77adc9)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:50.641178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29129a-f6ad-4220-abb8-b79eb49b34d5 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:50.641441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-a6a3e3b5-c65c-4dc7-a28f-05dc1ca01c94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:50.641441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:50.641441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:50.641441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:50.641441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:50.641441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:50.641441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:50.641441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:50.641441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:50.641441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:50.641441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:50.641441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:50.641441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:50.641441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:50.641441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:50.641441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:50.642277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:50.642277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:50.642277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:50.642277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:50.642277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:50.642277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:50.642277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:50.642277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:50.642277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:50.642277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:50.642277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:50.642277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:50.642277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:50.642277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:50.642277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:50.642277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:50.643046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:50.643046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:50.643046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:50.643046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:50.643046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:50.643046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:50.643046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:50.643046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:50.643046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:50.643046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:50.643046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:50.643046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:50.643046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 198/380] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:50.646579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 183/381] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:50 2022] GET /identity/v3/projects/ed5a4d067698404b8e986636ba77adc9 => generated 344 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:50.649206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3e3b5-c65c-4dc7-a28f-05dc1ca01c94 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:50.652627 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29129a-f6ad-4220-abb8-b79eb49b34d5 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:50.797210 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:50.808764 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29129a-f6ad-4220-abb8-b79eb49b34d5 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:50.884294 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88708aca-e12c-476b-9b5f-db64522b65d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:50.885293 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88708aca-e12c-476b-9b5f-db64522b65d8 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:50.885775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88708aca-e12c-476b-9b5f-db64522b65d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:50.886855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88708aca-e12c-476b-9b5f-db64522b65d8 None admin] PATH_INFO: `/v3/groups/46a2dfefae4c470080e90653900bef6b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:50.889818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3e3b5-c65c-4dc7-a28f-05dc1ca01c94 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:50.902925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88708aca-e12c-476b-9b5f-db64522b65d8 None admin] RBAC: Authorizing `identity:get_group(group_id=46a2dfefae4c470080e90653900bef6b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:50.904794 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88708aca-e12c-476b-9b5f-db64522b65d8 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:50.906999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 184/382] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Aug 4 10:11:50 2022] GET /identity/v3/groups/46a2dfefae4c470080e90653900bef6b => generated 229 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:50.913183 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88708aca-e12c-476b-9b5f-db64522b65d8 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:50.953651 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1222a81-545a-4010-9d12-98572eb74fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:50.954647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1222a81-545a-4010-9d12-98572eb74fbe None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:50.955137 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1222a81-545a-4010-9d12-98572eb74fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:50.955628 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1222a81-545a-4010-9d12-98572eb74fbe None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:50.957130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1222a81-545a-4010-9d12-98572eb74fbe None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:50.957702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1222a81-545a-4010-9d12-98572eb74fbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:50.959439 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1222a81-545a-4010-9d12-98572eb74fbe None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:50.975192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 199/383] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:50.980650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1222a81-545a-4010-9d12-98572eb74fbe None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:51.057287 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:51.113743 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88708aca-e12c-476b-9b5f-db64522b65d8 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:51.169073 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1222a81-545a-4010-9d12-98572eb74fbe None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:51.182679 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ea135-e3c3-45c0-8a97-a99c4debce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:51.183608 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ea135-e3c3-45c0-8a97-a99c4debce97 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:51.184244 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ea135-e3c3-45c0-8a97-a99c4debce97 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:51.186142 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ea135-e3c3-45c0-8a97-a99c4debce97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:51.187406 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ea135-e3c3-45c0-8a97-a99c4debce97 None admin] RBAC: Adding query filter params (group.id=46a2dfefae4c470080e90653900bef6b, role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.project.id=ed5a4d067698404b8e986636ba77adc9) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:51.188118 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ea135-e3c3-45c0-8a97-a99c4debce97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:51.191214 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ea135-e3c3-45c0-8a97-a99c4debce97 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:51.203516 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 185/384] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Aug 4 10:11:50 2022] GET /identity/v3/role_assignments?group.id=46a2dfefae4c470080e90653900bef6b&scope.project.id=ed5a4d067698404b8e986636ba77adc9&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 260 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:51.243405 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba64403-d525-4654-aa37-1e3dc05e797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:51.244647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba64403-d525-4654-aa37-1e3dc05e797d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:51.245130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba64403-d525-4654-aa37-1e3dc05e797d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:51.245623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba64403-d525-4654-aa37-1e3dc05e797d None admin] PATH_INFO: `/v3/groups/31431e6befa84fe1a76b88ff2f303c50` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:51.247291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba64403-d525-4654-aa37-1e3dc05e797d None admin] RBAC: Authorizing `identity:get_group(group_id=31431e6befa84fe1a76b88ff2f303c50)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:51.249153 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba64403-d525-4654-aa37-1e3dc05e797d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:51.251229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 200/385] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Aug 4 10:11:50 2022] GET /identity/v3/groups/31431e6befa84fe1a76b88ff2f303c50 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:51.257365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ea135-e3c3-45c0-8a97-a99c4debce97 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:51.290599 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:51.419981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ea135-e3c3-45c0-8a97-a99c4debce97 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:51.463633 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefa3c7-fbc5-4dda-aee7-6d4b3f294579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:51.464787 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefa3c7-fbc5-4dda-aee7-6d4b3f294579 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:51.465262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefa3c7-fbc5-4dda-aee7-6d4b3f294579 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:51.465769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefa3c7-fbc5-4dda-aee7-6d4b3f294579 None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:51.467126 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefa3c7-fbc5-4dda-aee7-6d4b3f294579 None admin] RBAC: Authorizing `identity:get_project(project_id=8c7f15d3ce55460993f520e6f8838a8a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:51.468793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefa3c7-fbc5-4dda-aee7-6d4b3f294579 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:51.470714 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 186/386] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:51 2022] GET /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:51.476606 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba64403-d525-4654-aa37-1e3dc05e797d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:51.605208 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba64403-d525-4654-aa37-1e3dc05e797d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:51.631289 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:51.661761 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166ada4-dbc7-43fb-af3c-3dd3509dc02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:51.662440 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166ada4-dbc7-43fb-af3c-3dd3509dc02f None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:51.662718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166ada4-dbc7-43fb-af3c-3dd3509dc02f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:51.663331 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166ada4-dbc7-43fb-af3c-3dd3509dc02f None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a/groups/31431e6befa84fe1a76b88ff2f303c50/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:51.665312 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166ada4-dbc7-43fb-af3c-3dd3509dc02f None admin] RBAC: Authorizing `identity:create_grant(project_id=8c7f15d3ce55460993f520e6f8838a8a, group_id=31431e6befa84fe1a76b88ff2f303c50, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:51.666809 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166ada4-dbc7-43fb-af3c-3dd3509dc02f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:51.681758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 201/387] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Aug 4 10:11:51 2022] PUT /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a/groups/31431e6befa84fe1a76b88ff2f303c50/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:11:51.923269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e5c3b-e7ad-430b-a105-e989bdf58bf9 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:51.923791 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e5c3b-e7ad-430b-a105-e989bdf58bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:51.924105 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e5c3b-e7ad-430b-a105-e989bdf58bf9 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:51.926942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 187/388] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:51.932664 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ea072-76d8-462d-bc20-6c890eb81c28 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:51.933125 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ea072-76d8-462d-bc20-6c890eb81c28 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:51.933125 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ea072-76d8-462d-bc20-6c890eb81c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:51.958804 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-157ea072-76d8-462d-bc20-6c890eb81c28 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:51.960387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-157ea072-76d8-462d-bc20-6c890eb81c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:52.044088 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 202/389] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:52.079907 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e5c3b-e7ad-430b-a105-e989bdf58bf9 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:52.196609 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:52.215894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e5c3b-e7ad-430b-a105-e989bdf58bf9 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:52.263565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa010c31-4737-4c8a-a7c2-dcc0262ae086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:52.264233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa010c31-4737-4c8a-a7c2-dcc0262ae086 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:52.264518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa010c31-4737-4c8a-a7c2-dcc0262ae086 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:52.264792 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa010c31-4737-4c8a-a7c2-dcc0262ae086 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:52.275909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa010c31-4737-4c8a-a7c2-dcc0262ae086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:52.286383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-aa010c31-4737-4c8a-a7c2-dcc0262ae086 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:52.286383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:52.286383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:52.286383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:52.286383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:52.286383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:52.286383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:52.286383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:52.286383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:52.286383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:52.286383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:52.286383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:52.286383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:52.286383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:52.286383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:52.286383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:52.287237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:52.287237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:52.287237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:52.287237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:52.287237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:52.287237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:52.287237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:52.287237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:52.287237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:52.287237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:52.287237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:52.287237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:52.287237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:52.287237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:52.287237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:52.287237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:52.288443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:52.288443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:52.288443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:52.288443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:52.288443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:52.288443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:52.288443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:52.288443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:52.288443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:52.288443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:52.288443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:52.288443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:52.288443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 188/390] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:11:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:52.295100 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ea072-76d8-462d-bc20-6c890eb81c28 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:52.410952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ea072-76d8-462d-bc20-6c890eb81c28 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:52.412650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:52.460158 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12227da-1787-4163-bb73-9d1e89bf94ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:52.460747 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12227da-1787-4163-bb73-9d1e89bf94ee None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:52.461030 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12227da-1787-4163-bb73-9d1e89bf94ee None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:52.461306 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12227da-1787-4163-bb73-9d1e89bf94ee None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:52.462032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12227da-1787-4163-bb73-9d1e89bf94ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:52.462346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12227da-1787-4163-bb73-9d1e89bf94ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:52.463728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12227da-1787-4163-bb73-9d1e89bf94ee None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:52.473560 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 203/391] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:11:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:52.479211 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa010c31-4737-4c8a-a7c2-dcc0262ae086 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:52.496931 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3ff81-c551-41aa-8559-ceb9e04d7918 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:52.497227 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3ff81-c551-41aa-8559-ceb9e04d7918 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:52.497490 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3ff81-c551-41aa-8559-ceb9e04d7918 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:52.498835 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 204/392] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:11:52.513730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bf9a4-0520-43f2-9498-e8010966909d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:52.514310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bf9a4-0520-43f2-9498-e8010966909d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:52.514781 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bf9a4-0520-43f2-9498-e8010966909d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:52.545150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a28bf9a4-0520-43f2-9498-e8010966909d None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:52.546354 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a28bf9a4-0520-43f2-9498-e8010966909d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:52.665530 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa010c31-4737-4c8a-a7c2-dcc0262ae086 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:52.669157 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 205/393] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:52.705353 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c238e-4694-4de1-8254-53580043b558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:52.706624 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c238e-4694-4de1-8254-53580043b558 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:52.708364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bf9a4-0520-43f2-9498-e8010966909d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:52.710502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c238e-4694-4de1-8254-53580043b558 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:52.711614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c238e-4694-4de1-8254-53580043b558 None admin] PATH_INFO: `/v3/groups/31431e6befa84fe1a76b88ff2f303c50` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:52.719198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c238e-4694-4de1-8254-53580043b558 None admin] RBAC: Authorizing `identity:get_group(group_id=31431e6befa84fe1a76b88ff2f303c50)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:52.722337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c238e-4694-4de1-8254-53580043b558 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:52.725327 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 189/394] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Aug 4 10:11:52 2022] GET /identity/v3/groups/31431e6befa84fe1a76b88ff2f303c50 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:52.729926 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c238e-4694-4de1-8254-53580043b558 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:52.759700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:52.877126 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:52.888974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bf9a4-0520-43f2-9498-e8010966909d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:52.912249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c238e-4694-4de1-8254-53580043b558 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:52.951628 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be104e5-0be0-4ef5-aec6-b936071dd0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:52.952326 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be104e5-0be0-4ef5-aec6-b936071dd0ce None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:52.952596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be104e5-0be0-4ef5-aec6-b936071dd0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:52.952875 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be104e5-0be0-4ef5-aec6-b936071dd0ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:52.964208 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be104e5-0be0-4ef5-aec6-b936071dd0ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:52.969180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-7be104e5-0be0-4ef5-aec6-b936071dd0ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:52.969180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:52.969180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:52.969180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:52.969180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:52.969180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:52.969180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:52.969180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:52.969180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:52.969180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:52.969180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:52.969180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:52.969180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:52.969180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:52.969180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:52.969180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:52.970057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:52.970057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:52.970057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:52.970057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:52.970057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:52.970057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:52.970057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:52.970057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:52.970057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:52.970057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:52.970057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:52.970057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:52.970057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:52.970057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:52.970057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:52.970057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:52.971338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:52.971338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:52.971338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:52.971338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:52.971338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:52.971338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:52.971338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:52.971338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:52.971338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:52.971338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:52.971338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:52.971338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:52.971338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 206/395] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:52.978146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be104e5-0be0-4ef5-aec6-b936071dd0ce None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:52.986843 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47625304-eb50-4b6d-85b0-b44f44378704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:52.988086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47625304-eb50-4b6d-85b0-b44f44378704 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:52.988404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47625304-eb50-4b6d-85b0-b44f44378704 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:52.988677 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47625304-eb50-4b6d-85b0-b44f44378704 None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:52.995178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47625304-eb50-4b6d-85b0-b44f44378704 None admin] RBAC: Authorizing `identity:get_project(project_id=8c7f15d3ce55460993f520e6f8838a8a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:52.996696 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47625304-eb50-4b6d-85b0-b44f44378704 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:52.998424 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 190/396] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:52 2022] GET /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:53.005162 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47625304-eb50-4b6d-85b0-b44f44378704 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:53.116378 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:53.138031 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47625304-eb50-4b6d-85b0-b44f44378704 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:53.142487 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be104e5-0be0-4ef5-aec6-b936071dd0ce None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:53.181605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b08ab6-463d-4595-8f77-50ed72e11c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:53.182506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b08ab6-463d-4595-8f77-50ed72e11c6a None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:53.182989 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b08ab6-463d-4595-8f77-50ed72e11c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:53.183338 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b08ab6-463d-4595-8f77-50ed72e11c6a None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a/groups/31431e6befa84fe1a76b88ff2f303c50/roles/472f2455c837486084f108ce944f1bff` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:53.185942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b08ab6-463d-4595-8f77-50ed72e11c6a None admin] RBAC: Authorizing `identity:create_grant(project_id=8c7f15d3ce55460993f520e6f8838a8a, group_id=31431e6befa84fe1a76b88ff2f303c50, role_id=472f2455c837486084f108ce944f1bff)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:53.187879 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b08ab6-463d-4595-8f77-50ed72e11c6a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:53.195140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608120aa-84c2-4d8b-87fa-b2676706de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:53.196295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608120aa-84c2-4d8b-87fa-b2676706de61 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:53.197896 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608120aa-84c2-4d8b-87fa-b2676706de61 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:53.198301 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608120aa-84c2-4d8b-87fa-b2676706de61 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:53.199112 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608120aa-84c2-4d8b-87fa-b2676706de61 None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:53.199580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608120aa-84c2-4d8b-87fa-b2676706de61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:53.201298 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608120aa-84c2-4d8b-87fa-b2676706de61 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:53.205470 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 191/397] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Aug 4 10:11:53 2022] PUT /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a/groups/31431e6befa84fe1a76b88ff2f303c50/roles/472f2455c837486084f108ce944f1bff => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:11:53.207461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593a757-8233-4203-801f-d17a72860f04 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:53.207755 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593a757-8233-4203-801f-d17a72860f04 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:53.208133 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593a757-8233-4203-801f-d17a72860f04 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:53.209466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 192/398] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:53.211838 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 207/399] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:53.219324 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593a757-8233-4203-801f-d17a72860f04 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:53.230624 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e0c2a-7fef-4552-9835-d2261d6d5a83 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:53.231267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e0c2a-7fef-4552-9835-d2261d6d5a83 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:53.231795 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e0c2a-7fef-4552-9835-d2261d6d5a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:53.269487 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-ad5e0c2a-7fef-4552-9835-d2261d6d5a83 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:53.271204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ad5e0c2a-7fef-4552-9835-d2261d6d5a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:53.302324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:53.358952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593a757-8233-4203-801f-d17a72860f04 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:53.407689 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3dca98-7770-439c-ba32-deae5b6dface None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:53.408283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3dca98-7770-439c-ba32-deae5b6dface None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:53.408726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3dca98-7770-439c-ba32-deae5b6dface None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:53.409585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3dca98-7770-439c-ba32-deae5b6dface None admin] PATH_INFO: `/v3/groups/31431e6befa84fe1a76b88ff2f303c50` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:53.410724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3dca98-7770-439c-ba32-deae5b6dface None admin] RBAC: Authorizing `identity:get_group(group_id=31431e6befa84fe1a76b88ff2f303c50)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:53.412421 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3dca98-7770-439c-ba32-deae5b6dface None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:53.416322 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 193/400] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Aug 4 10:11:53 2022] GET /identity/v3/groups/31431e6befa84fe1a76b88ff2f303c50 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:53.422242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3dca98-7770-439c-ba32-deae5b6dface None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:53.440273 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 208/401] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:53.464070 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:53.464620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e0c2a-7fef-4552-9835-d2261d6d5a83 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:53.578342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3dca98-7770-439c-ba32-deae5b6dface None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:53.606868 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e0c2a-7fef-4552-9835-d2261d6d5a83 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:53.627262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97165b5-7a4c-4230-bd3c-bbef3635966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:53.628811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97165b5-7a4c-4230-bd3c-bbef3635966f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:53.629789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97165b5-7a4c-4230-bd3c-bbef3635966f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:53.630251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97165b5-7a4c-4230-bd3c-bbef3635966f None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:53.631971 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97165b5-7a4c-4230-bd3c-bbef3635966f None admin] RBAC: Authorizing `identity:get_project(project_id=13b307d54e4e48ef84790ab15f5ceb39)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:53.633637 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97165b5-7a4c-4230-bd3c-bbef3635966f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:53.641729 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 194/402] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:53 2022] GET /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:53.643917 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bd7b2-bdde-41b0-8787-ad22e30b3a5f None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:53.644890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bd7b2-bdde-41b0-8787-ad22e30b3a5f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:53.645350 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bd7b2-bdde-41b0-8787-ad22e30b3a5f None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:53.648029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 195/403] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:53.649447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bd7b2-bdde-41b0-8787-ad22e30b3a5f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:53.659566 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c911f22-8284-4c59-bb66-f60b0577ff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:53.660371 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c911f22-8284-4c59-bb66-f60b0577ff6a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:53.660729 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c911f22-8284-4c59-bb66-f60b0577ff6a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:53.661129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c911f22-8284-4c59-bb66-f60b0577ff6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:53.675734 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c911f22-8284-4c59-bb66-f60b0577ff6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:53.681374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-1c911f22-8284-4c59-bb66-f60b0577ff6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:53.681374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:53.681374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:53.681374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:53.681374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:53.681374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:53.681374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:53.681374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:53.681374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:53.681374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:53.681374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:53.681374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:53.681374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:53.681374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:53.681374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:53.681374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:53.682270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:53.682270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:53.682270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:53.682270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:53.682270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:53.682270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:53.682270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:53.682270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:53.682270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:53.682270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:53.682270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:53.682270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:53.682270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:53.682270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:53.682270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:53.682270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:53.683150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:53.683150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:53.683150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:53.683150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:53.683150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:53.683150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:53.683150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:53.683150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:53.683150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:53.683150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:53.683150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:53.683150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:53.683150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 209/404] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:11:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:11:53.683776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9abc9-0b38-489b-b913-9c10f1a7fb10 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:53.688904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9abc9-0b38-489b-b913-9c10f1a7fb10 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:53.688904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9abc9-0b38-489b-b913-9c10f1a7fb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:53.700402 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:53.709048 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d9c9abc9-0b38-489b-b913-9c10f1a7fb10 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:53.709805 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d9c9abc9-0b38-489b-b913-9c10f1a7fb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:53.769050 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:53.791453 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 210/405] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:53.792640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9abc9-0b38-489b-b913-9c10f1a7fb10 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:53.799293 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bd7b2-bdde-41b0-8787-ad22e30b3a5f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:53.847188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27274aff-223c-4a79-b2bd-9edb6bfe761a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:53.848775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27274aff-223c-4a79-b2bd-9edb6bfe761a None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:53.849242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27274aff-223c-4a79-b2bd-9edb6bfe761a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:53.849696 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27274aff-223c-4a79-b2bd-9edb6bfe761a None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39/groups/31431e6befa84fe1a76b88ff2f303c50/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:53.852892 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27274aff-223c-4a79-b2bd-9edb6bfe761a None admin] RBAC: Authorizing `identity:create_grant(project_id=13b307d54e4e48ef84790ab15f5ceb39, group_id=31431e6befa84fe1a76b88ff2f303c50, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:53.854781 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27274aff-223c-4a79-b2bd-9edb6bfe761a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:53.874908 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 196/406] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Aug 4 10:11:53 2022] PUT /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39/groups/31431e6befa84fe1a76b88ff2f303c50/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:11:53.876259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27274aff-223c-4a79-b2bd-9edb6bfe761a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:53.961691 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9abc9-0b38-489b-b913-9c10f1a7fb10 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:54.022263 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27274aff-223c-4a79-b2bd-9edb6bfe761a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:54.057672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591aff26-7157-4ac5-823e-be9ecdbceea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:54.058355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591aff26-7157-4ac5-823e-be9ecdbceea1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:54.058634 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591aff26-7157-4ac5-823e-be9ecdbceea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:54.059020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591aff26-7157-4ac5-823e-be9ecdbceea1 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:54.059648 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591aff26-7157-4ac5-823e-be9ecdbceea1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:54.059955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591aff26-7157-4ac5-823e-be9ecdbceea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:54.061660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591aff26-7157-4ac5-823e-be9ecdbceea1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:54.070639 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6bae3-0bc4-484b-8dcf-afee13934aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:54.071538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6bae3-0bc4-484b-8dcf-afee13934aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:54.071966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6bae3-0bc4-484b-8dcf-afee13934aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:54.072410 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6bae3-0bc4-484b-8dcf-afee13934aa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:54.072949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:54.081261 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 211/407] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:11:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:54.083033 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:54.087606 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591aff26-7157-4ac5-823e-be9ecdbceea1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:54.089690 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6bae3-0bc4-484b-8dcf-afee13934aa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:54.096144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-6ef6bae3-0bc4-484b-8dcf-afee13934aa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:54.096144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:54.096144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:54.096144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:54.096144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:54.096144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:54.096144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:54.096144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:54.096144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:54.096144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:54.096144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:54.096144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:54.096144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:54.096144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:54.096144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:54.096144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:54.097946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:54.097946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:54.097946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:54.097946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:54.097946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:54.097946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:54.097946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:54.097946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:54.097946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:54.097946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:54.097946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:54.097946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:54.097946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:54.097946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:54.097946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:54.097946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:54.098919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:54.098919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:54.098919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:54.098919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:54.098919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:54.098919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:54.098919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:54.098919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:54.098919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:54.098919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:54.098919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:54.098919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:54.101782 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 197/408] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:11:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:54.109189 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6bae3-0bc4-484b-8dcf-afee13934aa7 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:54.223281 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591aff26-7157-4ac5-823e-be9ecdbceea1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:54.264009 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9333f86-b3c8-45d7-8628-6e9634e86c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:54.265065 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9333f86-b3c8-45d7-8628-6e9634e86c1b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:54.265604 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9333f86-b3c8-45d7-8628-6e9634e86c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:54.266061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9333f86-b3c8-45d7-8628-6e9634e86c1b None admin] PATH_INFO: `/v3/groups/31431e6befa84fe1a76b88ff2f303c50` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:54.267509 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9333f86-b3c8-45d7-8628-6e9634e86c1b None admin] RBAC: Authorizing `identity:get_group(group_id=31431e6befa84fe1a76b88ff2f303c50)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:54.269349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9333f86-b3c8-45d7-8628-6e9634e86c1b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:54.275773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 212/409] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Aug 4 10:11:54 2022] GET /identity/v3/groups/31431e6befa84fe1a76b88ff2f303c50 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:54.277189 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9333f86-b3c8-45d7-8628-6e9634e86c1b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:54.286310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6bae3-0bc4-484b-8dcf-afee13934aa7 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:54.356251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24ab71-8121-481f-93a5-e818ebf4338b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:54.356815 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24ab71-8121-481f-93a5-e818ebf4338b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:54.357100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24ab71-8121-481f-93a5-e818ebf4338b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:54.357374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24ab71-8121-481f-93a5-e818ebf4338b None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:54.358129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24ab71-8121-481f-93a5-e818ebf4338b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:54.358412 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24ab71-8121-481f-93a5-e818ebf4338b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:54.359820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24ab71-8121-481f-93a5-e818ebf4338b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:54.372938 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:54.376312 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 198/410] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:54.382131 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d8b8b-72bc-45c6-a16c-6adf1289559c None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:54.382808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d8b8b-72bc-45c6-a16c-6adf1289559c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:54.383285 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d8b8b-72bc-45c6-a16c-6adf1289559c None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:54.389342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 199/411] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:54.390930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d8b8b-72bc-45c6-a16c-6adf1289559c None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:54.397052 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9333f86-b3c8-45d7-8628-6e9634e86c1b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:54.434610 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898c7e0-d637-4f76-84f5-64e716473e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:54.435272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898c7e0-d637-4f76-84f5-64e716473e71 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:54.435557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898c7e0-d637-4f76-84f5-64e716473e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:54.435839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898c7e0-d637-4f76-84f5-64e716473e71 None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:54.437313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898c7e0-d637-4f76-84f5-64e716473e71 None admin] RBAC: Authorizing `identity:get_project(project_id=13b307d54e4e48ef84790ab15f5ceb39)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:54.438897 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898c7e0-d637-4f76-84f5-64e716473e71 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:54.445716 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 213/412] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:54 2022] GET /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:54.447135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2786e85-f3a0-4cfc-b0e6-da1bcdbe6c55 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:54.447430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2786e85-f3a0-4cfc-b0e6-da1bcdbe6c55 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:54.448011 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2786e85-f3a0-4cfc-b0e6-da1bcdbe6c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:54.467948 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:54.470618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b2786e85-f3a0-4cfc-b0e6-da1bcdbe6c55 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:54.472811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b2786e85-f3a0-4cfc-b0e6-da1bcdbe6c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:54.521665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d8b8b-72bc-45c6-a16c-6adf1289559c None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:54.572365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d376e87-62a7-445a-a338-684e32a49d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:54.572365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d376e87-62a7-445a-a338-684e32a49d2f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:54.572365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d376e87-62a7-445a-a338-684e32a49d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:54.572365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d376e87-62a7-445a-a338-684e32a49d2f None admin] PATH_INFO: `/v3/groups/46a2dfefae4c470080e90653900bef6b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:54.572741 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d376e87-62a7-445a-a338-684e32a49d2f None admin] RBAC: Authorizing `identity:get_group(group_id=46a2dfefae4c470080e90653900bef6b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:54.572741 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d376e87-62a7-445a-a338-684e32a49d2f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:54.573087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 214/413] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:54.573633 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 200/414] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Aug 4 10:11:54 2022] GET /identity/v3/groups/46a2dfefae4c470080e90653900bef6b => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:54.574357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2786e85-f3a0-4cfc-b0e6-da1bcdbe6c55 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:54.579008 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d376e87-62a7-445a-a338-684e32a49d2f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:54.665272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:54.712568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2786e85-f3a0-4cfc-b0e6-da1bcdbe6c55 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:54.734381 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d376e87-62a7-445a-a338-684e32a49d2f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:54.758579 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5c523-47e2-4e2f-9a38-bd84a576ad8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:54.759264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5c523-47e2-4e2f-9a38-bd84a576ad8b None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:54.759552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5c523-47e2-4e2f-9a38-bd84a576ad8b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:54.759828 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5c523-47e2-4e2f-9a38-bd84a576ad8b None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39/groups/31431e6befa84fe1a76b88ff2f303c50/roles/472f2455c837486084f108ce944f1bff` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:54.762169 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5c523-47e2-4e2f-9a38-bd84a576ad8b None admin] RBAC: Authorizing `identity:create_grant(project_id=13b307d54e4e48ef84790ab15f5ceb39, group_id=31431e6befa84fe1a76b88ff2f303c50, role_id=472f2455c837486084f108ce944f1bff)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:54.763614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5c523-47e2-4e2f-9a38-bd84a576ad8b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:54.777920 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:54.780962 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 215/415] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Aug 4 10:11:54 2022] PUT /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39/groups/31431e6befa84fe1a76b88ff2f303c50/roles/472f2455c837486084f108ce944f1bff => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:11:54.782132 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5c523-47e2-4e2f-9a38-bd84a576ad8b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:54.808197 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f15ca9-a7fc-44d2-b981-c700e796ed05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:54.808940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f15ca9-a7fc-44d2-b981-c700e796ed05 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:54.809236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f15ca9-a7fc-44d2-b981-c700e796ed05 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:54.809517 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f15ca9-a7fc-44d2-b981-c700e796ed05 None admin] PATH_INFO: `/v3/projects/ed5a4d067698404b8e986636ba77adc9` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:54.814345 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f15ca9-a7fc-44d2-b981-c700e796ed05 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5a4d067698404b8e986636ba77adc9)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:54.816422 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f15ca9-a7fc-44d2-b981-c700e796ed05 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:54.818265 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 201/416] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:54 2022] GET /identity/v3/projects/ed5a4d067698404b8e986636ba77adc9 => generated 344 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:54.824246 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f15ca9-a7fc-44d2-b981-c700e796ed05 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:54.977558 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5c523-47e2-4e2f-9a38-bd84a576ad8b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:55.008016 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:55.019060 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f15ca9-a7fc-44d2-b981-c700e796ed05 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:55.023393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9ea78-b173-4cb1-ba45-2f8f68325eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:55.024061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9ea78-b173-4cb1-ba45-2f8f68325eaf None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:55.024399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9ea78-b173-4cb1-ba45-2f8f68325eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:55.024682 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9ea78-b173-4cb1-ba45-2f8f68325eaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:55.038063 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9ea78-b173-4cb1-ba45-2f8f68325eaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:55.044458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-cfa9ea78-b173-4cb1-ba45-2f8f68325eaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:55.044458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:55.044458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:55.044458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:55.044458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:55.044458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:55.044458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:55.044458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:55.044458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:55.044458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:55.044458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:55.044458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:55.044458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:55.044458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:55.044458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:55.044458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:55.045345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:55.045345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:55.045345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:55.045345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:55.045345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:55.045345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:55.045345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:55.045345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:55.045345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:55.045345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:55.045345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:55.045345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:55.045345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:55.045345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:55.045345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:55.045345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:55.046124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:55.046124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:55.046124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:55.046124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:55.046124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:55.046124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:55.046124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:55.046124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:55.046124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:55.046124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:55.046124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:55.046124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:55.046124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 216/417] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:55.052997 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9ea78-b173-4cb1-ba45-2f8f68325eaf None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:55.064521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a781f0-90cb-4d94-a362-5869cac89191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:55.065917 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a781f0-90cb-4d94-a362-5869cac89191 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:55.066493 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a781f0-90cb-4d94-a362-5869cac89191 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:55.066971 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a781f0-90cb-4d94-a362-5869cac89191 None admin] PATH_INFO: `/v3/projects/ed5a4d067698404b8e986636ba77adc9/groups/46a2dfefae4c470080e90653900bef6b/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:55.071279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a781f0-90cb-4d94-a362-5869cac89191 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed5a4d067698404b8e986636ba77adc9, group_id=46a2dfefae4c470080e90653900bef6b, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:55.073251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a781f0-90cb-4d94-a362-5869cac89191 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:55.088937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 202/418] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Aug 4 10:11:54 2022] PUT /identity/v3/projects/ed5a4d067698404b8e986636ba77adc9/groups/46a2dfefae4c470080e90653900bef6b/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:11:55.200147 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9ea78-b173-4cb1-ba45-2f8f68325eaf None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:55.250415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461d9e8-95d9-4f7c-bafe-b97042014651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:55.250979 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461d9e8-95d9-4f7c-bafe-b97042014651 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:55.251266 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461d9e8-95d9-4f7c-bafe-b97042014651 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:55.251544 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461d9e8-95d9-4f7c-bafe-b97042014651 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:55.252308 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461d9e8-95d9-4f7c-bafe-b97042014651 None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:55.252651 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461d9e8-95d9-4f7c-bafe-b97042014651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:55.254064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461d9e8-95d9-4f7c-bafe-b97042014651 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:55.269180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 217/419] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:55.274660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a781f0-90cb-4d94-a362-5869cac89191 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:55.367028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:55.413251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a781f0-90cb-4d94-a362-5869cac89191 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:55.450875 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b04ab-1078-41f8-982e-ad2de1c14caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:55.451916 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b04ab-1078-41f8-982e-ad2de1c14caa None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:55.452472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b04ab-1078-41f8-982e-ad2de1c14caa None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:55.453272 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b04ab-1078-41f8-982e-ad2de1c14caa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:55.526721 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b04ab-1078-41f8-982e-ad2de1c14caa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:55.528624 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b04ab-1078-41f8-982e-ad2de1c14caa None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:55.586522 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:55.632943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 203/420] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:55.641504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461d9e8-95d9-4f7c-bafe-b97042014651 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:55.667235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f3a24-f544-4f7d-afe2-458743c47e85 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:55.667560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f3a24-f544-4f7d-afe2-458743c47e85 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:55.667802 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f3a24-f544-4f7d-afe2-458743c47e85 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:55.669481 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 204/421] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:11:55.675355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615ff8b-3516-4f0b-9055-b4f5a8f7e432 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:55.675758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615ff8b-3516-4f0b-9055-b4f5a8f7e432 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:55.676139 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615ff8b-3516-4f0b-9055-b4f5a8f7e432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:55.716487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a615ff8b-3516-4f0b-9055-b4f5a8f7e432 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:55.717727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a615ff8b-3516-4f0b-9055-b4f5a8f7e432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:55.739696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:55.808936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461d9e8-95d9-4f7c-bafe-b97042014651 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:55.857979 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6011da-8c4a-41a4-bca9-9c33545eb596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:55.858643 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6011da-8c4a-41a4-bca9-9c33545eb596 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:55.858931 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6011da-8c4a-41a4-bca9-9c33545eb596 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:55.859212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6011da-8c4a-41a4-bca9-9c33545eb596 None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:55.860938 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6011da-8c4a-41a4-bca9-9c33545eb596 None admin] RBAC: Authorizing `identity:get_project(project_id=8c7f15d3ce55460993f520e6f8838a8a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:55.863078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6011da-8c4a-41a4-bca9-9c33545eb596 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:55.865129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 218/422] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:55 2022] GET /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:55.866783 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 205/423] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:55.873235 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6011da-8c4a-41a4-bca9-9c33545eb596 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:55.916204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615ff8b-3516-4f0b-9055-b4f5a8f7e432 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:55.986703 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6011da-8c4a-41a4-bca9-9c33545eb596 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:56.010985 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:56.029984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e06564-588a-41e0-89e1-2c3e323e10ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:56.030651 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e06564-588a-41e0-89e1-2c3e323e10ce None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:56.030937 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e06564-588a-41e0-89e1-2c3e323e10ce None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:56.031753 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e06564-588a-41e0-89e1-2c3e323e10ce None admin] PATH_INFO: `/v3/groups/31431e6befa84fe1a76b88ff2f303c50` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:56.032985 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e06564-588a-41e0-89e1-2c3e323e10ce None admin] RBAC: Authorizing `identity:get_group(group_id=31431e6befa84fe1a76b88ff2f303c50)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:56.034884 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e06564-588a-41e0-89e1-2c3e323e10ce None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:56.037075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 219/424] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Aug 4 10:11:55 2022] GET /identity/v3/groups/31431e6befa84fe1a76b88ff2f303c50 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:56.045293 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e06564-588a-41e0-89e1-2c3e323e10ce None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:56.160608 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:56.169310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e06564-588a-41e0-89e1-2c3e323e10ce None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:56.208884 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d0e73-827b-4e8e-9b80-278cd826fd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:56.209516 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d0e73-827b-4e8e-9b80-278cd826fd0b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:56.209804 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d0e73-827b-4e8e-9b80-278cd826fd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:56.210087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d0e73-827b-4e8e-9b80-278cd826fd0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:56.210892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d0e73-827b-4e8e-9b80-278cd826fd0b None admin] RBAC: Adding query filter params (group.id=31431e6befa84fe1a76b88ff2f303c50, role.id=50575a0d3f4340ee92356ce22ff3e62a, scope.project.id=8c7f15d3ce55460993f520e6f8838a8a) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:56.211213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d0e73-827b-4e8e-9b80-278cd826fd0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:56.212703 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d0e73-827b-4e8e-9b80-278cd826fd0b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:56.215124 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615ff8b-3516-4f0b-9055-b4f5a8f7e432 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:56.219930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 220/425] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Aug 4 10:11:56 2022] GET /identity/v3/role_assignments?group.id=31431e6befa84fe1a76b88ff2f303c50&scope.project.id=8c7f15d3ce55460993f520e6f8838a8a&role.id=50575a0d3f4340ee92356ce22ff3e62a => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:56.259740 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1dbe14-73da-46fa-a6ab-e491cdf701ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:56.260478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1dbe14-73da-46fa-a6ab-e491cdf701ac None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:56.260769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1dbe14-73da-46fa-a6ab-e491cdf701ac None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:56.261069 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1dbe14-73da-46fa-a6ab-e491cdf701ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:56.274159 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1dbe14-73da-46fa-a6ab-e491cdf701ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:56.285560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-3e1dbe14-73da-46fa-a6ab-e491cdf701ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:56.285560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:56.285560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:56.285560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:56.285560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:56.285560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:56.285560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:56.285560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:56.285560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:56.285560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:56.285560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:56.285560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:56.285560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:56.285560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:56.285560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:56.285560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:56.286479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:56.286479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:56.286479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:56.286479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:56.286479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:56.286479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:56.286479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:56.286479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:56.286479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:56.286479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:56.286479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:56.286479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:56.286479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:56.286479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:56.286479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:56.286479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:56.287226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:56.287226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:56.287226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:56.287226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:56.287226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:56.287226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:56.287226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:56.287226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:56.287226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:56.287226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:56.287226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:56.287226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:56.287226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 206/426] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:11:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:11:56.293055 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d0e73-827b-4e8e-9b80-278cd826fd0b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:56.359827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f1b5c-1efd-4d0a-8b06-b8476ea42ca9 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:56.360137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f1b5c-1efd-4d0a-8b06-b8476ea42ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:56.360428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f1b5c-1efd-4d0a-8b06-b8476ea42ca9 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:56.361961 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 207/427] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:56.369385 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:56.381350 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b33e1-cce7-443d-85af-c686d1bfe501 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:56.381679 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b33e1-cce7-443d-85af-c686d1bfe501 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:56.381923 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b33e1-cce7-443d-85af-c686d1bfe501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:56.421978 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a97b33e1-cce7-443d-85af-c686d1bfe501 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:56.423520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a97b33e1-cce7-443d-85af-c686d1bfe501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:56.466096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d0e73-827b-4e8e-9b80-278cd826fd0b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:56.511636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf71c4-9c42-4059-8983-67eb73f06009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:56.512302 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf71c4-9c42-4059-8983-67eb73f06009 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:56.512590 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf71c4-9c42-4059-8983-67eb73f06009 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:56.512869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf71c4-9c42-4059-8983-67eb73f06009 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:56.513589 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf71c4-9c42-4059-8983-67eb73f06009 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:56.513896 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf71c4-9c42-4059-8983-67eb73f06009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:56.518921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf71c4-9c42-4059-8983-67eb73f06009 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:56.528003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 208/428] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:56.528667 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 221/429] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:11:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:56.534282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b33e1-cce7-443d-85af-c686d1bfe501 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:56.557303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf71c4-9c42-4059-8983-67eb73f06009 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:56.645788 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:56.679794 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b33e1-cce7-443d-85af-c686d1bfe501 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:56.721932 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf71c4-9c42-4059-8983-67eb73f06009 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:56.733620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:56.743220 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf5f6f-c474-40f3-bd34-ed480da80612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:56.744485 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf5f6f-c474-40f3-bd34-ed480da80612 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:56.745110 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf5f6f-c474-40f3-bd34-ed480da80612 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:56.745846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf5f6f-c474-40f3-bd34-ed480da80612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:56.768860 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f123bc-5bb6-4087-8000-50a4bc907728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:56.770120 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f123bc-5bb6-4087-8000-50a4bc907728 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:56.770582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f123bc-5bb6-4087-8000-50a4bc907728 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:56.771029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f123bc-5bb6-4087-8000-50a4bc907728 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:56.786165 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f123bc-5bb6-4087-8000-50a4bc907728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:56.793555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-20f123bc-5bb6-4087-8000-50a4bc907728 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:56.793555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:56.793555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:56.793555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:56.793555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:56.793555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:56.793555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:56.793555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:56.793555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:56.793555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:56.793555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:56.793555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:56.793555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:56.793555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:56.793555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:56.793555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:56.794436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:56.794436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:56.794436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:56.794436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:56.794436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:56.794436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:56.794436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:56.794436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:56.794436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:56.794436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:56.794436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:56.794436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:56.794436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:56.794436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:56.794436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:56.794436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:56.795220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:56.795220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:56.795220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:56.795220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:56.795220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:56.795220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:56.795220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:56.795220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:56.795220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:56.795220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:56.795220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 10:11:56.795220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:11:56.797519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 222/430] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:11:56.805394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f123bc-5bb6-4087-8000-50a4bc907728 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:56.834433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf5f6f-c474-40f3-bd34-ed480da80612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:56.836748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf5f6f-c474-40f3-bd34-ed480da80612 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:56.940041 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f123bc-5bb6-4087-8000-50a4bc907728 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:56.942626 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:56.970699 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 209/431] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:56.976542 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf5f6f-c474-40f3-bd34-ed480da80612 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:56.977541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeca5cb-6d3e-42c9-a3b2-cba42366163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:56.978281 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeca5cb-6d3e-42c9-a3b2-cba42366163e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:56.978669 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeca5cb-6d3e-42c9-a3b2-cba42366163e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:56.979048 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeca5cb-6d3e-42c9-a3b2-cba42366163e None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:56.979874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeca5cb-6d3e-42c9-a3b2-cba42366163e None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:56.980312 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeca5cb-6d3e-42c9-a3b2-cba42366163e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:56.981820 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeca5cb-6d3e-42c9-a3b2-cba42366163e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:56.995808 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 223/432] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:11:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:56.997841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeca5cb-6d3e-42c9-a3b2-cba42366163e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:57.031801 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:57.100235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf5f6f-c474-40f3-bd34-ed480da80612 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:57.117534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeca5cb-6d3e-42c9-a3b2-cba42366163e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:57.139148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd7a49-d385-4912-a265-a28bd98299b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:57.140139 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd7a49-d385-4912-a265-a28bd98299b1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:57.140634 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd7a49-d385-4912-a265-a28bd98299b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:57.141066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd7a49-d385-4912-a265-a28bd98299b1 None admin] PATH_INFO: `/v3/projects/8c7f15d3ce55460993f520e6f8838a8a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:57.142517 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd7a49-d385-4912-a265-a28bd98299b1 None admin] RBAC: Authorizing `identity:get_project(project_id=8c7f15d3ce55460993f520e6f8838a8a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:57.144920 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd7a49-d385-4912-a265-a28bd98299b1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:57.147195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 210/433] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:56 2022] GET /identity/v3/projects/8c7f15d3ce55460993f520e6f8838a8a => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:57.152935 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd7a49-d385-4912-a265-a28bd98299b1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:57.158062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004282ca-cbb8-4871-a9d4-8758b3353759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:57.159358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004282ca-cbb8-4871-a9d4-8758b3353759 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:57.159986 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004282ca-cbb8-4871-a9d4-8758b3353759 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:57.160485 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004282ca-cbb8-4871-a9d4-8758b3353759 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:57.207215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:57.237148 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004282ca-cbb8-4871-a9d4-8758b3353759 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:57.238808 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004282ca-cbb8-4871-a9d4-8758b3353759 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:57.273233 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:57.285251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd7a49-d385-4912-a265-a28bd98299b1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:57.327430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f3a08-5d61-472b-b0e8-e5288faa8baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:57.328421 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f3a08-5d61-472b-b0e8-e5288faa8baf None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:57.328875 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f3a08-5d61-472b-b0e8-e5288faa8baf None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:57.329346 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f3a08-5d61-472b-b0e8-e5288faa8baf None admin] PATH_INFO: `/v3/groups/31431e6befa84fe1a76b88ff2f303c50` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:57.331421 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f3a08-5d61-472b-b0e8-e5288faa8baf None admin] RBAC: Authorizing `identity:get_group(group_id=31431e6befa84fe1a76b88ff2f303c50)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:57.333162 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f3a08-5d61-472b-b0e8-e5288faa8baf None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:57.335072 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 211/434] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Aug 4 10:11:57 2022] GET /identity/v3/groups/31431e6befa84fe1a76b88ff2f303c50 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:57.340999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f3a08-5d61-472b-b0e8-e5288faa8baf None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:57.357062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 224/435] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:57.358410 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004282ca-cbb8-4871-a9d4-8758b3353759 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:57.454555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f3a08-5d61-472b-b0e8-e5288faa8baf None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:57.470760 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:57.474650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004282ca-cbb8-4871-a9d4-8758b3353759 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:57.493956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20034b14-b668-4b0e-b524-7045d5f15020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:57.494607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20034b14-b668-4b0e-b524-7045d5f15020 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:57.494885 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20034b14-b668-4b0e-b524-7045d5f15020 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:57.495165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20034b14-b668-4b0e-b524-7045d5f15020 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:57.495959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20034b14-b668-4b0e-b524-7045d5f15020 None admin] RBAC: Adding query filter params (group.id=31431e6befa84fe1a76b88ff2f303c50, role.id=472f2455c837486084f108ce944f1bff, scope.project.id=8c7f15d3ce55460993f520e6f8838a8a) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:57.496299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20034b14-b668-4b0e-b524-7045d5f15020 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:57.497732 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20034b14-b668-4b0e-b524-7045d5f15020 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:57.504555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 212/436] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Aug 4 10:11:57 2022] GET /identity/v3/role_assignments?group.id=31431e6befa84fe1a76b88ff2f303c50&scope.project.id=8c7f15d3ce55460993f520e6f8838a8a&role.id=472f2455c837486084f108ce944f1bff => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:57.505697 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff459602-0729-4669-95e0-3c5a829f902e None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:57.505990 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff459602-0729-4669-95e0-3c5a829f902e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:57.506268 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff459602-0729-4669-95e0-3c5a829f902e None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:57.507624 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 213/437] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:57.513122 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:57.513317 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b7307-61ae-404f-b9c1-6f795ebb0167 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:57.513557 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b7307-61ae-404f-b9c1-6f795ebb0167 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:57.513836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b7307-61ae-404f-b9c1-6f795ebb0167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:57.522195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cb7aa-73e6-4405-a8ff-9fd4e63b79cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:57.524411 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cb7aa-73e6-4405-a8ff-9fd4e63b79cf None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:57.524946 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cb7aa-73e6-4405-a8ff-9fd4e63b79cf None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:57.525455 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cb7aa-73e6-4405-a8ff-9fd4e63b79cf None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:57.527049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cb7aa-73e6-4405-a8ff-9fd4e63b79cf None admin] RBAC: Authorizing `identity:get_project(project_id=13b307d54e4e48ef84790ab15f5ceb39)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:57.528965 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cb7aa-73e6-4405-a8ff-9fd4e63b79cf None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:57.532601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 225/438] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:57 2022] GET /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:57.539837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cb7aa-73e6-4405-a8ff-9fd4e63b79cf None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:57.540648 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-823b7307-61ae-404f-b9c1-6f795ebb0167 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:57.541964 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-823b7307-61ae-404f-b9c1-6f795ebb0167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:57.631461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 214/439] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:11:57.651067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b7307-61ae-404f-b9c1-6f795ebb0167 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:57.661483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cb7aa-73e6-4405-a8ff-9fd4e63b79cf None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:57.699371 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e33ae-c0d0-4650-b7aa-519309f4b151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:57.700025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e33ae-c0d0-4650-b7aa-519309f4b151 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:57.700338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e33ae-c0d0-4650-b7aa-519309f4b151 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:57.700797 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e33ae-c0d0-4650-b7aa-519309f4b151 None admin] PATH_INFO: `/v3/groups/31431e6befa84fe1a76b88ff2f303c50` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:57.701782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e33ae-c0d0-4650-b7aa-519309f4b151 None admin] RBAC: Authorizing `identity:get_group(group_id=31431e6befa84fe1a76b88ff2f303c50)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:57.703242 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e33ae-c0d0-4650-b7aa-519309f4b151 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:57.705238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 226/440] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Aug 4 10:11:57 2022] GET /identity/v3/groups/31431e6befa84fe1a76b88ff2f303c50 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:57.707480 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8537e-097c-49d7-ac9a-8f8384ebbd7c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:57.707766 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8537e-097c-49d7-ac9a-8f8384ebbd7c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:57.708042 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8537e-097c-49d7-ac9a-8f8384ebbd7c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:57.709349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 227/441] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:11:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:11:57.713046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8537e-097c-49d7-ac9a-8f8384ebbd7c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:57.773818 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b7307-61ae-404f-b9c1-6f795ebb0167 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:57.781480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:57.798002 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:57.817999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e918acc-dc57-407c-9e0c-474f60c2ef5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:57.818936 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e918acc-dc57-407c-9e0c-474f60c2ef5c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:57.819284 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e918acc-dc57-407c-9e0c-474f60c2ef5c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:57.819621 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e918acc-dc57-407c-9e0c-474f60c2ef5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:57.833445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e918acc-dc57-407c-9e0c-474f60c2ef5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:57.838488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-4e918acc-dc57-407c-9e0c-474f60c2ef5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:57.838488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:57.838488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:57.838488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:57.838488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:57.838488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:57.838488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:57.838488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:57.838488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:57.838488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:57.838488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:57.838488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:57.838488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:57.838488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:57.838488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:57.838488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:57.839401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:57.839401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:57.839401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:57.839401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:57.839401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:57.839401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:57.839401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:57.839401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:57.839401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:57.839401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:57.839401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:57.839401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:57.839401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:57.839401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:57.839401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:57.839401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:57.840182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:57.840182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:57.840182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:57.840182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:57.840182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:57.840182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:57.840182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:57.840182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:57.840182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:57.840182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:57.840182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:11:57.840182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:57.840182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 215/442] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:11:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:11:57.841342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d67e72-9237-487f-9134-658c72b05c4d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:57.841342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d67e72-9237-487f-9134-658c72b05c4d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:57.841497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d67e72-9237-487f-9134-658c72b05c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:57.856648 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8537e-097c-49d7-ac9a-8f8384ebbd7c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:57.861774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a1d67e72-9237-487f-9134-658c72b05c4d None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:11:57.863559 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a1d67e72-9237-487f-9134-658c72b05c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:11:57.901380 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dbf83-3146-4e0a-9af6-2e0c1529fb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:57.902032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dbf83-3146-4e0a-9af6-2e0c1529fb85 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:57.902314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dbf83-3146-4e0a-9af6-2e0c1529fb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:57.902589 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dbf83-3146-4e0a-9af6-2e0c1529fb85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:57.903379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78dbf83-3146-4e0a-9af6-2e0c1529fb85 None admin] RBAC: Adding query filter params (group.id=31431e6befa84fe1a76b88ff2f303c50, role.id=50575a0d3f4340ee92356ce22ff3e62a, scope.project.id=13b307d54e4e48ef84790ab15f5ceb39) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:57.903693 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78dbf83-3146-4e0a-9af6-2e0c1529fb85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:57.905183 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78dbf83-3146-4e0a-9af6-2e0c1529fb85 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:57.911740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 228/443] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Aug 4 10:11:57 2022] GET /identity/v3/role_assignments?group.id=31431e6befa84fe1a76b88ff2f303c50&scope.project.id=13b307d54e4e48ef84790ab15f5ceb39&role.id=50575a0d3f4340ee92356ce22ff3e62a => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:57.912567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dbf83-3146-4e0a-9af6-2e0c1529fb85 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:57.944397 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 216/444] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:11:57.967249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d67e72-9237-487f-9134-658c72b05c4d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:58.044503 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dbf83-3146-4e0a-9af6-2e0c1529fb85 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:58.079293 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:58.084018 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:58.087817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3b54a-19b3-495a-8631-55ed76ba562e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:58.088245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b54a-19b3-495a-8631-55ed76ba562e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:58.088515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b54a-19b3-495a-8631-55ed76ba562e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:58.088795 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b54a-19b3-495a-8631-55ed76ba562e None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:58.089739 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3b54a-19b3-495a-8631-55ed76ba562e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:58.089841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3b54a-19b3-495a-8631-55ed76ba562e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:58.091342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3b54a-19b3-495a-8631-55ed76ba562e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:58.091442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d67e72-9237-487f-9134-658c72b05c4d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:58.104076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 229/445] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:11:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:58.109756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3b54a-19b3-495a-8631-55ed76ba562e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:58.132807 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f51a25-9daf-471a-aa60-bb73bf9f9b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:58.133449 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f51a25-9daf-471a-aa60-bb73bf9f9b18 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:58.133735 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f51a25-9daf-471a-aa60-bb73bf9f9b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:58.134008 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f51a25-9daf-471a-aa60-bb73bf9f9b18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:58.146125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f51a25-9daf-471a-aa60-bb73bf9f9b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:11:58.151554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-e7f51a25-9daf-471a-aa60-bb73bf9f9b18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:58.151554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:11:58.151554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:11:58.151554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:11:58.151554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:11:58.151554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:11:58.151554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:11:58.151554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:11:58.151554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:11:58.151554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:11:58.151554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:11:58.151554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:11:58.151554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:11:58.151554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:11:58.151554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:11:58.151554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:11:58.152450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:11:58.152450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:11:58.152450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:11:58.152450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:11:58.152450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:11:58.152450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:11:58.152450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:11:58.152450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:11:58.152450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:11:58.152450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:11:58.152450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:11:58.152450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:11:58.152450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:11:58.152450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:11:58.152450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:11:58.152450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:11:58.153238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:11:58.153238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:11:58.153238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:11:58.153238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:11:58.153238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:11:58.153238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:11:58.153238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:11:58.153238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:11:58.153238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:11:58.153238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:11:58.153238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:11:58.153238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:11:58.155564 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 217/446] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:11:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:11:58.160565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f51a25-9daf-471a-aa60-bb73bf9f9b18 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:58.243996 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3b54a-19b3-495a-8631-55ed76ba562e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:58.279062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f51a25-9daf-471a-aa60-bb73bf9f9b18 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:58.282978 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb50b9-9c45-4904-bacd-ff66f57edafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:58.285004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb50b9-9c45-4904-bacd-ff66f57edafc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:58.285286 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb50b9-9c45-4904-bacd-ff66f57edafc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:58.285558 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb50b9-9c45-4904-bacd-ff66f57edafc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:58.316596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2c930-9fc9-4359-ba95-6f442fe8cf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:58.317219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2c930-9fc9-4359-ba95-6f442fe8cf91 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:58.317501 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2c930-9fc9-4359-ba95-6f442fe8cf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:58.317778 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2c930-9fc9-4359-ba95-6f442fe8cf91 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:58.318497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2c930-9fc9-4359-ba95-6f442fe8cf91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:58.318804 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2c930-9fc9-4359-ba95-6f442fe8cf91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:58.320200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2c930-9fc9-4359-ba95-6f442fe8cf91 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:58.328592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 218/447] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:11:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:58.334234 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2c930-9fc9-4359-ba95-6f442fe8cf91 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:58.344292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:58.354199 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:58.354860 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb50b9-9c45-4904-bacd-ff66f57edafc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:58.356628 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb50b9-9c45-4904-bacd-ff66f57edafc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:58.441022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2c930-9fc9-4359-ba95-6f442fe8cf91 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:58.480772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304a0b6-f0b1-4103-9c38-cfd71721cc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:58.481395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304a0b6-f0b1-4103-9c38-cfd71721cc7e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:58.484273 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304a0b6-f0b1-4103-9c38-cfd71721cc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:58.484273 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304a0b6-f0b1-4103-9c38-cfd71721cc7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:58.486125 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 230/448] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:58.487131 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb50b9-9c45-4904-bacd-ff66f57edafc None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:58.567426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304a0b6-f0b1-4103-9c38-cfd71721cc7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:58.568847 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304a0b6-f0b1-4103-9c38-cfd71721cc7e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:58.588857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:58.592985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:58.599638 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb50b9-9c45-4904-bacd-ff66f57edafc None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:58.636608 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ffb15-1f83-4456-b4c1-7227a1bed274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:58.637267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ffb15-1f83-4456-b4c1-7227a1bed274 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:58.637556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ffb15-1f83-4456-b4c1-7227a1bed274 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:58.637835 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ffb15-1f83-4456-b4c1-7227a1bed274 None admin] PATH_INFO: `/v3/projects/13b307d54e4e48ef84790ab15f5ceb39` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:58.639033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ffb15-1f83-4456-b4c1-7227a1bed274 None admin] RBAC: Authorizing `identity:get_project(project_id=13b307d54e4e48ef84790ab15f5ceb39)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:58.640560 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ffb15-1f83-4456-b4c1-7227a1bed274 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:58.642434 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 231/449] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:58 2022] GET /identity/v3/projects/13b307d54e4e48ef84790ab15f5ceb39 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:58.648551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ffb15-1f83-4456-b4c1-7227a1bed274 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:58.697177 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 219/450] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:11:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:11:58.702613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304a0b6-f0b1-4103-9c38-cfd71721cc7e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:58.764223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ffb15-1f83-4456-b4c1-7227a1bed274 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:58.799422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce764ac0-18ef-4bda-8656-bf964aa4c388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:58.800843 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce764ac0-18ef-4bda-8656-bf964aa4c388 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:58.801244 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce764ac0-18ef-4bda-8656-bf964aa4c388 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:58.801550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce764ac0-18ef-4bda-8656-bf964aa4c388 None admin] PATH_INFO: `/v3/groups/31431e6befa84fe1a76b88ff2f303c50` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:58.802980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce764ac0-18ef-4bda-8656-bf964aa4c388 None admin] RBAC: Authorizing `identity:get_group(group_id=31431e6befa84fe1a76b88ff2f303c50)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:58.804667 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce764ac0-18ef-4bda-8656-bf964aa4c388 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:58.806811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 232/451] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Aug 4 10:11:58 2022] GET /identity/v3/groups/31431e6befa84fe1a76b88ff2f303c50 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:58.815783 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce764ac0-18ef-4bda-8656-bf964aa4c388 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:58.819631 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304a0b6-f0b1-4103-9c38-cfd71721cc7e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:58.841814 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:58.851171 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:58.861332 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402980b-5864-4043-8f60-58de99e423f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:58.862618 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402980b-5864-4043-8f60-58de99e423f1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:58.862905 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402980b-5864-4043-8f60-58de99e423f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:58.863188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402980b-5864-4043-8f60-58de99e423f1 None admin] PATH_INFO: `/v3/projects/ed5a4d067698404b8e986636ba77adc9` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:58.864418 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402980b-5864-4043-8f60-58de99e423f1 None admin] RBAC: Authorizing `identity:get_project(project_id=ed5a4d067698404b8e986636ba77adc9)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:58.865881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402980b-5864-4043-8f60-58de99e423f1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:58.867557 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 220/452] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:11:58 2022] GET /identity/v3/projects/ed5a4d067698404b8e986636ba77adc9 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:58.872952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402980b-5864-4043-8f60-58de99e423f1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:58.923320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce764ac0-18ef-4bda-8656-bf964aa4c388 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:58.957142 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e34750-5dc7-4ca9-809d-838bc107bf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:58.957760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e34750-5dc7-4ca9-809d-838bc107bf79 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:58.958045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e34750-5dc7-4ca9-809d-838bc107bf79 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:58.958325 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e34750-5dc7-4ca9-809d-838bc107bf79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:58.959118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e34750-5dc7-4ca9-809d-838bc107bf79 None admin] RBAC: Adding query filter params (group.id=31431e6befa84fe1a76b88ff2f303c50, role.id=472f2455c837486084f108ce944f1bff, scope.project.id=13b307d54e4e48ef84790ab15f5ceb39) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:58.959427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e34750-5dc7-4ca9-809d-838bc107bf79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:58.960909 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e34750-5dc7-4ca9-809d-838bc107bf79 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:58.966635 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 233/453] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Aug 4 10:11:58 2022] GET /identity/v3/role_assignments?group.id=31431e6befa84fe1a76b88ff2f303c50&scope.project.id=13b307d54e4e48ef84790ab15f5ceb39&role.id=472f2455c837486084f108ce944f1bff => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:11:58.971940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402980b-5864-4043-8f60-58de99e423f1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:59.010061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33585300-b3ed-4dc6-9839-f08a301b41b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:59.010724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33585300-b3ed-4dc6-9839-f08a301b41b9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:59.011003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33585300-b3ed-4dc6-9839-f08a301b41b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:59.011280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33585300-b3ed-4dc6-9839-f08a301b41b9 None admin] PATH_INFO: `/v3/groups/46a2dfefae4c470080e90653900bef6b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:59.012582 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33585300-b3ed-4dc6-9839-f08a301b41b9 None admin] RBAC: Authorizing `identity:get_group(group_id=46a2dfefae4c470080e90653900bef6b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:59.014086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33585300-b3ed-4dc6-9839-f08a301b41b9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:59.015816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 221/454] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Aug 4 10:11:58 2022] GET /identity/v3/groups/46a2dfefae4c470080e90653900bef6b => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:11:59.023138 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e34750-5dc7-4ca9-809d-838bc107bf79 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:11:59.121171 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:11:59.130949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e34750-5dc7-4ca9-809d-838bc107bf79 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:11:59.165549 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf6dcf-ecd2-41cf-8d94-909fb98ab64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:11:59.166184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf6dcf-ecd2-41cf-8d94-909fb98ab64e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:11:59.166462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf6dcf-ecd2-41cf-8d94-909fb98ab64e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:11:59.166741 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf6dcf-ecd2-41cf-8d94-909fb98ab64e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:11:59.167531 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf6dcf-ecd2-41cf-8d94-909fb98ab64e None admin] RBAC: Adding query filter params (group.id=46a2dfefae4c470080e90653900bef6b, role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.project.id=ed5a4d067698404b8e986636ba77adc9) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:11:59.167847 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf6dcf-ecd2-41cf-8d94-909fb98ab64e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:11:59.169303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf6dcf-ecd2-41cf-8d94-909fb98ab64e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:11:59.175296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 234/455] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Aug 4 10:11:59 2022] GET /identity/v3/role_assignments?group.id=46a2dfefae4c470080e90653900bef6b&scope.project.id=ed5a4d067698404b8e986636ba77adc9&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:01.788273 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf277f5-122a-4b17-bae3-0af4591380d1 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:01.789295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf277f5-122a-4b17-bae3-0af4591380d1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:01.789807 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf277f5-122a-4b17-bae3-0af4591380d1 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:01.791899 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 222/456] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:01.797126 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfacc3d-a5de-48f5-84e2-be6de02dfec0 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:01.798070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfacc3d-a5de-48f5-84e2-be6de02dfec0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:01.798587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfacc3d-a5de-48f5-84e2-be6de02dfec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:01.829243 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5cfacc3d-a5de-48f5-84e2-be6de02dfec0 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:01.830503 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5cfacc3d-a5de-48f5-84e2-be6de02dfec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:01.918108 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 235/457] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:01.970285 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf277f5-122a-4b17-bae3-0af4591380d1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:02.064075 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:02.128652 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf277f5-122a-4b17-bae3-0af4591380d1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:02.188554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a189d-adfb-46b9-b7a0-68768628390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:02.189540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a189d-adfb-46b9-b7a0-68768628390f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:02.190084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a189d-adfb-46b9-b7a0-68768628390f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:02.190586 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a189d-adfb-46b9-b7a0-68768628390f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:02.207557 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a189d-adfb-46b9-b7a0-68768628390f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:02.209705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a189d-adfb-46b9-b7a0-68768628390f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:02.239315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-c13a189d-adfb-46b9-b7a0-68768628390f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:02.239315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:02.239315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:02.239315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:02.239315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:02.239315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:02.239315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:02.239315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:02.239315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:02.239315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:02.239315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:02.239315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:02.239315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:02.239315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:02.239315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:02.240466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:02.240466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:02.240466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:02.240466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:02.240466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:02.240466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:02.240466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:02.240466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:02.240466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:02.240466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:02.240466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:02.240466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:02.240466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:02.240466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:02.240466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:02.240466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:02.240466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:02.241494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:02.241494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:02.241494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:02.241494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:02.243642 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 223/458] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:02.252692 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfacc3d-a5de-48f5-84e2-be6de02dfec0 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:02.255370 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680eb95-e10c-447f-bc8d-3f7bfc4e69e9 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:02.255951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680eb95-e10c-447f-bc8d-3f7bfc4e69e9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:02.256576 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680eb95-e10c-447f-bc8d-3f7bfc4e69e9 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:02.258599 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 224/459] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:12:02.265333 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e311c5-bef7-4f7e-8926-3dced2594d80 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:02.265867 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e311c5-bef7-4f7e-8926-3dced2594d80 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:02.266333 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e311c5-bef7-4f7e-8926-3dced2594d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:02.298367 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d3e311c5-bef7-4f7e-8926-3dced2594d80 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:02.300591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d3e311c5-bef7-4f7e-8926-3dced2594d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:02.495292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:02.524036 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfacc3d-a5de-48f5-84e2-be6de02dfec0 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:02.529292 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 225/460] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:12:02.593646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e311c5-bef7-4f7e-8926-3dced2594d80 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:02.593933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671283f-fa40-48b0-b783-02b545be9703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:02.594704 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671283f-fa40-48b0-b783-02b545be9703 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:02.595176 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671283f-fa40-48b0-b783-02b545be9703 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:02.595648 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671283f-fa40-48b0-b783-02b545be9703 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:02.597538 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671283f-fa40-48b0-b783-02b545be9703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:02.598075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671283f-fa40-48b0-b783-02b545be9703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:02.608197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671283f-fa40-48b0-b783-02b545be9703 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:02.623304 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 236/461] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:02.631775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671283f-fa40-48b0-b783-02b545be9703 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:02.684796 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:02.768873 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e311c5-bef7-4f7e-8926-3dced2594d80 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:02.814684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76318d2-961f-4f49-ba57-e5f7d6451a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:02.815766 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76318d2-961f-4f49-ba57-e5f7d6451a05 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:02.816392 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76318d2-961f-4f49-ba57-e5f7d6451a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:02.816950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76318d2-961f-4f49-ba57-e5f7d6451a05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:02.820035 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671283f-fa40-48b0-b783-02b545be9703 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:02.832213 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76318d2-961f-4f49-ba57-e5f7d6451a05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:02.834414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76318d2-961f-4f49-ba57-e5f7d6451a05 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:02.855833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-a76318d2-961f-4f49-ba57-e5f7d6451a05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:02.855833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:02.855833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:02.855833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:02.855833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:02.855833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:02.855833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:02.855833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:02.855833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:02.855833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:02.855833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:02.855833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:02.855833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:02.855833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:02.855833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:02.857256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:02.857256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:02.857256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:02.857256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:02.857256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:02.857256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:02.857256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:02.857256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:02.857256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:02.857256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:02.857256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:02.857256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:02.857256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:02.857256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:02.857256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:02.857256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:02.857256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:02.858713 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:02.858713 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:02.858713 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:02.858713 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:02.860998 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 226/462] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:02.863161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e832d3a-1276-4004-be91-4fade32dbee7 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:02.863849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e832d3a-1276-4004-be91-4fade32dbee7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:02.864590 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e832d3a-1276-4004-be91-4fade32dbee7 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:02.871013 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 227/463] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:02.872223 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e832d3a-1276-4004-be91-4fade32dbee7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:02.887943 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627deb5-1229-47b9-8d96-1e4ae85cea75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:02.889160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627deb5-1229-47b9-8d96-1e4ae85cea75 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:02.889740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627deb5-1229-47b9-8d96-1e4ae85cea75 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:02.890530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627deb5-1229-47b9-8d96-1e4ae85cea75 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:02.892016 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627deb5-1229-47b9-8d96-1e4ae85cea75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:02.895537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627deb5-1229-47b9-8d96-1e4ae85cea75 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:02.931978 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 237/464] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Aug 4 10:12:02 2022] POST /identity/v3/users => generated 246 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:12:02.934755 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54253b3e-3ef3-4e57-a098-0f54e2d5d969 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:02.935496 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54253b3e-3ef3-4e57-a098-0f54e2d5d969 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:02.936546 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54253b3e-3ef3-4e57-a098-0f54e2d5d969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:02.947679 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:02.974110 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-54253b3e-3ef3-4e57-a098-0f54e2d5d969 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:02.976461 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-54253b3e-3ef3-4e57-a098-0f54e2d5d969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:02.978768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:02.997022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e832d3a-1276-4004-be91-4fade32dbee7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:03.045816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fd81f-6838-4fb3-83fd-bcbd774da16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:03.046506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fd81f-6838-4fb3-83fd-bcbd774da16e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:03.046864 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fd81f-6838-4fb3-83fd-bcbd774da16e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:03.047222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fd81f-6838-4fb3-83fd-bcbd774da16e None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:03.048119 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fd81f-6838-4fb3-83fd-bcbd774da16e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:03.048550 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fd81f-6838-4fb3-83fd-bcbd774da16e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:03.050783 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fd81f-6838-4fb3-83fd-bcbd774da16e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:03.073646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 228/465] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:03.082908 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fd81f-6838-4fb3-83fd-bcbd774da16e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:03.103180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 238/466] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:03.202029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54253b3e-3ef3-4e57-a098-0f54e2d5d969 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:03.238142 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fd81f-6838-4fb3-83fd-bcbd774da16e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:03.279740 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e2d17-1499-4d1b-898c-5cf326a83a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:03.280400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e2d17-1499-4d1b-898c-5cf326a83a13 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:03.280684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e2d17-1499-4d1b-898c-5cf326a83a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:03.280959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e2d17-1499-4d1b-898c-5cf326a83a13 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:03.281919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e2d17-1499-4d1b-898c-5cf326a83a13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:03.283210 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e2d17-1499-4d1b-898c-5cf326a83a13 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:03.310638 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 229/467] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Aug 4 10:12:03 2022] POST /identity/v3/users => generated 248 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:12:03.401010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da2a6c-8358-4328-a541-2ce03e12f8e2 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:03.401812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da2a6c-8358-4328-a541-2ce03e12f8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:03.402134 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da2a6c-8358-4328-a541-2ce03e12f8e2 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:03.403976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 230/468] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:03.411104 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94ba42-72b0-41ac-9fc6-8bc7cdf5d810 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:03.411593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94ba42-72b0-41ac-9fc6-8bc7cdf5d810 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:03.411937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94ba42-72b0-41ac-9fc6-8bc7cdf5d810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:03.419652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54253b3e-3ef3-4e57-a098-0f54e2d5d969 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:03.421187 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:03.437672 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-be94ba42-72b0-41ac-9fc6-8bc7cdf5d810 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:03.439249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-be94ba42-72b0-41ac-9fc6-8bc7cdf5d810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:03.475347 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:03.483314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecb316-c7d1-4d3c-8158-7659a21c1867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:03.484676 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecb316-c7d1-4d3c-8158-7659a21c1867 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:03.485331 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecb316-c7d1-4d3c-8158-7659a21c1867 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:03.485934 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecb316-c7d1-4d3c-8158-7659a21c1867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:03.506164 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecb316-c7d1-4d3c-8158-7659a21c1867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:03.508990 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecb316-c7d1-4d3c-8158-7659a21c1867 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:03.527606 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 231/469] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:12:03.537188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-53ecb316-c7d1-4d3c-8158-7659a21c1867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:03.537188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:03.537188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:03.537188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:03.537188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:03.537188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:03.537188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:03.537188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:03.537188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:03.537188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:03.537188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:03.537188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:03.537188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:03.537188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:03.537188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:03.538998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:03.538998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:03.538998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:03.538998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:03.538998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:03.538998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:03.538998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:03.538998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:03.538998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:03.538998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:03.538998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:03.538998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:03.538998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:03.538998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:03.538998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:03.538998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:03.538998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:03.540942 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:03.540942 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:03.540942 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:03.540942 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:03.544066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 239/470] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:03.550142 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94ba42-72b0-41ac-9fc6-8bc7cdf5d810 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:03.575049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecb316-c7d1-4d3c-8158-7659a21c1867 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:03.725175 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94ba42-72b0-41ac-9fc6-8bc7cdf5d810 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:03.763276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecb316-c7d1-4d3c-8158-7659a21c1867 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:03.785270 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d923e-6320-4dcd-9e11-d6c12ba6e633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:03.786358 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d923e-6320-4dcd-9e11-d6c12ba6e633 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:03.787010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d923e-6320-4dcd-9e11-d6c12ba6e633 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:03.787569 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d923e-6320-4dcd-9e11-d6c12ba6e633 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:03.789135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d923e-6320-4dcd-9e11-d6c12ba6e633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:03.789801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d923e-6320-4dcd-9e11-d6c12ba6e633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:03.792317 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d923e-6320-4dcd-9e11-d6c12ba6e633 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:03.805432 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:03.815663 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 232/471] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:03.818086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56e22d-0c29-49b3-a0bb-6a431ff864e8 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:03.818689 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56e22d-0c29-49b3-a0bb-6a431ff864e8 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:03.819283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56e22d-0c29-49b3-a0bb-6a431ff864e8 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:03.827478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 233/472] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:03.827478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56e22d-0c29-49b3-a0bb-6a431ff864e8 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:03.834219 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6bdfc-95ea-4955-9da8-e45ceb1fe460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:03.836068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6bdfc-95ea-4955-9da8-e45ceb1fe460 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:03.836777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6bdfc-95ea-4955-9da8-e45ceb1fe460 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:03.837438 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6bdfc-95ea-4955-9da8-e45ceb1fe460 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:03.859062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6bdfc-95ea-4955-9da8-e45ceb1fe460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:03.863014 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6bdfc-95ea-4955-9da8-e45ceb1fe460 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:03.893099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-45d6bdfc-95ea-4955-9da8-e45ceb1fe460 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:03.893099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:03.893099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:03.893099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:03.893099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:03.893099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:03.893099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:03.893099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:03.893099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:03.893099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:03.893099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:03.893099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:03.893099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:03.893099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:03.893099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:03.895066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:03.895066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:03.895066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:03.895066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:03.895066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:03.895066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:03.895066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:03.895066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:03.895066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:03.895066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:03.895066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:03.895066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:03.895066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:03.895066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:03.895066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:03.895066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:03.895066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:03.896910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:03.896910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:03.896910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:03.896910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:03.900790 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 240/473] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:03.903988 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5b795-07a8-4b0e-8aeb-02347c2217a4 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:03.904747 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5b795-07a8-4b0e-8aeb-02347c2217a4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:03.905725 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5b795-07a8-4b0e-8aeb-02347c2217a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:03.942848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-92b5b795-07a8-4b0e-8aeb-02347c2217a4 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:03.945374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-92b5b795-07a8-4b0e-8aeb-02347c2217a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:04.001570 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:04.005582 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56e22d-0c29-49b3-a0bb-6a431ff864e8 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:04.060331 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 241/474] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:04.060331 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5b795-07a8-4b0e-8aeb-02347c2217a4 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:04.086930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419d359-5d40-4c03-b00c-dbc096a5c23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:04.087868 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419d359-5d40-4c03-b00c-dbc096a5c23c None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:04.088387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419d359-5d40-4c03-b00c-dbc096a5c23c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:04.088883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419d359-5d40-4c03-b00c-dbc096a5c23c None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:04.090112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419d359-5d40-4c03-b00c-dbc096a5c23c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:04.092776 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419d359-5d40-4c03-b00c-dbc096a5c23c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:04.133298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 234/475] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Aug 4 10:12:03 2022] POST /identity/v3/users => generated 248 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:12:04.134922 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419d359-5d40-4c03-b00c-dbc096a5c23c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:04.191547 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5b795-07a8-4b0e-8aeb-02347c2217a4 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:04.236815 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:04.254331 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d87bc1-9247-4108-8246-4249a1d0ddab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:04.255400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d87bc1-9247-4108-8246-4249a1d0ddab None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:04.255903 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d87bc1-9247-4108-8246-4249a1d0ddab None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:04.256523 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d87bc1-9247-4108-8246-4249a1d0ddab None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:04.257542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d87bc1-9247-4108-8246-4249a1d0ddab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:04.258076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d87bc1-9247-4108-8246-4249a1d0ddab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:04.260826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d87bc1-9247-4108-8246-4249a1d0ddab None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:04.274657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 242/476] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:04.284423 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d87bc1-9247-4108-8246-4249a1d0ddab None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:04.332976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419d359-5d40-4c03-b00c-dbc096a5c23c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:04.348062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:04.391041 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142619c-18af-4d9c-b481-cef2778299b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:04.392161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142619c-18af-4d9c-b481-cef2778299b7 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:04.392642 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142619c-18af-4d9c-b481-cef2778299b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:04.393720 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142619c-18af-4d9c-b481-cef2778299b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:04.394989 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142619c-18af-4d9c-b481-cef2778299b7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:04.398700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142619c-18af-4d9c-b481-cef2778299b7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:04.412055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.sql.core [None req-a142619c-18af-4d9c-b481-cef2778299b7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 10:12:04.412055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 10:12:04.412055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [parameters: {'id': 'eac44536118a406e99edf6ceb738680a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 10:12:04.412055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80116) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 10:12:04.441206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d87bc1-9247-4108-8246-4249a1d0ddab None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:04.444757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-a142619c-18af-4d9c-b481-cef2778299b7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 10:12:04.444757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:04.444757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 10:12:04.444757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 10:12:04.444757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 10:12:04.444757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 10:12:04.444757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 10:12:04.444757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 10:12:04.444757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 10:12:04.444757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application conn.query(q) Aug 04 10:12:04.444757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 10:12:04.444757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 10:12:04.444757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 10:12:04.444757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result.read() Aug 04 10:12:04.444757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 10:12:04.445585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 10:12:04.445585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 10:12:04.445585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 10:12:04.445585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 10:12:04.445585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 10:12:04.445585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 10:12:04.445585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 10:12:04.445585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 10:12:04.445585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:04.445585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 10:12:04.445585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:04.445585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:04.445585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 10:12:04.445585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 10:12:04.445585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 04 10:12:04.445585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return ref.to_dict() Aug 04 10:12:04.445585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 10:12:04.445585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application next(self.gen) Aug 04 10:12:04.446463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 10:12:04.446463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application yield resource Aug 04 10:12:04.446463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 10:12:04.446463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application next(self.gen) Aug 04 10:12:04.446463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 10:12:04.446463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 10:12:04.446463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 10:12:04.446463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 10:12:04.446463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 10:12:04.446463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise self.value Aug 04 10:12:04.446463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 10:12:04.446463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 10:12:04.446463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 10:12:04.446463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application session.commit() Aug 04 10:12:04.446463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 10:12:04.446463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 10:12:04.446463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 10:12:04.447309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 10:12:04.447309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 10:12:04.447309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.session.flush() Aug 04 10:12:04.447309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 10:12:04.447309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 10:12:04.447309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 10:12:04.447309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 10:12:04.447309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 10:12:04.447309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application compat.raise_( Aug 04 10:12:04.447309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 10:12:04.447309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception Aug 04 10:12:04.447309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 10:12:04.447309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 10:12:04.447309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 10:12:04.447309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 10:12:04.447309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 10:12:04.447309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 10:12:04.448343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 10:12:04.448343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 10:12:04.448343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 10:12:04.448343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 10:12:04.448343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 10:12:04.448343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 10:12:04.448343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 10:12:04.448343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 10:12:04.448343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 10:12:04.448343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 10:12:04.448343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 10:12:04.448343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 10:12:04.448343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 10:12:04.448343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 10:12:04.448343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 10:12:04.448343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception Aug 04 10:12:04.449195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 10:12:04.449195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 10:12:04.449195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 10:12:04.449195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 10:12:04.449195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 10:12:04.449195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 10:12:04.449195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 10:12:04.449195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application conn.query(q) Aug 04 10:12:04.449195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 10:12:04.449195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 10:12:04.449195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 10:12:04.449195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result.read() Aug 04 10:12:04.449195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 10:12:04.449195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 10:12:04.449195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 10:12:04.449195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 10:12:04.450122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 10:12:04.450122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 10:12:04.450122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 10:12:04.450122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 10:12:04.450122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 10:12:04.450122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 10:12:04.450122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [parameters: {'id': 'eac44536118a406e99edf6ceb738680a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 10:12:04.450122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 10:12:04.450122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:04.450122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:04.450122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:04.450122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:04.450122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:04.450122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:04.450122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:04.450122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:04.450995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:04.450995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:04.450995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:04.450995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:04.450995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:04.450995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:04.450995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 04 10:12:04.450995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 04 10:12:04.450995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:04.450995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:04.450995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 04 10:12:04.450995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 04 10:12:04.450995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 10:12:04.450995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 10:12:04.450995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 10:12:04.450995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:04.451916 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 235/477] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Aug 4 10:12:04 2022] POST /identity/v3/roles => generated 144 bytes in 313 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:04.463133 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142619c-18af-4d9c-b481-cef2778299b7 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:04.483946 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c09423-e92d-42c9-8363-6415740ed3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:04.484955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c09423-e92d-42c9-8363-6415740ed3a2 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:04.485420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c09423-e92d-42c9-8363-6415740ed3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:04.485873 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c09423-e92d-42c9-8363-6415740ed3a2 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:04.486947 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c09423-e92d-42c9-8363-6415740ed3a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:04.488683 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c09423-e92d-42c9-8363-6415740ed3a2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:04.512920 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 243/478] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Aug 4 10:12:04 2022] POST /identity/v3/users => generated 249 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:12:04.617375 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142619c-18af-4d9c-b481-cef2778299b7 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:04.634570 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:04.664308 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470e3c2-1845-4186-9ba1-07e155ab014f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:04.665811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470e3c2-1845-4186-9ba1-07e155ab014f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:04.666618 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470e3c2-1845-4186-9ba1-07e155ab014f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:04.667362 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470e3c2-1845-4186-9ba1-07e155ab014f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:04.688435 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470e3c2-1845-4186-9ba1-07e155ab014f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:04.700469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-6470e3c2-1845-4186-9ba1-07e155ab014f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:12:04.700469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:04.700469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:04.700469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:04.700469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:04.700469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:04.700469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:04.700469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:04.700469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:04.700469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:04.700469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:04.700469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:04.700469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:04.700469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:04.700469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:04.700469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:04.702194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:04.702194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:04.702194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:04.702194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:04.702194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:04.702194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:04.702194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:04.702194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:04.702194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:04.702194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:04.702194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:04.702194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:04.702194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:04.702194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:04.702194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:04.702194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:04.703728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:04.703728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:04.703728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:04.703728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:04.703728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:04.703728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:04.703728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:04.703728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:04.703728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:04.703728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:04.703728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 10:12:04.703728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:04.709288 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 236/479] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:12:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:04.717871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c09423-e92d-42c9-8363-6415740ed3a2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:04.875454 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:04.911105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c09423-e92d-42c9-8363-6415740ed3a2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:04.970469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285dbd1-c7f2-468f-b818-4cfe60106907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:04.971609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285dbd1-c7f2-468f-b818-4cfe60106907 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:04.972089 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285dbd1-c7f2-468f-b818-4cfe60106907 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:04.972591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285dbd1-c7f2-468f-b818-4cfe60106907 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:04.973864 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285dbd1-c7f2-468f-b818-4cfe60106907 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:04.974449 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285dbd1-c7f2-468f-b818-4cfe60106907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:04.977107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285dbd1-c7f2-468f-b818-4cfe60106907 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:04.992353 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 244/480] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:05.866968 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b469a7-1863-4c11-920f-2997d8ee4196 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:05.867479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b469a7-1863-4c11-920f-2997d8ee4196 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:05.867582 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b469a7-1863-4c11-920f-2997d8ee4196 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:05.869112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 237/481] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:05.874603 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc71b7-7e88-435c-8358-72511e4341fb None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:05.874960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc71b7-7e88-435c-8358-72511e4341fb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:05.875294 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc71b7-7e88-435c-8358-72511e4341fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:05.903004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-76fc71b7-7e88-435c-8358-72511e4341fb None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:05.904240 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-76fc71b7-7e88-435c-8358-72511e4341fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:05.992817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 245/482] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:12:06.033368 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b469a7-1863-4c11-920f-2997d8ee4196 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:06.222796 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b469a7-1863-4c11-920f-2997d8ee4196 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:06.291760 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d4506-ba67-4449-bc78-3258d2e0e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:06.292875 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d4506-ba67-4449-bc78-3258d2e0e349 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:06.293377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d4506-ba67-4449-bc78-3258d2e0e349 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:06.293871 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d4506-ba67-4449-bc78-3258d2e0e349 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:06.322119 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d4506-ba67-4449-bc78-3258d2e0e349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:06.332287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-8f0d4506-ba67-4449-bc78-3258d2e0e349 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:06.332287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:06.332287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:06.332287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:06.332287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:06.332287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:06.332287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:06.332287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:06.332287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:06.332287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:06.332287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:06.332287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:06.332287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:06.332287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:06.332287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:06.332287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:06.333169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:06.333169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:06.333169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:06.333169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:06.333169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:06.333169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:06.333169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:06.333169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:06.333169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:06.333169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:06.333169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:06.333169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:06.333169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:06.333169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:06.333169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:06.333169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:06.333930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:06.333930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:06.333930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:06.333930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:06.333930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:06.333930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:06.333930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:06.333930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:06.333930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:06.333930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:06.333930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:06.333930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:06.335031 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 238/483] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:06.342199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc71b7-7e88-435c-8358-72511e4341fb None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:06.454284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:06.503072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc71b7-7e88-435c-8358-72511e4341fb None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:06.588371 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4291ff-0182-460b-aaac-db45fc54944f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:06.589396 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4291ff-0182-460b-aaac-db45fc54944f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:06.589873 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4291ff-0182-460b-aaac-db45fc54944f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:06.590369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4291ff-0182-460b-aaac-db45fc54944f None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:06.591659 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4291ff-0182-460b-aaac-db45fc54944f None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:06.592217 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4291ff-0182-460b-aaac-db45fc54944f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:06.595137 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4291ff-0182-460b-aaac-db45fc54944f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:06.611145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 246/484] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:12:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:06.617486 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d4506-ba67-4449-bc78-3258d2e0e349 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:06.691643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:06.802297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d4506-ba67-4449-bc78-3258d2e0e349 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:06.873479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8f79f-29de-4f78-a399-8bdace743df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:06.874580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8f79f-29de-4f78-a399-8bdace743df1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:06.875068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8f79f-29de-4f78-a399-8bdace743df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:06.875558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8f79f-29de-4f78-a399-8bdace743df1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:06.899615 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8f79f-29de-4f78-a399-8bdace743df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:06.902370 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8f79f-29de-4f78-a399-8bdace743df1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:06.935750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-59c8f79f-29de-4f78-a399-8bdace743df1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:06.935750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:06.935750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:06.935750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:06.935750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:06.935750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:06.935750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:06.935750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:06.935750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:06.935750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:06.935750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:06.935750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:06.935750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:06.935750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:06.935750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:06.937737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:06.937737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:06.937737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:06.937737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:06.937737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:06.937737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:06.937737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:06.937737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:06.937737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:06.937737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:06.937737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:06.937737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:06.937737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:06.937737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:06.937737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:06.937737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:06.937737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:06.941387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:06.941387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:06.941387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:06.941387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:06.941387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 239/485] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:06.945513 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4291ff-0182-460b-aaac-db45fc54944f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:07.106535 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fac7e3-1d1c-44a9-90e1-71c162943e6d None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:07.107071 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fac7e3-1d1c-44a9-90e1-71c162943e6d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:07.108489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fac7e3-1d1c-44a9-90e1-71c162943e6d None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:07.111402 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 240/486] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:07.118216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4578313-9a94-40ce-86c4-68330e7e066b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:07.118707 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4578313-9a94-40ce-86c4-68330e7e066b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:07.119200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4578313-9a94-40ce-86c4-68330e7e066b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:07.138880 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4291ff-0182-460b-aaac-db45fc54944f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:07.149929 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a4578313-9a94-40ce-86c4-68330e7e066b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:07.155465 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a4578313-9a94-40ce-86c4-68330e7e066b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:07.224896 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a16082-db12-46c9-b841-877627caf4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:07.225542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16082-db12-46c9-b841-877627caf4bc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:07.225831 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16082-db12-46c9-b841-877627caf4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:07.226115 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a16082-db12-46c9-b841-877627caf4bc None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:07.226823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a16082-db12-46c9-b841-877627caf4bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:07.227133 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a16082-db12-46c9-b841-877627caf4bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:07.228598 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a16082-db12-46c9-b841-877627caf4bc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:07.236241 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:07.249915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 247/487] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:07.257172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a16082-db12-46c9-b841-877627caf4bc None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:07.277789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 241/488] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:12:07.323958 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4578313-9a94-40ce-86c4-68330e7e066b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:07.368398 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:07.434486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a16082-db12-46c9-b841-877627caf4bc None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:07.474985 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89e41e-cc8c-40c5-a552-3e8c68a6c471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:07.476234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89e41e-cc8c-40c5-a552-3e8c68a6c471 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:07.476979 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89e41e-cc8c-40c5-a552-3e8c68a6c471 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:07.477838 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89e41e-cc8c-40c5-a552-3e8c68a6c471 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:07.480463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4578313-9a94-40ce-86c4-68330e7e066b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:07.486314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89e41e-cc8c-40c5-a552-3e8c68a6c471 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:07.488069 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa89e41e-cc8c-40c5-a552-3e8c68a6c471 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:07.501625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-fa89e41e-cc8c-40c5-a552-3e8c68a6c471 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 10:12:07.501625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:07.501625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:07.501625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:07.501625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:07.501625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:07.501625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:07.501625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:07.501625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:07.501625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:07.501625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:07.501625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:07.501625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:07.501625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:07.501625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:07.501625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:07.502849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:07.502849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:07.502849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:07.502849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:07.502849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:07.502849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:07.502849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:07.502849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:07.502849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:07.502849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:07.502849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:07.502849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:07.502849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:07.502849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:07.502849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:07.502849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:07.502849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:07.502849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:07.504394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:07.504394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:07.504394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:07.504394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:07.504394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:07.504394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:07.504394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:07.504394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:07.504394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 10:12:07.504394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:07.507467 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 248/489] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Aug 4 10:12:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:07.508880 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c69b2-4c6c-45f1-bf43-e82186d6e80d None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:07.509108 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c69b2-4c6c-45f1-bf43-e82186d6e80d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:07.509393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c69b2-4c6c-45f1-bf43-e82186d6e80d None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:07.510925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 249/490] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:07.511627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c69b2-4c6c-45f1-bf43-e82186d6e80d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:07.530472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20204e35-dea6-4e36-b434-b879f6e1f604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:07.531561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20204e35-dea6-4e36-b434-b879f6e1f604 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:07.532034 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20204e35-dea6-4e36-b434-b879f6e1f604 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:07.532625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20204e35-dea6-4e36-b434-b879f6e1f604 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:07.545144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20204e35-dea6-4e36-b434-b879f6e1f604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:07.552202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-20204e35-dea6-4e36-b434-b879f6e1f604 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:07.552202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:07.552202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:07.552202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:07.552202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:07.552202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:07.552202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:07.552202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:07.552202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:07.552202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:07.552202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:07.552202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:07.552202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:07.552202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:07.552202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:07.552202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:07.553061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:07.553061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:07.553061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:07.553061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:07.553061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:07.553061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:07.553061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:07.553061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:07.553061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:07.553061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:07.553061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:07.553061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:07.553061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:07.553061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:07.553061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:07.553061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:07.553824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:07.553824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:07.553824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:07.553824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:07.553824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:07.553824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:07.553824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:07.553824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:07.553824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:07.553824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:07.553824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:07.553824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:07.556660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 242/491] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:07.558182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a420a-b6fb-405a-b958-aa614d5f6748 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:07.558713 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a420a-b6fb-405a-b958-aa614d5f6748 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:07.559198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a420a-b6fb-405a-b958-aa614d5f6748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:07.579496 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d82a420a-b6fb-405a-b958-aa614d5f6748 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:07.582082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d82a420a-b6fb-405a-b958-aa614d5f6748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:07.587342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:07.635837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c69b2-4c6c-45f1-bf43-e82186d6e80d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:07.661851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 243/492] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:07.663072 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a420a-b6fb-405a-b958-aa614d5f6748 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:07.672273 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69430fdf-4e7c-46d0-8cb5-36157c9f43ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:07.672823 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:07.672995 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69430fdf-4e7c-46d0-8cb5-36157c9f43ef None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:07.673240 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69430fdf-4e7c-46d0-8cb5-36157c9f43ef None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:07.673518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69430fdf-4e7c-46d0-8cb5-36157c9f43ef None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:07.674863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69430fdf-4e7c-46d0-8cb5-36157c9f43ef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:07.674863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69430fdf-4e7c-46d0-8cb5-36157c9f43ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:07.676568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69430fdf-4e7c-46d0-8cb5-36157c9f43ef None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:07.716808 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 250/493] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Aug 4 10:12:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:07.717821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69430fdf-4e7c-46d0-8cb5-36157c9f43ef None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:07.779982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a420a-b6fb-405a-b958-aa614d5f6748 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:07.821480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd6eb9-a393-44db-9136-2346c1a81d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:07.822114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69430fdf-4e7c-46d0-8cb5-36157c9f43ef None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:07.822770 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd6eb9-a393-44db-9136-2346c1a81d87 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:07.823286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd6eb9-a393-44db-9136-2346c1a81d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:07.823804 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd6eb9-a393-44db-9136-2346c1a81d87 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:07.824842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd6eb9-a393-44db-9136-2346c1a81d87 None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:07.825339 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd6eb9-a393-44db-9136-2346c1a81d87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:07.826905 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd6eb9-a393-44db-9136-2346c1a81d87 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:07.836257 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:07.838072 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 244/494] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:12:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:07.839229 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd6eb9-a393-44db-9136-2346c1a81d87 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:07.863948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2041791-bef5-41bb-8b39-9b7a6477b70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:07.864624 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041791-bef5-41bb-8b39-9b7a6477b70a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:07.864908 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041791-bef5-41bb-8b39-9b7a6477b70a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:07.865183 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041791-bef5-41bb-8b39-9b7a6477b70a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:07.876041 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2041791-bef5-41bb-8b39-9b7a6477b70a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:07.881631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-a2041791-bef5-41bb-8b39-9b7a6477b70a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:07.881631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:07.881631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:07.881631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:07.881631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:07.881631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:07.881631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:07.881631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:07.881631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:07.881631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:07.881631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:07.881631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:07.881631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:07.881631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:07.881631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:07.881631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:07.882504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:07.882504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:07.882504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:07.882504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:07.882504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:07.882504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:07.882504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:07.882504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:07.882504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:07.882504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:07.882504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:07.882504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:07.882504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:07.882504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:07.882504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:07.882504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:07.883984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:07.883984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:07.883984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:07.883984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:07.883984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:07.883984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:07.883984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:07.883984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:07.883984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:07.883984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:07.883984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:07.883984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:07.883984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 251/495] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:07.883984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2041791-bef5-41bb-8b39-9b7a6477b70a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:07.922350 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:07.964498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd6eb9-a393-44db-9136-2346c1a81d87 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:07.988202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2041791-bef5-41bb-8b39-9b7a6477b70a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:08.004570 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c97488-e78c-4933-8e3d-622ab9aec90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:08.005630 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c97488-e78c-4933-8e3d-622ab9aec90a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:08.006127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c97488-e78c-4933-8e3d-622ab9aec90a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:08.006595 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c97488-e78c-4933-8e3d-622ab9aec90a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:08.022927 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddcb7b-3f35-40f0-bad3-46e271032ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:08.023572 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddcb7b-3f35-40f0-bad3-46e271032ebb None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:08.023867 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddcb7b-3f35-40f0-bad3-46e271032ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:08.024124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddcb7b-3f35-40f0-bad3-46e271032ebb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:08.036069 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddcb7b-3f35-40f0-bad3-46e271032ebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:08.037599 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddcb7b-3f35-40f0-bad3-46e271032ebb None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:08.052769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-81ddcb7b-3f35-40f0-bad3-46e271032ebb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:08.052769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:08.052769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:08.052769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:08.052769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:08.052769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:08.052769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:08.052769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:08.052769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:08.052769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:08.052769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:08.052769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:08.052769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:08.052769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:08.052769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:08.053625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:08.053625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:08.053625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:08.053625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:08.053625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:08.053625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:08.053625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:08.053625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:08.053625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:08.053625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:08.053625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:08.053625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:08.053625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:08.053625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:08.053625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:08.053625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:08.053625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:08.054427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:08.054427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:08.054427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:08.054427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:08.054427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 252/496] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:08.054690 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddcb7b-3f35-40f0-bad3-46e271032ebb None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:08.086021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:08.086649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c97488-e78c-4933-8e3d-622ab9aec90a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:08.088110 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c97488-e78c-4933-8e3d-622ab9aec90a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:08.154478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:08.162651 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddcb7b-3f35-40f0-bad3-46e271032ebb None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:08.190900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 245/497] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:12:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:12:08.192127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873a804-e5f8-48de-a369-1ba626526d69 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:08.192453 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873a804-e5f8-48de-a369-1ba626526d69 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:08.192734 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873a804-e5f8-48de-a369-1ba626526d69 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:08.194136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 246/498] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:08.195664 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cc692-87d6-401b-bdda-733445b16440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:08.196329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cc692-87d6-401b-bdda-733445b16440 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:08.196616 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cc692-87d6-401b-bdda-733445b16440 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:08.196893 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cc692-87d6-401b-bdda-733445b16440 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:08.196987 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873a804-e5f8-48de-a369-1ba626526d69 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:08.197605 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cc692-87d6-401b-bdda-733445b16440 None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:08.197980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cc692-87d6-401b-bdda-733445b16440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:08.199315 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cc692-87d6-401b-bdda-733445b16440 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:08.208277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 253/499] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:12:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:08.209317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621f9d7-8b6e-4ea1-bb56-80c5257f4480 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:08.209604 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621f9d7-8b6e-4ea1-bb56-80c5257f4480 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:08.209884 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621f9d7-8b6e-4ea1-bb56-80c5257f4480 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:08.211086 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 254/500] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:08.211772 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621f9d7-8b6e-4ea1-bb56-80c5257f4480 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:08.299099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:08.302692 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873a804-e5f8-48de-a369-1ba626526d69 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:08.313043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621f9d7-8b6e-4ea1-bb56-80c5257f4480 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:08.336951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756c57f-54f2-4966-bd7b-45d5b2de276d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:08.337570 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756c57f-54f2-4966-bd7b-45d5b2de276d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:08.337856 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756c57f-54f2-4966-bd7b-45d5b2de276d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:08.338138 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756c57f-54f2-4966-bd7b-45d5b2de276d None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:08.338833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756c57f-54f2-4966-bd7b-45d5b2de276d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:08.339141 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756c57f-54f2-4966-bd7b-45d5b2de276d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:08.340552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756c57f-54f2-4966-bd7b-45d5b2de276d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:08.346801 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcabc0-6230-4c21-9773-f1aa71c4fd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:08.347444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcabc0-6230-4c21-9773-f1aa71c4fd8c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:08.347723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcabc0-6230-4c21-9773-f1aa71c4fd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:08.348004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcabc0-6230-4c21-9773-f1aa71c4fd8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:08.352002 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 247/501] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:08.353289 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21f161-9db3-40c9-b07c-71ecbd20cdf8 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:08.353585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21f161-9db3-40c9-b07c-71ecbd20cdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:08.353869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21f161-9db3-40c9-b07c-71ecbd20cdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:08.358475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcabc0-6230-4c21-9773-f1aa71c4fd8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:08.360037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcabc0-6230-4c21-9773-f1aa71c4fd8c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:08.372450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-8b21f161-9db3-40c9-b07c-71ecbd20cdf8 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:08.373659 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8b21f161-9db3-40c9-b07c-71ecbd20cdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:08.374727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-d6fcabc0-6230-4c21-9773-f1aa71c4fd8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:08.374727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:08.374727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:08.374727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:08.374727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:08.374727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:08.374727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:08.374727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:08.374727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:08.374727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:08.374727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:08.374727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:08.374727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:08.374727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:08.374727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:08.375540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:08.375540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:08.375540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:08.375540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:08.375540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:08.375540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:08.375540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:08.375540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:08.375540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:08.375540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:08.375540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:08.375540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:08.375540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:08.375540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:08.375540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:08.375540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:08.375540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:08.376392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:08.376392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:08.376392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:08.376392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:08.376392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 255/502] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:08.376904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcabc0-6230-4c21-9773-f1aa71c4fd8c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:08.402038 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:08.446054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 248/503] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:08.447210 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d7277-f6e6-459a-a004-8ece809b5152 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:08.447502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d7277-f6e6-459a-a004-8ece809b5152 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:08.447773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d7277-f6e6-459a-a004-8ece809b5152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:08.467741 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-0e7d7277-f6e6-459a-a004-8ece809b5152 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:08.468935 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0e7d7277-f6e6-459a-a004-8ece809b5152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:08.477037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcabc0-6230-4c21-9773-f1aa71c4fd8c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:08.510940 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35257e12-5f4f-49ab-b7f7-69050e88f307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:08.511592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35257e12-5f4f-49ab-b7f7-69050e88f307 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:08.511873 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35257e12-5f4f-49ab-b7f7-69050e88f307 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:08.512455 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35257e12-5f4f-49ab-b7f7-69050e88f307 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:08.522205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:08.525589 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35257e12-5f4f-49ab-b7f7-69050e88f307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:08.527235 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35257e12-5f4f-49ab-b7f7-69050e88f307 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:08.542482 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 249/504] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:08.543329 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d7277-f6e6-459a-a004-8ece809b5152 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:08.544471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-35257e12-5f4f-49ab-b7f7-69050e88f307 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:08.544471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:08.544471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:08.544471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:08.544471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:08.544471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:08.544471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:08.544471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:08.544471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:08.544471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:08.544471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:08.544471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:08.544471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:08.544471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:08.544471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:08.545730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:08.545730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:08.545730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:08.545730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:08.545730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:08.545730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:08.545730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:08.545730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:08.545730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:08.545730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:08.545730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:08.545730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:08.545730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:08.545730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:08.545730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:08.545730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:08.545730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:08.547072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:08.547072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:08.547072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:08.547072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:08.547630 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 256/505] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:08.548506 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35257e12-5f4f-49ab-b7f7-69050e88f307 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:08.634481 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:08.647206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d7277-f6e6-459a-a004-8ece809b5152 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:08.658336 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35257e12-5f4f-49ab-b7f7-69050e88f307 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:08.680747 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd390544-2bbc-4fdc-8682-c9e62e958222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:08.681387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd390544-2bbc-4fdc-8682-c9e62e958222 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:08.681665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd390544-2bbc-4fdc-8682-c9e62e958222 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:08.681943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd390544-2bbc-4fdc-8682-c9e62e958222 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:08.689114 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd390544-2bbc-4fdc-8682-c9e62e958222 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:08.691204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd390544-2bbc-4fdc-8682-c9e62e958222 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:08.693219 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b417f-7f60-41cf-afdb-b120750bea8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:08.693843 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b417f-7f60-41cf-afdb-b120750bea8a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:08.694130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b417f-7f60-41cf-afdb-b120750bea8a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:08.694407 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b417f-7f60-41cf-afdb-b120750bea8a None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:08.695096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b417f-7f60-41cf-afdb-b120750bea8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:08.695425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b417f-7f60-41cf-afdb-b120750bea8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:08.696884 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b417f-7f60-41cf-afdb-b120750bea8a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:08.704282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-fd390544-2bbc-4fdc-8682-c9e62e958222 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 10:12:08.704282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:08.704282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:08.704282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:08.704282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:08.704282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:08.704282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:08.704282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:08.704282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:08.704282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:08.704282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:08.704282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:08.704282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:08.704282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:08.704282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:08.704282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:08.705369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:08.705369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:08.705369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:08.705369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:08.705369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:08.705369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:08.705369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:08.705369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:08.705369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:08.705369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:08.705369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:08.705369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:08.705369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:08.705369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:08.705369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:08.705369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:08.705369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:08.705369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:08.706442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:08.706442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:08.706442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:08.706442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:08.706442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:08.706442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:08.706442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:08.706442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:08.706442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 10:12:08.706442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:08.706442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 250/506] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:12:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:08.706442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd390544-2bbc-4fdc-8682-c9e62e958222 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:08.711150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 257/507] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:08.711954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b417f-7f60-41cf-afdb-b120750bea8a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:08.764007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:08.809988 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd390544-2bbc-4fdc-8682-c9e62e958222 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:08.810726 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b417f-7f60-41cf-afdb-b120750bea8a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:08.843515 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb0480-7ade-4d79-992f-ba548eef58f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:08.843711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0d29e-00ca-48b0-90de-cb572a1cb7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:08.844177 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb0480-7ade-4d79-992f-ba548eef58f0 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:08.844275 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0d29e-00ca-48b0-90de-cb572a1cb7ba None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:08.844475 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb0480-7ade-4d79-992f-ba548eef58f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:08.844578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0d29e-00ca-48b0-90de-cb572a1cb7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:08.844759 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb0480-7ade-4d79-992f-ba548eef58f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:08.844847 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0d29e-00ca-48b0-90de-cb572a1cb7ba None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:08.845454 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0d29e-00ca-48b0-90de-cb572a1cb7ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:08.845773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0d29e-00ca-48b0-90de-cb572a1cb7ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:08.847155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0d29e-00ca-48b0-90de-cb572a1cb7ba None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:08.855484 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb0480-7ade-4d79-992f-ba548eef58f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:08.856966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb0480-7ade-4d79-992f-ba548eef58f0 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:08.858277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 258/508] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:08.859136 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0d29e-00ca-48b0-90de-cb572a1cb7ba None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:08.867795 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:08.874981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-4efb0480-7ade-4d79-992f-ba548eef58f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:08.874981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:08.874981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:08.874981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:08.874981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:08.874981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:08.874981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:08.874981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:08.874981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:08.874981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:08.874981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:08.874981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:08.874981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:08.874981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:08.874981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:08.875963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:08.875963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:08.875963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:08.875963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:08.875963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:08.875963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:08.875963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:08.875963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:08.875963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:08.875963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:08.875963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:08.875963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:08.875963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:08.875963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:08.875963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:08.875963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:08.875963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:08.876909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:08.876909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:08.876909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:08.876909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:08.876909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 251/509] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:08.878344 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb0480-7ade-4d79-992f-ba548eef58f0 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:08.962283 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0d29e-00ca-48b0-90de-cb572a1cb7ba None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:08.975282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:08.981873 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb0480-7ade-4d79-992f-ba548eef58f0 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:08.997840 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60271b-7570-42f2-a1c3-19c2428817e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:08.998485 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60271b-7570-42f2-a1c3-19c2428817e8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:08.998766 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60271b-7570-42f2-a1c3-19c2428817e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:08.999041 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60271b-7570-42f2-a1c3-19c2428817e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:09.009595 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60271b-7570-42f2-a1c3-19c2428817e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:09.014907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-7d60271b-7570-42f2-a1c3-19c2428817e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:09.014907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:09.014907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:09.014907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:09.014907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:09.014907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:09.014907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:09.014907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:09.014907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:09.014907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:09.014907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:09.014907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:09.014907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:09.014907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:09.014907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:09.014907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:09.016067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:09.016067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:09.016067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:09.016067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:09.016067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:09.016067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:09.016067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:09.016067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:09.016067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:09.016067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:09.016067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:09.016067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:09.016067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:09.016067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:09.016067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:09.016067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:09.016910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:09.016910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:09.016910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:09.016910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:09.016910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:09.016910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:09.016910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:09.016910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:09.016910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:09.016910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:09.016910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:09.016910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:09.016910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 259/510] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:09.016910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60271b-7570-42f2-a1c3-19c2428817e8 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:09.018553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b86268-702d-4444-a043-dc740787dc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:09.019187 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b86268-702d-4444-a043-dc740787dc87 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:09.019467 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b86268-702d-4444-a043-dc740787dc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:09.019752 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b86268-702d-4444-a043-dc740787dc87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:09.027386 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b86268-702d-4444-a043-dc740787dc87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:09.029119 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b86268-702d-4444-a043-dc740787dc87 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:09.042396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-95b86268-702d-4444-a043-dc740787dc87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:09.042396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:09.042396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:09.042396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:09.042396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:09.042396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:09.042396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:09.042396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:09.042396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:09.042396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:09.042396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:09.042396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:09.042396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:09.042396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:09.042396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:09.043242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:09.043242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:09.043242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:09.043242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:09.043242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:09.043242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:09.043242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:09.043242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:09.043242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:09.043242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:09.043242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:09.043242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:09.043242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:09.043242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:09.043242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:09.043242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:09.043242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:09.044054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:09.044054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:09.044054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:09.044054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:09.044054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:09.044054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:09.044054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:09.044054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:09.044054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 252/511] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:09.044550 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b86268-702d-4444-a043-dc740787dc87 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:09.104467 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:09.119128 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60271b-7570-42f2-a1c3-19c2428817e8 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:09.146608 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b86268-702d-4444-a043-dc740787dc87 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:09.151972 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2d776-9618-4816-a2ef-b8de273ea6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:09.152623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2d776-9618-4816-a2ef-b8de273ea6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:09.152908 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2d776-9618-4816-a2ef-b8de273ea6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:09.153186 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2d776-9618-4816-a2ef-b8de273ea6d7 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:09.153977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2d776-9618-4816-a2ef-b8de273ea6d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:09.154282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2d776-9618-4816-a2ef-b8de273ea6d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:09.155714 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2d776-9618-4816-a2ef-b8de273ea6d7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:09.173056 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 260/512] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Aug 4 10:12:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:09.173920 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2d776-9618-4816-a2ef-b8de273ea6d7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:09.185172 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903fff5-f643-4249-922d-4fad909186ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:09.185814 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903fff5-f643-4249-922d-4fad909186ec None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:09.186350 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903fff5-f643-4249-922d-4fad909186ec None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:09.186642 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903fff5-f643-4249-922d-4fad909186ec None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:09.194168 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903fff5-f643-4249-922d-4fad909186ec None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:09.195623 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903fff5-f643-4249-922d-4fad909186ec None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:09.203118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:09.206890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-6903fff5-f643-4249-922d-4fad909186ec None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 10:12:09.206890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:09.206890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:09.206890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:09.206890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:09.206890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:09.206890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:09.206890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:09.206890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:09.206890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:09.206890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:09.206890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:09.206890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:09.206890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:09.206890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:09.206890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:09.207925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:09.207925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:09.207925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:09.207925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:09.207925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:09.207925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:09.207925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:09.207925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:09.207925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:09.207925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:09.207925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:09.207925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:09.207925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:09.207925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:09.207925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:09.207925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:09.207925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:09.207925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:09.209042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:09.209042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:09.209042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:09.209042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:09.209042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:09.209042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:09.209042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:09.209042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:09.209042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 10:12:09.209042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:09.209042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 253/513] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:12:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:09.209042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903fff5-f643-4249-922d-4fad909186ec None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:09.275439 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2d776-9618-4816-a2ef-b8de273ea6d7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:09.310098 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903fff5-f643-4249-922d-4fad909186ec None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:09.310414 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5159539-dad2-4eb9-a39e-3c1fdca08180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:09.311029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5159539-dad2-4eb9-a39e-3c1fdca08180 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:09.311566 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5159539-dad2-4eb9-a39e-3c1fdca08180 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:09.311839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5159539-dad2-4eb9-a39e-3c1fdca08180 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:09.312551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5159539-dad2-4eb9-a39e-3c1fdca08180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:09.312849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5159539-dad2-4eb9-a39e-3c1fdca08180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:09.314235 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5159539-dad2-4eb9-a39e-3c1fdca08180 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:09.325041 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 261/514] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:09.325820 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5159539-dad2-4eb9-a39e-3c1fdca08180 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:09.331244 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:09.346304 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2734d7-a738-4f7f-b27d-07e5a6462d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:09.346960 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2734d7-a738-4f7f-b27d-07e5a6462d94 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:09.347237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2734d7-a738-4f7f-b27d-07e5a6462d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:09.347507 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2734d7-a738-4f7f-b27d-07e5a6462d94 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:09.348254 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2734d7-a738-4f7f-b27d-07e5a6462d94 None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:09.348562 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2734d7-a738-4f7f-b27d-07e5a6462d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:09.349923 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2734d7-a738-4f7f-b27d-07e5a6462d94 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:09.357899 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 254/515] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:12:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:09.358748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2734d7-a738-4f7f-b27d-07e5a6462d94 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:09.418054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:09.429702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5159539-dad2-4eb9-a39e-3c1fdca08180 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:09.458022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2734d7-a738-4f7f-b27d-07e5a6462d94 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:09.462845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1a2ae-3748-4192-99ca-e43010eb6688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:09.463465 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1a2ae-3748-4192-99ca-e43010eb6688 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:09.463749 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1a2ae-3748-4192-99ca-e43010eb6688 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:09.464022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1a2ae-3748-4192-99ca-e43010eb6688 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:09.464803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1a2ae-3748-4192-99ca-e43010eb6688 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:09.465112 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1a2ae-3748-4192-99ca-e43010eb6688 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:09.466556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1a2ae-3748-4192-99ca-e43010eb6688 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:09.484230 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 262/516] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:09.485300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1a2ae-3748-4192-99ca-e43010eb6688 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:09.492674 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f0cf9-a3cb-4450-b307-080217c9ac72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:09.493300 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f0cf9-a3cb-4450-b307-080217c9ac72 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:09.493585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f0cf9-a3cb-4450-b307-080217c9ac72 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:09.493863 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f0cf9-a3cb-4450-b307-080217c9ac72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:09.549590 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:09.569592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f0cf9-a3cb-4450-b307-080217c9ac72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:09.571055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f0cf9-a3cb-4450-b307-080217c9ac72 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:09.586722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1a2ae-3748-4192-99ca-e43010eb6688 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:09.624630 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb13220-2969-48cd-897b-5d68c5f9b865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:09.625264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb13220-2969-48cd-897b-5d68c5f9b865 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:09.625543 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb13220-2969-48cd-897b-5d68c5f9b865 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:09.625816 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb13220-2969-48cd-897b-5d68c5f9b865 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:09.626600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb13220-2969-48cd-897b-5d68c5f9b865 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:09.626904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb13220-2969-48cd-897b-5d68c5f9b865 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:09.628493 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb13220-2969-48cd-897b-5d68c5f9b865 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:09.645645 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 263/517] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Aug 4 10:12:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:09.646410 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb13220-2969-48cd-897b-5d68c5f9b865 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:09.656582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:09.671912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 255/518] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:12:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:12:09.672780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f0cf9-a3cb-4450-b307-080217c9ac72 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:09.750562 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb13220-2969-48cd-897b-5d68c5f9b865 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:09.752913 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:09.772487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f0cf9-a3cb-4450-b307-080217c9ac72 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:09.784704 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d249c4-c2d0-4a5e-82b2-16d6abbe569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:09.785324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d249c4-c2d0-4a5e-82b2-16d6abbe569c None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:09.785605 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d249c4-c2d0-4a5e-82b2-16d6abbe569c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:09.785880 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d249c4-c2d0-4a5e-82b2-16d6abbe569c None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:09.786549 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d249c4-c2d0-4a5e-82b2-16d6abbe569c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:09.788003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d249c4-c2d0-4a5e-82b2-16d6abbe569c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:09.808099 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762119d-8557-4adb-a24d-4c355df65fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:09.808773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762119d-8557-4adb-a24d-4c355df65fcd None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:09.809055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762119d-8557-4adb-a24d-4c355df65fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:09.809306 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 264/519] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Aug 4 10:12:09 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:12:09.809448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762119d-8557-4adb-a24d-4c355df65fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:09.810110 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d249c4-c2d0-4a5e-82b2-16d6abbe569c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:09.821257 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762119d-8557-4adb-a24d-4c355df65fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:09.822769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762119d-8557-4adb-a24d-4c355df65fcd None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:09.839614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-c762119d-8557-4adb-a24d-4c355df65fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:09.839614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:09.839614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:09.839614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:09.839614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:09.839614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:09.839614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:09.839614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:09.839614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:09.839614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:09.839614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:09.839614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:09.839614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:09.839614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:09.839614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:09.840596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:09.840596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:09.840596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:09.840596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:09.840596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:09.840596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:09.840596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:09.840596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:09.840596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:09.840596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:09.840596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:09.840596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:09.840596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:09.840596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:09.840596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:09.840596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:09.840596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:09.841419 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:09.841419 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:09.841419 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:09.841419 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:09.841419 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 256/520] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:09.841710 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762119d-8557-4adb-a24d-4c355df65fcd None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:09.889696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:09.937338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d249c4-c2d0-4a5e-82b2-16d6abbe569c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:09.959195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762119d-8557-4adb-a24d-4c355df65fcd None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:09.978905 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de2ffa-f362-4f04-aa06-4e69d53411a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:09.979630 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de2ffa-f362-4f04-aa06-4e69d53411a2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:09.979810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de2ffa-f362-4f04-aa06-4e69d53411a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:09.980093 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de2ffa-f362-4f04-aa06-4e69d53411a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:09.980930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de2ffa-f362-4f04-aa06-4e69d53411a2 None admin] RBAC: Adding query filter params (role.id=88ed5b6546c64ac09d03064e12ca7f10, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=592539924feb44ad8ea520d8539b6608) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:09.981225 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de2ffa-f362-4f04-aa06-4e69d53411a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:09.982682 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de2ffa-f362-4f04-aa06-4e69d53411a2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:09.989252 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 265/521] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:12:09 2022] GET /identity/v3/role_assignments?user.id=592539924feb44ad8ea520d8539b6608&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=88ed5b6546c64ac09d03064e12ca7f10 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:09.997210 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de2ffa-f362-4f04-aa06-4e69d53411a2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:09.998247 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9063155-e654-4962-a52a-720074b99ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:09.998902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9063155-e654-4962-a52a-720074b99ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:09.999189 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9063155-e654-4962-a52a-720074b99ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:09.999474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9063155-e654-4962-a52a-720074b99ff5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:10.003282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:10.100525 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9063155-e654-4962-a52a-720074b99ff5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:10.104016 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9063155-e654-4962-a52a-720074b99ff5 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:10.141975 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de2ffa-f362-4f04-aa06-4e69d53411a2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:10.178211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:10.187207 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78939a0d-4697-492a-a5d2-533ed0ffd4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:10.188027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78939a0d-4697-492a-a5d2-533ed0ffd4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:10.188500 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78939a0d-4697-492a-a5d2-533ed0ffd4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:10.188991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78939a0d-4697-492a-a5d2-533ed0ffd4e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:10.206990 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78939a0d-4697-492a-a5d2-533ed0ffd4e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:10.208600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78939a0d-4697-492a-a5d2-533ed0ffd4e4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:10.225076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-78939a0d-4697-492a-a5d2-533ed0ffd4e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:10.225076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:10.225076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:10.225076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:10.225076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:10.225076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:10.225076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:10.225076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:10.225076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:10.225076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:10.225076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:10.225076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:10.225076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:10.225076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:10.225076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:10.225955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:10.225955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:10.225955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:10.225955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:10.225955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:10.225955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:10.225955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:10.225955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:10.225955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:10.225955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:10.225955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:10.225955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:10.225955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:10.225955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:10.225955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:10.225955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:10.225955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:10.226799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:10.226799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:10.226799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:10.226799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:10.226799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 266/522] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:10.227501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78939a0d-4697-492a-a5d2-533ed0ffd4e4 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:10.232595 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 257/523] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:12:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:12:10.233679 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9063155-e654-4962-a52a-720074b99ff5 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:10.273769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:10.334832 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78939a0d-4697-492a-a5d2-533ed0ffd4e4 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:10.350415 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9063155-e654-4962-a52a-720074b99ff5 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:10.371697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b77bf0-3478-4219-ba2e-298eb61433d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:10.372282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b77bf0-3478-4219-ba2e-298eb61433d5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:10.372576 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b77bf0-3478-4219-ba2e-298eb61433d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:10.372858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b77bf0-3478-4219-ba2e-298eb61433d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:10.373568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b77bf0-3478-4219-ba2e-298eb61433d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:10.373977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b77bf0-3478-4219-ba2e-298eb61433d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:10.375494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b77bf0-3478-4219-ba2e-298eb61433d5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:10.389513 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 267/524] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:10.390382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b77bf0-3478-4219-ba2e-298eb61433d5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:10.391565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f424dc-01ca-486c-8992-10ba2e66e24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:10.392222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f424dc-01ca-486c-8992-10ba2e66e24f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:10.392712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f424dc-01ca-486c-8992-10ba2e66e24f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:10.393238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f424dc-01ca-486c-8992-10ba2e66e24f None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:10.394097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f424dc-01ca-486c-8992-10ba2e66e24f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:10.395147 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f424dc-01ca-486c-8992-10ba2e66e24f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:10.395924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f424dc-01ca-486c-8992-10ba2e66e24f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:10.416686 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 258/525] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:10.417522 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f424dc-01ca-486c-8992-10ba2e66e24f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:10.446425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:10.525775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b77bf0-3478-4219-ba2e-298eb61433d5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:10.531790 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:10.540320 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f424dc-01ca-486c-8992-10ba2e66e24f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:10.579428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c348e-4ceb-4fa2-ab45-b69916235426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:10.579632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14397d-1db5-4ad2-b04a-74926db22f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:10.580842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14397d-1db5-4ad2-b04a-74926db22f1e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:10.581185 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14397d-1db5-4ad2-b04a-74926db22f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:10.581389 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14397d-1db5-4ad2-b04a-74926db22f1e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:10.582146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c348e-4ceb-4fa2-ab45-b69916235426 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:10.582626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c348e-4ceb-4fa2-ab45-b69916235426 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:10.583116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c348e-4ceb-4fa2-ab45-b69916235426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:10.589517 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14397d-1db5-4ad2-b04a-74926db22f1e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:10.590969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14397d-1db5-4ad2-b04a-74926db22f1e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:10.596458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c348e-4ceb-4fa2-ab45-b69916235426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:10.598452 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c348e-4ceb-4fa2-ab45-b69916235426 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:10.602693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-4b14397d-1db5-4ad2-b04a-74926db22f1e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 10:12:10.602693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:10.602693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:10.602693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:10.602693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:10.602693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:10.602693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:10.602693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:10.602693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:10.602693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:10.602693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:10.602693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:10.602693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:10.602693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:10.602693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:10.602693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:10.603657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:10.603657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:10.603657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:10.603657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:10.603657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:10.603657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:10.603657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:10.603657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:10.603657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:10.603657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:10.603657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:10.603657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:10.603657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:10.603657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:10.603657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:10.603657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:10.603657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:10.603657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:10.604581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:10.604581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:10.604581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:10.604581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:10.604581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:10.604581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:10.604581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:10.604581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:10.604581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 10:12:10.604581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:10.604581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 259/526] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:10.605118 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14397d-1db5-4ad2-b04a-74926db22f1e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:10.630578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-723c348e-4ceb-4fa2-ab45-b69916235426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:10.630578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:10.630578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:10.630578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:10.630578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:10.630578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:10.630578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:10.630578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:10.630578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:10.630578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:10.630578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:10.630578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:10.630578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:10.630578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:10.630578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:10.631445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:10.631445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:10.631445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:10.631445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:10.631445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:10.631445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:10.631445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:10.631445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:10.631445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:10.631445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:10.631445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:10.631445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:10.631445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:10.631445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:10.631445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:10.631445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:10.631445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:10.632295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:10.632295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:10.632295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:10.632295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:10.636450 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 268/527] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:10.637292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c348e-4ceb-4fa2-ab45-b69916235426 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:10.743973 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14397d-1db5-4ad2-b04a-74926db22f1e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:10.748096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:10.760466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c348e-4ceb-4fa2-ab45-b69916235426 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:10.798298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb39ed-aeb5-43fd-bfce-da487d15424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:10.799819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac31e4-365f-490c-85d4-0e00cca74fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:10.800270 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb39ed-aeb5-43fd-bfce-da487d15424d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:10.800491 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac31e4-365f-490c-85d4-0e00cca74fba None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:10.800778 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac31e4-365f-490c-85d4-0e00cca74fba None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:10.801071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac31e4-365f-490c-85d4-0e00cca74fba None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:10.801425 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb39ed-aeb5-43fd-bfce-da487d15424d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:10.801906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb39ed-aeb5-43fd-bfce-da487d15424d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:10.802005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac31e4-365f-490c-85d4-0e00cca74fba None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:10.802227 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac31e4-365f-490c-85d4-0e00cca74fba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:10.803887 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac31e4-365f-490c-85d4-0e00cca74fba None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:10.811509 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb39ed-aeb5-43fd-bfce-da487d15424d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:10.814463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb39ed-aeb5-43fd-bfce-da487d15424d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:10.827794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 269/528] 10.222.0.48 () {56 vars in 1139 bytes} [Thu Aug 4 10:12:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:10.827794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac31e4-365f-490c-85d4-0e00cca74fba None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:10.833708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-c5fb39ed-aeb5-43fd-bfce-da487d15424d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:10.833708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:10.833708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:10.833708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:10.833708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:10.833708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:10.833708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:10.833708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:10.833708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:10.833708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:10.833708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:10.833708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:10.833708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:10.833708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:10.833708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:10.834520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:10.834520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:10.834520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:10.834520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:10.834520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:10.834520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:10.834520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:10.834520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:10.834520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:10.834520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:10.834520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:10.834520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:10.834520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:10.834520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:10.834520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:10.834520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:10.834520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:10.835342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:10.835342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:10.835342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:10.835342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:10.835342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:10.835342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:10.835342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:10.835342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:10.837574 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 260/529] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:10.842793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb39ed-aeb5-43fd-bfce-da487d15424d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:10.858425 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:10.960998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac31e4-365f-490c-85d4-0e00cca74fba None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:10.970367 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb39ed-aeb5-43fd-bfce-da487d15424d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:10.999184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23415a-5e4f-4656-96a5-1344eff15b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:10.999911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23415a-5e4f-4656-96a5-1344eff15b49 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:11.000295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23415a-5e4f-4656-96a5-1344eff15b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:11.001031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23415a-5e4f-4656-96a5-1344eff15b49 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:11.001507 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23415a-5e4f-4656-96a5-1344eff15b49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:11.001936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23415a-5e4f-4656-96a5-1344eff15b49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:11.004059 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23415a-5e4f-4656-96a5-1344eff15b49 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:11.022132 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 270/530] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:11.023088 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fb2bd-e461-4007-bdf0-7475f9fec210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:11.023730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fb2bd-e461-4007-bdf0-7475f9fec210 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:11.024017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fb2bd-e461-4007-bdf0-7475f9fec210 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:11.024332 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fb2bd-e461-4007-bdf0-7475f9fec210 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:11.025831 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23415a-5e4f-4656-96a5-1344eff15b49 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:11.041280 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:11.125004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fb2bd-e461-4007-bdf0-7475f9fec210 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:11.126662 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fb2bd-e461-4007-bdf0-7475f9fec210 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:11.142551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23415a-5e4f-4656-96a5-1344eff15b49 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:11.147231 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:11.185097 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcc0e6-2979-4f6d-b2ca-91e2c74036a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:11.185742 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcc0e6-2979-4f6d-b2ca-91e2c74036a6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:11.186027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcc0e6-2979-4f6d-b2ca-91e2c74036a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:11.186569 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcc0e6-2979-4f6d-b2ca-91e2c74036a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:11.187609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcc0e6-2979-4f6d-b2ca-91e2c74036a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:11.187921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcc0e6-2979-4f6d-b2ca-91e2c74036a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:11.190136 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcc0e6-2979-4f6d-b2ca-91e2c74036a6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:11.208332 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 271/531] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:11.209524 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcc0e6-2979-4f6d-b2ca-91e2c74036a6 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:11.269281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 261/532] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:12:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:12:11.270454 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fb2bd-e461-4007-bdf0-7475f9fec210 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:11.295225 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:11.340119 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcc0e6-2979-4f6d-b2ca-91e2c74036a6 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:11.378358 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fb2bd-e461-4007-bdf0-7475f9fec210 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:11.386792 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092820ae-b877-4305-8eaa-942f105b30aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:11.387457 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092820ae-b877-4305-8eaa-942f105b30aa None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:11.388258 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092820ae-b877-4305-8eaa-942f105b30aa None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:11.388554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092820ae-b877-4305-8eaa-942f105b30aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:11.396793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:11.399317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092820ae-b877-4305-8eaa-942f105b30aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:11.401748 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092820ae-b877-4305-8eaa-942f105b30aa None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:11.418322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-092820ae-b877-4305-8eaa-942f105b30aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:11.418322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:11.418322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:11.418322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:11.418322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:11.418322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:11.418322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:11.418322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:11.418322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:11.418322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:11.418322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:11.418322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:11.418322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:11.418322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:11.418322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:11.419155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:11.419155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:11.419155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:11.419155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:11.419155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:11.419155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:11.419155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:11.419155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:11.419155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:11.419155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:11.419155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:11.419155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:11.419155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:11.419155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:11.419155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:11.419155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:11.419155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:11.419976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:11.419976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:11.419976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:11.419976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:11.419976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:11.419976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:11.419976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:11.419976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:11.419976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 272/533] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:11.425875 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092820ae-b877-4305-8eaa-942f105b30aa None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:11.428746 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43b8c5-1684-45ec-a16f-e137d419263a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:11.429373 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43b8c5-1684-45ec-a16f-e137d419263a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:11.429654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43b8c5-1684-45ec-a16f-e137d419263a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:11.429926 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43b8c5-1684-45ec-a16f-e137d419263a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:11.430727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43b8c5-1684-45ec-a16f-e137d419263a None admin] RBAC: Adding query filter params (role.id=88ed5b6546c64ac09d03064e12ca7f10, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=0dc15e64c987488f812d1cdd0c82c7ea) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:11.431037 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43b8c5-1684-45ec-a16f-e137d419263a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:11.432722 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43b8c5-1684-45ec-a16f-e137d419263a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:11.441103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 262/534] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:12:11 2022] GET /identity/v3/role_assignments?user.id=0dc15e64c987488f812d1cdd0c82c7ea&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=88ed5b6546c64ac09d03064e12ca7f10 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:11.444651 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43b8c5-1684-45ec-a16f-e137d419263a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:11.630013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092820ae-b877-4305-8eaa-942f105b30aa None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:11.656332 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43b8c5-1684-45ec-a16f-e137d419263a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:11.678587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:11.685478 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d739a-03ee-453d-ade9-98b8ec418152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:11.686936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d739a-03ee-453d-ade9-98b8ec418152 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:11.687320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d739a-03ee-453d-ade9-98b8ec418152 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:11.687942 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d739a-03ee-453d-ade9-98b8ec418152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:11.701458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80588f7f-12f0-48c5-90eb-3a1d3d3a1c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:11.701773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d739a-03ee-453d-ade9-98b8ec418152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:11.702492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80588f7f-12f0-48c5-90eb-3a1d3d3a1c18 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:11.702969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80588f7f-12f0-48c5-90eb-3a1d3d3a1c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:11.703388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80588f7f-12f0-48c5-90eb-3a1d3d3a1c18 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:11.703657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d739a-03ee-453d-ade9-98b8ec418152 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:11.704691 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80588f7f-12f0-48c5-90eb-3a1d3d3a1c18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:11.705687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80588f7f-12f0-48c5-90eb-3a1d3d3a1c18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:11.707537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80588f7f-12f0-48c5-90eb-3a1d3d3a1c18 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:11.723175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-411d739a-03ee-453d-ade9-98b8ec418152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:11.723175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:11.723175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:11.723175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:11.723175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:11.723175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:11.723175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:11.723175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:11.723175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:11.723175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:11.723175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:11.723175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:11.723175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:11.723175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:11.723175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:11.724101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:11.724101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:11.724101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:11.724101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:11.724101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:11.724101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:11.724101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:11.724101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:11.724101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:11.724101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:11.724101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:11.724101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:11.724101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:11.724101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:11.724101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:11.724101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:11.724101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:11.724992 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:11.724992 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:11.724992 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:11.724992 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:11.724992 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 273/535] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:11.730799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d739a-03ee-453d-ade9-98b8ec418152 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:11.733608 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 263/536] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:11.739704 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80588f7f-12f0-48c5-90eb-3a1d3d3a1c18 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:11.809571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:11.856724 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d739a-03ee-453d-ade9-98b8ec418152 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:11.902647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f2b6a-5f63-4820-9054-7c9497679617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:11.903516 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f2b6a-5f63-4820-9054-7c9497679617 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:11.904872 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f2b6a-5f63-4820-9054-7c9497679617 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:11.908935 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f2b6a-5f63-4820-9054-7c9497679617 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:11.909822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f2b6a-5f63-4820-9054-7c9497679617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:11.910274 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f2b6a-5f63-4820-9054-7c9497679617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:11.911804 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f2b6a-5f63-4820-9054-7c9497679617 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:11.933626 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80588f7f-12f0-48c5-90eb-3a1d3d3a1c18 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:11.942731 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 274/537] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:11.953381 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f2b6a-5f63-4820-9054-7c9497679617 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:11.981675 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed816d-f90b-4a7c-b0ad-e5fa50490fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:11.982566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed816d-f90b-4a7c-b0ad-e5fa50490fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:11.982992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed816d-f90b-4a7c-b0ad-e5fa50490fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:11.983845 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed816d-f90b-4a7c-b0ad-e5fa50490fb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:11.985123 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed816d-f90b-4a7c-b0ad-e5fa50490fb9 None admin] RBAC: Adding query filter params (role.id=88ed5b6546c64ac09d03064e12ca7f10, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=180731bbc26c4681965dfd9cf0c1f063) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:11.985586 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed816d-f90b-4a7c-b0ad-e5fa50490fb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:11.987795 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed816d-f90b-4a7c-b0ad-e5fa50490fb9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:11.995788 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 264/538] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:12:11 2022] GET /identity/v3/role_assignments?user.id=180731bbc26c4681965dfd9cf0c1f063&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=88ed5b6546c64ac09d03064e12ca7f10 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:11.998237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c1507-9b33-4043-8b5d-d3016126c48a None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:11.998686 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c1507-9b33-4043-8b5d-d3016126c48a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:11.999107 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c1507-9b33-4043-8b5d-d3016126c48a None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:12.000987 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 265/539] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:12.008655 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13f071-3a0d-4515-8e9f-e1875bf71e3e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:12.009171 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13f071-3a0d-4515-8e9f-e1875bf71e3e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:12.009618 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13f071-3a0d-4515-8e9f-e1875bf71e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:12.009910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:12.052269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-1b13f071-3a0d-4515-8e9f-e1875bf71e3e None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:12.053521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1b13f071-3a0d-4515-8e9f-e1875bf71e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:12.101845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f2b6a-5f63-4820-9054-7c9497679617 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:12.148251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f6d1a-04e0-4766-a51f-43fe7d599e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:12.148886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f6d1a-04e0-4766-a51f-43fe7d599e4b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:12.149171 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f6d1a-04e0-4766-a51f-43fe7d599e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:12.152192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f6d1a-04e0-4766-a51f-43fe7d599e4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:12.157120 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f6d1a-04e0-4766-a51f-43fe7d599e4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:12.159374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f6d1a-04e0-4766-a51f-43fe7d599e4b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:12.166629 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 266/540] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:12.167938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1d241-1901-46fe-a1d3-248d3251bd12 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:12.171573 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1d241-1901-46fe-a1d3-248d3251bd12 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:12.172089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1d241-1901-46fe-a1d3-248d3251bd12 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:12.173187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-bc6f6d1a-04e0-4766-a51f-43fe7d599e4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:12.173187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:12.173187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:12.173187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:12.173187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:12.173187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:12.173187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:12.173187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:12.173187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:12.173187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:12.173187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:12.173187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:12.173187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:12.173187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:12.173187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:12.174551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:12.174551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:12.174551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:12.174551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:12.174551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:12.174551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:12.174551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:12.174551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:12.174551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:12.174551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:12.174551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:12.174551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:12.174551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:12.174551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:12.174551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:12.174551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:12.174551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:12.175561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:12.175561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:12.175561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:12.175561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:12.175561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:12.175561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:12.175561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:12.175561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:12.177243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 267/542] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:12.180131 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 275/542] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:12.181236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1d241-1901-46fe-a1d3-248d3251bd12 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:12.184739 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55310105-c925-4cf6-9862-41c7a54bea09 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:12.185207 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55310105-c925-4cf6-9862-41c7a54bea09 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:12.185710 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55310105-c925-4cf6-9862-41c7a54bea09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:12.205970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-55310105-c925-4cf6-9862-41c7a54bea09 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:12.207511 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-55310105-c925-4cf6-9862-41c7a54bea09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:12.223613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:12.293866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 276/543] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:12.295167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55310105-c925-4cf6-9862-41c7a54bea09 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:12.324735 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1d241-1901-46fe-a1d3-248d3251bd12 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:12.344861 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:12.369572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fa9a1-5571-454b-889a-3e2088a7f601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:12.370205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fa9a1-5571-454b-889a-3e2088a7f601 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:12.370493 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fa9a1-5571-454b-889a-3e2088a7f601 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:12.370765 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fa9a1-5571-454b-889a-3e2088a7f601 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:12.371521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fa9a1-5571-454b-889a-3e2088a7f601 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:12.371828 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fa9a1-5571-454b-889a-3e2088a7f601 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:12.373991 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fa9a1-5571-454b-889a-3e2088a7f601 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:12.392304 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 268/544] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:12.394030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fa9a1-5571-454b-889a-3e2088a7f601 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:12.430777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55310105-c925-4cf6-9862-41c7a54bea09 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:12.476195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c072ed-0dd8-4b0e-8b5c-e05e2a1bd2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:12.476871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c072ed-0dd8-4b0e-8b5c-e05e2a1bd2cb None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:12.477138 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c072ed-0dd8-4b0e-8b5c-e05e2a1bd2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:12.477414 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c072ed-0dd8-4b0e-8b5c-e05e2a1bd2cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:12.491357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c072ed-0dd8-4b0e-8b5c-e05e2a1bd2cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:12.498270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-35c072ed-0dd8-4b0e-8b5c-e05e2a1bd2cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:12.498270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:12.498270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:12.498270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:12.498270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:12.498270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:12.498270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:12.498270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:12.498270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:12.498270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:12.498270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:12.498270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:12.498270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:12.498270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:12.498270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:12.498270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:12.499129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:12.499129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:12.499129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:12.499129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:12.499129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:12.499129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:12.499129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:12.499129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:12.499129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:12.499129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:12.499129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:12.499129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:12.499129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:12.499129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:12.499129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:12.499129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:12.499918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:12.499918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:12.499918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:12.499918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:12.499918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:12.499918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:12.499918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:12.499918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:12.499918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:12.499918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:12.499918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:12.499918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:12.499918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 277/545] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:12.500575 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c072ed-0dd8-4b0e-8b5c-e05e2a1bd2cb None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:12.509757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:12.521704 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fa9a1-5571-454b-889a-3e2088a7f601 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:12.560589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6a0ef-04ed-4ac5-90ef-c44435de50cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:12.562016 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6a0ef-04ed-4ac5-90ef-c44435de50cc None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:12.562478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6a0ef-04ed-4ac5-90ef-c44435de50cc None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:12.562961 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6a0ef-04ed-4ac5-90ef-c44435de50cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:12.575636 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6a0ef-04ed-4ac5-90ef-c44435de50cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:12.582062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-73b6a0ef-04ed-4ac5-90ef-c44435de50cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:12.582062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:12.582062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:12.582062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:12.582062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:12.582062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:12.582062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:12.582062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:12.582062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:12.582062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:12.582062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:12.582062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:12.582062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:12.582062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:12.582062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:12.582062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:12.582924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:12.582924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:12.582924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:12.582924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:12.582924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:12.582924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:12.582924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:12.582924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:12.582924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:12.582924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:12.582924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:12.582924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:12.582924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:12.582924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:12.582924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:12.582924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:12.583684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:12.583684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:12.583684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:12.583684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:12.583684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:12.583684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:12.583684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:12.583684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:12.583684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:12.583684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:12.583684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:12.583684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:12.590732 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 269/546] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:12.591712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6a0ef-04ed-4ac5-90ef-c44435de50cc None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:12.613875 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:12.625964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c072ed-0dd8-4b0e-8b5c-e05e2a1bd2cb None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:12.663786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cdeb6-d330-4ee0-aaa1-3bf1252e4c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:12.664710 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cdeb6-d330-4ee0-aaa1-3bf1252e4c78 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:12.665138 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cdeb6-d330-4ee0-aaa1-3bf1252e4c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:12.665552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cdeb6-d330-4ee0-aaa1-3bf1252e4c78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:12.666579 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0cdeb6-d330-4ee0-aaa1-3bf1252e4c78 None admin] RBAC: Adding query filter params (role.id=88ed5b6546c64ac09d03064e12ca7f10, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=2021ac71491f4bebb0fbd91c533dc383) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:12.667052 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0cdeb6-d330-4ee0-aaa1-3bf1252e4c78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:12.668752 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0cdeb6-d330-4ee0-aaa1-3bf1252e4c78 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:12.675611 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 278/547] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:12:12 2022] GET /identity/v3/role_assignments?user.id=2021ac71491f4bebb0fbd91c533dc383&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=88ed5b6546c64ac09d03064e12ca7f10 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:12.676620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cdeb6-d330-4ee0-aaa1-3bf1252e4c78 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:12.755003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6a0ef-04ed-4ac5-90ef-c44435de50cc None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:12.840215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739f982-4b4d-413f-b7fc-d1e4c7d52eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:12.841206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739f982-4b4d-413f-b7fc-d1e4c7d52eaf None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:12.841637 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739f982-4b4d-413f-b7fc-d1e4c7d52eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:12.842056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739f982-4b4d-413f-b7fc-d1e4c7d52eaf None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:12.842959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739f982-4b4d-413f-b7fc-d1e4c7d52eaf None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:12.843495 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739f982-4b4d-413f-b7fc-d1e4c7d52eaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:12.847588 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739f982-4b4d-413f-b7fc-d1e4c7d52eaf None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:12.866780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 270/548] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:12.872535 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739f982-4b4d-413f-b7fc-d1e4c7d52eaf None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:12.883261 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cdeb6-d330-4ee0-aaa1-3bf1252e4c78 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:12.902455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:12.921521 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69870189-fa63-4d75-9a76-800778ed06d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:12.922140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69870189-fa63-4d75-9a76-800778ed06d2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:12.922423 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69870189-fa63-4d75-9a76-800778ed06d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:12.922699 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69870189-fa63-4d75-9a76-800778ed06d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:12.923563 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69870189-fa63-4d75-9a76-800778ed06d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:12.924629 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69870189-fa63-4d75-9a76-800778ed06d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:12.926354 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69870189-fa63-4d75-9a76-800778ed06d2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:12.936008 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 279/549] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:12.942426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69870189-fa63-4d75-9a76-800778ed06d2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:12.982183 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:13.063839 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739f982-4b4d-413f-b7fc-d1e4c7d52eaf None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:13.102041 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69f62a-70ef-423c-ae70-9b6a530d03e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:13.102700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69f62a-70ef-423c-ae70-9b6a530d03e9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:13.102988 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69f62a-70ef-423c-ae70-9b6a530d03e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:13.103267 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69f62a-70ef-423c-ae70-9b6a530d03e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:13.115257 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69f62a-70ef-423c-ae70-9b6a530d03e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:13.116755 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69f62a-70ef-423c-ae70-9b6a530d03e9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:13.133940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-7b69f62a-70ef-423c-ae70-9b6a530d03e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:13.133940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:13.133940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:13.133940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:13.133940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:13.133940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:13.133940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:13.133940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:13.133940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:13.133940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:13.133940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:13.133940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:13.133940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:13.133940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:13.133940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:13.135299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:13.135299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:13.135299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:13.135299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:13.135299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:13.135299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:13.135299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:13.135299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:13.135299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:13.135299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:13.135299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:13.135299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:13.135299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:13.135299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:13.135299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:13.135299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:13.135299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:13.136506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:13.136506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:13.136506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:13.136506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:13.136506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 271/550] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:13.142536 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69f62a-70ef-423c-ae70-9b6a530d03e9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:13.164850 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69870189-fa63-4d75-9a76-800778ed06d2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:13.234856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09fd14-cc83-4c64-a52e-224f80fe7313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:13.235512 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09fd14-cc83-4c64-a52e-224f80fe7313 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:13.235797 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09fd14-cc83-4c64-a52e-224f80fe7313 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:13.236158 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09fd14-cc83-4c64-a52e-224f80fe7313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:13.255152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09fd14-cc83-4c64-a52e-224f80fe7313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:13.256650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09fd14-cc83-4c64-a52e-224f80fe7313 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:13.270466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:13.288495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-2c09fd14-cc83-4c64-a52e-224f80fe7313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:13.288495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:13.288495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:13.288495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:13.288495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:13.288495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:13.288495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:13.288495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:13.288495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:13.288495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:13.288495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:13.288495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:13.288495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:13.288495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:13.288495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:13.289376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:13.289376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:13.289376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:13.289376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:13.289376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:13.289376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:13.289376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:13.289376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:13.289376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:13.289376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:13.289376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:13.289376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:13.289376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:13.289376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:13.289376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:13.289376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:13.289376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:13.290365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:13.290365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:13.290365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:13.290365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:13.291733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 280/551] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:13.297719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09fd14-cc83-4c64-a52e-224f80fe7313 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:13.339945 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69f62a-70ef-423c-ae70-9b6a530d03e9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:13.404096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:13.424878 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5047eec-f928-4151-9145-4e6d92f9cb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:13.425511 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5047eec-f928-4151-9145-4e6d92f9cb1d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:13.425796 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5047eec-f928-4151-9145-4e6d92f9cb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:13.426074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5047eec-f928-4151-9145-4e6d92f9cb1d None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:13.429469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5047eec-f928-4151-9145-4e6d92f9cb1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:13.429790 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5047eec-f928-4151-9145-4e6d92f9cb1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:13.431186 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5047eec-f928-4151-9145-4e6d92f9cb1d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:13.453140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09fd14-cc83-4c64-a52e-224f80fe7313 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:13.458259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 272/552] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:13.461667 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5047eec-f928-4151-9145-4e6d92f9cb1d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:13.521699 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bb885-3f57-4b4f-b6a0-2befbe5546d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:13.522339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bb885-3f57-4b4f-b6a0-2befbe5546d5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:13.522623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bb885-3f57-4b4f-b6a0-2befbe5546d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:13.522901 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bb885-3f57-4b4f-b6a0-2befbe5546d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:13.523605 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bb885-3f57-4b4f-b6a0-2befbe5546d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:13.523911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bb885-3f57-4b4f-b6a0-2befbe5546d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:13.529657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bb885-3f57-4b4f-b6a0-2befbe5546d5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:13.554400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 281/553] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:13.560470 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bb885-3f57-4b4f-b6a0-2befbe5546d5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:13.648535 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5047eec-f928-4151-9145-4e6d92f9cb1d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:13.694914 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:13.713360 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b4345-31ea-4d4b-9a4e-5d9e581ae941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:13.714014 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b4345-31ea-4d4b-9a4e-5d9e581ae941 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:13.714299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b4345-31ea-4d4b-9a4e-5d9e581ae941 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:13.714577 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b4345-31ea-4d4b-9a4e-5d9e581ae941 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:13.718968 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bb885-3f57-4b4f-b6a0-2befbe5546d5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:13.731252 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b4345-31ea-4d4b-9a4e-5d9e581ae941 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:13.732742 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b4345-31ea-4d4b-9a4e-5d9e581ae941 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:13.749426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-c34b4345-31ea-4d4b-9a4e-5d9e581ae941 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 10:12:13.749426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:13.749426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:13.749426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:13.749426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:13.749426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:13.749426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:13.749426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:13.749426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:13.749426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:13.749426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:13.749426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:13.749426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:13.749426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:13.749426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:13.749426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:13.750643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:13.750643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:13.750643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:13.750643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:13.750643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:13.750643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:13.750643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:13.750643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:13.750643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:13.750643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:13.750643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:13.750643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:13.750643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:13.750643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:13.750643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:13.750643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:13.750643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:13.750643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:13.752066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:13.752066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:13.752066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:13.752066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:13.752066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:13.752066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:13.752066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:13.752066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:13.752066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 10:12:13.752066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:13.752066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 273/554] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:12:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:13.765859 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b4345-31ea-4d4b-9a4e-5d9e581ae941 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:13.773077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:13.782099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb5f52-d907-4fb8-93dc-158b70c76653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:13.783627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb5f52-d907-4fb8-93dc-158b70c76653 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:13.784091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb5f52-d907-4fb8-93dc-158b70c76653 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:13.784633 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb5f52-d907-4fb8-93dc-158b70c76653 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:13.793329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb5f52-d907-4fb8-93dc-158b70c76653 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:13.795580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb5f52-d907-4fb8-93dc-158b70c76653 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:13.811810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-acfb5f52-d907-4fb8-93dc-158b70c76653 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 10:12:13.811810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:13.811810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:13.811810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:13.811810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:13.811810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:13.811810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:13.811810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:13.811810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:13.811810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:13.811810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:13.811810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:13.811810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:13.811810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:13.811810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:13.811810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:13.812791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:13.812791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:13.812791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:13.812791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:13.812791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:13.812791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:13.812791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:13.812791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:13.812791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:13.812791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:13.812791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:13.812791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:13.812791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:13.812791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:13.812791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:13.812791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:13.812791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:13.812791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:13.814222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:13.814222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:13.814222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:13.814222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:13.814222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:13.814222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:13.814222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:13.814222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:13.814222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 10:12:13.814222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:13.817268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 282/555] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Aug 4 10:12:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:13.822511 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb5f52-d907-4fb8-93dc-158b70c76653 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:13.934035 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb5f52-d907-4fb8-93dc-158b70c76653 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:13.948005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b4345-31ea-4d4b-9a4e-5d9e581ae941 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:13.976005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7599460-5438-45b0-9dfc-ae753f0df963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:13.977177 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7599460-5438-45b0-9dfc-ae753f0df963 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:13.977609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7599460-5438-45b0-9dfc-ae753f0df963 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:13.978438 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7599460-5438-45b0-9dfc-ae753f0df963 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:13.979657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7599460-5438-45b0-9dfc-ae753f0df963 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:13.980129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7599460-5438-45b0-9dfc-ae753f0df963 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:13.982623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7599460-5438-45b0-9dfc-ae753f0df963 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:13.986687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235656b-d4b2-424e-b2c9-09f8f9627d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:13.987047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235656b-d4b2-424e-b2c9-09f8f9627d30 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:13.987423 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235656b-d4b2-424e-b2c9-09f8f9627d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:13.987820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235656b-d4b2-424e-b2c9-09f8f9627d30 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:13.988757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235656b-d4b2-424e-b2c9-09f8f9627d30 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:13.989163 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235656b-d4b2-424e-b2c9-09f8f9627d30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:13.990711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235656b-d4b2-424e-b2c9-09f8f9627d30 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:14.004801 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 283/556] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Aug 4 10:12:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:14.006281 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a130c9-dad7-40ba-aaf9-eef9eb7b8d31 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:14.006723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a130c9-dad7-40ba-aaf9-eef9eb7b8d31 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:14.007130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a130c9-dad7-40ba-aaf9-eef9eb7b8d31 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:14.008770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 284/557] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:14.016337 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a130c9-dad7-40ba-aaf9-eef9eb7b8d31 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:14.045032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 274/558] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Aug 4 10:12:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:14.046594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad62fc-bbb0-4c1a-aedb-5eb64d25399c None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:14.046978 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad62fc-bbb0-4c1a-aedb-5eb64d25399c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:14.047351 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad62fc-bbb0-4c1a-aedb-5eb64d25399c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:14.066755 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-2aad62fc-bbb0-4c1a-aedb-5eb64d25399c None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:14.068085 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2aad62fc-bbb0-4c1a-aedb-5eb64d25399c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:14.082204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:14.114913 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:14.147630 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 275/559] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:14.148654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad62fc-bbb0-4c1a-aedb-5eb64d25399c None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:14.166524 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a130c9-dad7-40ba-aaf9-eef9eb7b8d31 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:14.204196 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70299667-6085-4a4a-8bfb-9846f664289b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:14.204779 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70299667-6085-4a4a-8bfb-9846f664289b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:14.205585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70299667-6085-4a4a-8bfb-9846f664289b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:14.205866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70299667-6085-4a4a-8bfb-9846f664289b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:14.216744 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70299667-6085-4a4a-8bfb-9846f664289b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:14.218213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70299667-6085-4a4a-8bfb-9846f664289b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:14.233426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-70299667-6085-4a4a-8bfb-9846f664289b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:14.233426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:14.233426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:14.233426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:14.233426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:14.233426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:14.233426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:14.233426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:14.233426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:14.233426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:14.233426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:14.233426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:14.233426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:14.233426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:14.233426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:14.234292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:14.234292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:14.234292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:14.234292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:14.234292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:14.234292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:14.234292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:14.234292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:14.234292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:14.234292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:14.234292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:14.234292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:14.234292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:14.234292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:14.234292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:14.234292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:14.234292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:14.235139 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:14.235139 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:14.235139 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:14.235139 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:14.235139 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 285/560] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:14.235729 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c719ee6-7dae-45ee-9172-10515b878a5c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:14.236013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c719ee6-7dae-45ee-9172-10515b878a5c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:14.236349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c719ee6-7dae-45ee-9172-10515b878a5c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:14.237582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 286/561] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:14.238271 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c719ee6-7dae-45ee-9172-10515b878a5c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:14.268710 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad62fc-bbb0-4c1a-aedb-5eb64d25399c None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:14.304591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25aba5-29aa-4736-89eb-646792480edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:14.305212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25aba5-29aa-4736-89eb-646792480edd None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:14.305496 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25aba5-29aa-4736-89eb-646792480edd None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:14.305777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25aba5-29aa-4736-89eb-646792480edd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:14.342179 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:14.347314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c719ee6-7dae-45ee-9172-10515b878a5c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:14.352040 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:14.384743 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25aba5-29aa-4736-89eb-646792480edd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:14.386222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25aba5-29aa-4736-89eb-646792480edd None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:14.387912 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dc509-87e5-46b5-986a-c68c59c9d4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:14.388612 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dc509-87e5-46b5-986a-c68c59c9d4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:14.388894 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dc509-87e5-46b5-986a-c68c59c9d4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:14.389169 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dc509-87e5-46b5-986a-c68c59c9d4c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:14.405788 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3dc509-87e5-46b5-986a-c68c59c9d4c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:14.411303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-4a3dc509-87e5-46b5-986a-c68c59c9d4c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:14.411303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:14.411303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:14.411303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:14.411303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:14.411303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:14.411303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:14.411303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:14.411303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:14.411303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:14.411303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:14.411303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:14.411303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:14.411303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:14.411303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:14.411303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:14.412276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:14.412276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:14.412276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:14.412276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:14.412276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:14.412276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:14.412276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:14.412276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:14.412276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:14.412276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:14.412276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:14.412276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:14.412276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:14.412276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:14.412276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:14.412276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:14.413160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:14.413160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:14.413160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:14.413160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:14.413160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:14.413160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:14.413160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:14.413160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:14.413160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:14.413160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:14.413160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:14.413160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:14.413160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 287/562] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:14.414460 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dc509-87e5-46b5-986a-c68c59c9d4c2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:14.511890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 276/563] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:12:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:12:14.513079 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4defb-a4f7-4a90-b28c-e4bb884ab2e5 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:14.513365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4defb-a4f7-4a90-b28c-e4bb884ab2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:14.513635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4defb-a4f7-4a90-b28c-e4bb884ab2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:14.525953 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dc509-87e5-46b5-986a-c68c59c9d4c2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:14.533741 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-26f4defb-a4f7-4a90-b28c-e4bb884ab2e5 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:14.534435 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-26f4defb-a4f7-4a90-b28c-e4bb884ab2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:14.573275 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c63ed2-0848-45cd-ba4d-cc0461342bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:14.574176 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c63ed2-0848-45cd-ba4d-cc0461342bbf None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:14.574877 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c63ed2-0848-45cd-ba4d-cc0461342bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:14.575322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c63ed2-0848-45cd-ba4d-cc0461342bbf None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:14.576231 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c63ed2-0848-45cd-ba4d-cc0461342bbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:14.576689 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c63ed2-0848-45cd-ba4d-cc0461342bbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:14.578223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c63ed2-0848-45cd-ba4d-cc0461342bbf None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:14.591508 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 288/564] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:14.592375 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c63ed2-0848-45cd-ba4d-cc0461342bbf None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:14.615248 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:14.628188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 277/565] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:14.628188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4defb-a4f7-4a90-b28c-e4bb884ab2e5 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:14.632308 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:14.723908 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c63ed2-0848-45cd-ba4d-cc0461342bbf None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:14.742563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4defb-a4f7-4a90-b28c-e4bb884ab2e5 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:14.763623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc24e0-d33a-4d52-8098-50f792297c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:14.764186 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc24e0-d33a-4d52-8098-50f792297c4c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:14.764483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc24e0-d33a-4d52-8098-50f792297c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:14.764766 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc24e0-d33a-4d52-8098-50f792297c4c None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:14.765486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc24e0-d33a-4d52-8098-50f792297c4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:14.765906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc24e0-d33a-4d52-8098-50f792297c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:14.767287 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc24e0-d33a-4d52-8098-50f792297c4c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:14.780635 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 289/566] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:12:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:14.782086 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc24e0-d33a-4d52-8098-50f792297c4c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:14.783185 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d55af-f3b1-4f16-abf5-34a2f79278f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:14.783951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d55af-f3b1-4f16-abf5-34a2f79278f9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:14.784330 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d55af-f3b1-4f16-abf5-34a2f79278f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:14.784610 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d55af-f3b1-4f16-abf5-34a2f79278f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:14.803128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d55af-f3b1-4f16-abf5-34a2f79278f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:14.805229 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d55af-f3b1-4f16-abf5-34a2f79278f9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:14.825248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-c30d55af-f3b1-4f16-abf5-34a2f79278f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:14.825248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:14.825248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:14.825248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:14.825248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:14.825248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:14.825248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:14.825248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:14.825248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:14.825248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:14.825248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:14.825248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:14.825248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:14.825248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:14.825248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:14.826413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:14.826413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:14.826413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:14.826413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:14.826413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:14.826413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:14.826413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:14.826413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:14.826413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:14.826413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:14.826413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:14.826413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:14.826413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:14.826413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:14.826413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:14.826413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:14.826413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:14.827430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:14.827430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:14.827430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:14.827430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:14.827890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 278/567] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:14.828409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d55af-f3b1-4f16-abf5-34a2f79278f9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:14.884090 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:14.891484 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:14.903670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc24e0-d33a-4d52-8098-50f792297c4c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:14.940656 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d55af-f3b1-4f16-abf5-34a2f79278f9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:14.942313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd09e2f-1327-4cec-8488-768f76892e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:14.942950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd09e2f-1327-4cec-8488-768f76892e75 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:14.943874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd09e2f-1327-4cec-8488-768f76892e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:14.943874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd09e2f-1327-4cec-8488-768f76892e75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:14.950465 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd09e2f-1327-4cec-8488-768f76892e75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:14.951905 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd09e2f-1327-4cec-8488-768f76892e75 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:14.963771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-6bd09e2f-1327-4cec-8488-768f76892e75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:14.963771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:14.963771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:14.963771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:14.963771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:14.963771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:14.963771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:14.963771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:14.963771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:14.963771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:14.963771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:14.963771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:14.963771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:14.963771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:14.963771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:14.964711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:14.964711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:14.964711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:14.964711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:14.964711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:14.964711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:14.964711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:14.964711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:14.964711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:14.964711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:14.964711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:14.964711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:14.964711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:14.964711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:14.964711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:14.964711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:14.964711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:14.965559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:14.965559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:14.965559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:14.965559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:14.965559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:14.965559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:14.965559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:14.965559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:14.965559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 290/568] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:14.966758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd09e2f-1327-4cec-8488-768f76892e75 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:14.981800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b90ef8-b925-43b8-99fa-ccefe8fbc075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:14.982582 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b90ef8-b925-43b8-99fa-ccefe8fbc075 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:14.982875 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b90ef8-b925-43b8-99fa-ccefe8fbc075 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:14.983161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b90ef8-b925-43b8-99fa-ccefe8fbc075 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:14.994449 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b90ef8-b925-43b8-99fa-ccefe8fbc075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:14.999943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-a4b90ef8-b925-43b8-99fa-ccefe8fbc075 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:14.999943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:14.999943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:14.999943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:14.999943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:14.999943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:14.999943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:14.999943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:14.999943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:14.999943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:14.999943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:14.999943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:14.999943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:14.999943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:14.999943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:14.999943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:15.000906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:15.000906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:15.000906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:15.000906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:15.000906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:15.000906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:15.000906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:15.000906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:15.000906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:15.000906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:15.000906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:15.000906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:15.000906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:15.000906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:15.000906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:15.000906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:15.006897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:15.006897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:15.006897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:15.006897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:15.006897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:15.006897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:15.006897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:15.006897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:15.006897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:15.006897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:15.006897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:15.006897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:15.006897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 279/569] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:15.006897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b90ef8-b925-43b8-99fa-ccefe8fbc075 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:15.075330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd09e2f-1327-4cec-8488-768f76892e75 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:15.108577 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b90ef8-b925-43b8-99fa-ccefe8fbc075 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:15.110010 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25d48e-82ca-403d-a8a6-df0181c10f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:15.110621 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25d48e-82ca-403d-a8a6-df0181c10f6f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:15.110907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25d48e-82ca-403d-a8a6-df0181c10f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:15.111206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25d48e-82ca-403d-a8a6-df0181c10f6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:15.121757 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25d48e-82ca-403d-a8a6-df0181c10f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:15.123193 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25d48e-82ca-403d-a8a6-df0181c10f6f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:15.124757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:15.124886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:15.139282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-4a25d48e-82ca-403d-a8a6-df0181c10f6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:15.139282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:15.139282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:15.139282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:15.139282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:15.139282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:15.139282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:15.139282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:15.139282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:15.139282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:15.139282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:15.139282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:15.139282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:15.139282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:15.139282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:15.140433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:15.140433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:15.140433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:15.140433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:15.140433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:15.140433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:15.140433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:15.140433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:15.140433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:15.140433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:15.140433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:15.140433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:15.140433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:15.140433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:15.140433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:15.140433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:15.140433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:15.141296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:15.141296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:15.141296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:15.141296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:15.141296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 291/570] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:15.141296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25d48e-82ca-403d-a8a6-df0181c10f6f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:15.149156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08eac7d-3fb5-4427-b5ff-2dde6b64678b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:15.149783 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eac7d-3fb5-4427-b5ff-2dde6b64678b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:15.150063 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eac7d-3fb5-4427-b5ff-2dde6b64678b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:15.150335 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eac7d-3fb5-4427-b5ff-2dde6b64678b None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:15.151029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08eac7d-3fb5-4427-b5ff-2dde6b64678b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:15.151334 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08eac7d-3fb5-4427-b5ff-2dde6b64678b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:15.152738 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08eac7d-3fb5-4427-b5ff-2dde6b64678b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:15.167433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 280/571] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:15.168342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08eac7d-3fb5-4427-b5ff-2dde6b64678b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:15.244143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25d48e-82ca-403d-a8a6-df0181c10f6f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:15.269976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08eac7d-3fb5-4427-b5ff-2dde6b64678b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:15.278415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e0123-fef6-4afd-bfe9-b73d7e08715d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:15.279042 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e0123-fef6-4afd-bfe9-b73d7e08715d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:15.279325 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e0123-fef6-4afd-bfe9-b73d7e08715d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:15.279601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e0123-fef6-4afd-bfe9-b73d7e08715d None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:15.280375 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e0123-fef6-4afd-bfe9-b73d7e08715d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:15.280687 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e0123-fef6-4afd-bfe9-b73d7e08715d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:15.282143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e0123-fef6-4afd-bfe9-b73d7e08715d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:15.294081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 292/572] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:15.295284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fe86e-b4e1-41f9-b0c6-78bcb64cebf0 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:15.295570 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fe86e-b4e1-41f9-b0c6-78bcb64cebf0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:15.295856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fe86e-b4e1-41f9-b0c6-78bcb64cebf0 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:15.300223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 293/573] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:15.300223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fe86e-b4e1-41f9-b0c6-78bcb64cebf0 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:15.307472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395caba-98a5-43d3-a1fa-a936594c58d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:15.308091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395caba-98a5-43d3-a1fa-a936594c58d4 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:15.308399 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395caba-98a5-43d3-a1fa-a936594c58d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:15.308672 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395caba-98a5-43d3-a1fa-a936594c58d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:15.309417 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395caba-98a5-43d3-a1fa-a936594c58d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:15.309722 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395caba-98a5-43d3-a1fa-a936594c58d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:15.311327 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395caba-98a5-43d3-a1fa-a936594c58d4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:15.320282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 281/574] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:12:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:15.322217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395caba-98a5-43d3-a1fa-a936594c58d4 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:15.357788 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:15.362443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:15.403042 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fe86e-b4e1-41f9-b0c6-78bcb64cebf0 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:15.422586 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395caba-98a5-43d3-a1fa-a936594c58d4 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:15.436734 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402143f-e10d-44d5-8348-5801c3fa9ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:15.437416 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402143f-e10d-44d5-8348-5801c3fa9ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:15.437761 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402143f-e10d-44d5-8348-5801c3fa9ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:15.438043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402143f-e10d-44d5-8348-5801c3fa9ee7 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:15.438728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402143f-e10d-44d5-8348-5801c3fa9ee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:15.439032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402143f-e10d-44d5-8348-5801c3fa9ee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:15.441139 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402143f-e10d-44d5-8348-5801c3fa9ee7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:15.452302 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 294/575] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:15.453060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402143f-e10d-44d5-8348-5801c3fa9ee7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:15.457922 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fc5d1-7670-4dda-ac23-18de8a188db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:15.458562 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fc5d1-7670-4dda-ac23-18de8a188db0 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:15.458843 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fc5d1-7670-4dda-ac23-18de8a188db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:15.459126 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fc5d1-7670-4dda-ac23-18de8a188db0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:15.466065 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fc5d1-7670-4dda-ac23-18de8a188db0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:15.467496 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fc5d1-7670-4dda-ac23-18de8a188db0 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:15.478900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-f50fc5d1-7670-4dda-ac23-18de8a188db0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:15.478900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:15.478900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:15.478900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:15.478900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:15.478900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:15.478900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:15.478900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:15.478900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:15.478900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:15.478900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:15.478900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:15.478900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:15.478900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:15.478900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:15.479932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:15.479932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:15.479932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:15.479932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:15.479932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:15.479932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:15.479932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:15.479932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:15.479932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:15.479932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:15.479932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:15.479932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:15.479932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:15.479932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:15.479932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:15.479932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:15.479932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:15.481321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:15.481321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:15.481321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:15.481321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:15.481321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:15.481321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:15.481321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:15.481321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:15.481321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 282/576] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:15.481321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa8c7e-5e10-4c03-9170-35c5ccd1b1f3 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:15.481850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa8c7e-5e10-4c03-9170-35c5ccd1b1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:15.481850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa8c7e-5e10-4c03-9170-35c5ccd1b1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:15.501310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-55aa8c7e-5e10-4c03-9170-35c5ccd1b1f3 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:15.503341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-55aa8c7e-5e10-4c03-9170-35c5ccd1b1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:15.560065 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402143f-e10d-44d5-8348-5801c3fa9ee7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:15.574443 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:15.577057 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 283/577] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:15.577897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa8c7e-5e10-4c03-9170-35c5ccd1b1f3 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:15.601608 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdbe36-fb51-4786-9510-895b85068c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:15.602429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdbe36-fb51-4786-9510-895b85068c0c None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:15.602816 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdbe36-fb51-4786-9510-895b85068c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:15.603199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdbe36-fb51-4786-9510-895b85068c0c None admin] PATH_INFO: `/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/592539924feb44ad8ea520d8539b6608/roles/88ed5b6546c64ac09d03064e12ca7f10` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:15.617473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:15.621443 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdbe36-fb51-4786-9510-895b85068c0c None admin] RBAC: Authorizing `identity:create_grant(project_id=7e37543156ee42a0818bf5cfe747fdc2, user_id=592539924feb44ad8ea520d8539b6608, role_id=88ed5b6546c64ac09d03064e12ca7f10)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:15.623107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdbe36-fb51-4786-9510-895b85068c0c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:15.635908 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 295/578] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:12:15 2022] PUT /identity/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/592539924feb44ad8ea520d8539b6608/roles/88ed5b6546c64ac09d03064e12ca7f10 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:12:15.636747 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdbe36-fb51-4786-9510-895b85068c0c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:15.707927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa8c7e-5e10-4c03-9170-35c5ccd1b1f3 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:15.747362 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4ab99-2f19-4a4e-9cde-374b07cb6f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:15.748135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4ab99-2f19-4a4e-9cde-374b07cb6f65 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:15.748455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4ab99-2f19-4a4e-9cde-374b07cb6f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:15.748735 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4ab99-2f19-4a4e-9cde-374b07cb6f65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:15.750247 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdbe36-fb51-4786-9510-895b85068c0c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:15.760804 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4ab99-2f19-4a4e-9cde-374b07cb6f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:15.762301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4ab99-2f19-4a4e-9cde-374b07cb6f65 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:15.778282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-4df4ab99-2f19-4a4e-9cde-374b07cb6f65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:15.778282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:15.778282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:15.778282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:15.778282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:15.778282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:15.778282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:15.778282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:15.778282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:15.778282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:15.778282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:15.778282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:15.778282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:15.778282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:15.778282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:15.779218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:15.779218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:15.779218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:15.779218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:15.779218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:15.779218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:15.779218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:15.779218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:15.779218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:15.779218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:15.779218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:15.779218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:15.779218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:15.779218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:15.779218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:15.779218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:15.779218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:15.780100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:15.780100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:15.780100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:15.780100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:15.780100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 284/579] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:15.780832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4ab99-2f19-4a4e-9cde-374b07cb6f65 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:15.799422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbce615-4f81-4a8c-ba67-0b34ece81d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:15.800187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbce615-4f81-4a8c-ba67-0b34ece81d89 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:15.800471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbce615-4f81-4a8c-ba67-0b34ece81d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:15.800754 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbce615-4f81-4a8c-ba67-0b34ece81d89 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:15.808248 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbce615-4f81-4a8c-ba67-0b34ece81d89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:15.809702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbce615-4f81-4a8c-ba67-0b34ece81d89 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:15.822640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-afbce615-4f81-4a8c-ba67-0b34ece81d89 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 10:12:15.822640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:15.822640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:15.822640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:15.822640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:15.822640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:15.822640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:15.822640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:15.822640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:15.822640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:15.822640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:15.822640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:15.822640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:15.822640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:15.822640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:15.822640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:15.823821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:15.823821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:15.823821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:15.823821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:15.823821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:15.823821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:15.823821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:15.823821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:15.823821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:15.823821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:15.823821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:15.823821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:15.823821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:15.823821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:15.823821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:15.823821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:15.823821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:15.823821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:15.825082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:15.825082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:15.825082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:15.825082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:15.825082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:15.825082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:15.825082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:15.825082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:15.825082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 10:12:15.825082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:15.826558 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 296/580] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:12:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:15.826669 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbce615-4f81-4a8c-ba67-0b34ece81d89 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:15.859622 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:15.878327 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:15.898333 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4ab99-2f19-4a4e-9cde-374b07cb6f65 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:15.935127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484074c0-1057-4d1e-b206-2bbf1f1aafa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:15.935755 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484074c0-1057-4d1e-b206-2bbf1f1aafa3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:15.936045 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484074c0-1057-4d1e-b206-2bbf1f1aafa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:15.936624 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484074c0-1057-4d1e-b206-2bbf1f1aafa3 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:15.937384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484074c0-1057-4d1e-b206-2bbf1f1aafa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:15.937697 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484074c0-1057-4d1e-b206-2bbf1f1aafa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:15.939122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484074c0-1057-4d1e-b206-2bbf1f1aafa3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:15.950850 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbce615-4f81-4a8c-ba67-0b34ece81d89 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:15.952257 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 285/581] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:15.953065 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484074c0-1057-4d1e-b206-2bbf1f1aafa3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:15.992575 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bf36a-7c69-42f3-a3d9-22dc48175411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:15.993229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bf36a-7c69-42f3-a3d9-22dc48175411 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:15.993515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bf36a-7c69-42f3-a3d9-22dc48175411 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:15.993797 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bf36a-7c69-42f3-a3d9-22dc48175411 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:16.004997 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615bf36a-7c69-42f3-a3d9-22dc48175411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:16.010462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-615bf36a-7c69-42f3-a3d9-22dc48175411 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:16.010462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:16.010462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:16.010462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:16.010462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:16.010462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:16.010462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:16.010462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:16.010462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:16.010462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:16.010462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:16.010462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:16.010462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:16.010462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:16.010462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:16.010462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:16.011432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:16.011432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:16.011432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:16.011432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:16.011432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:16.011432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:16.011432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:16.011432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:16.011432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:16.011432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:16.011432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:16.011432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:16.011432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:16.011432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:16.011432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:16.011432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:16.012288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:16.012288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:16.012288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:16.012288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:16.012288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:16.012288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:16.012288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:16.012288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:16.012288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:16.012288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:16.012288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:16.012288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:16.012288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 297/582] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:16.013027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bf36a-7c69-42f3-a3d9-22dc48175411 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:16.063004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484074c0-1057-4d1e-b206-2bbf1f1aafa3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:16.104409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4bcaa-2541-4fee-9931-2267322c525f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:16.105039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4bcaa-2541-4fee-9931-2267322c525f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:16.105325 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4bcaa-2541-4fee-9931-2267322c525f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:16.105623 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4bcaa-2541-4fee-9931-2267322c525f None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:16.106308 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4bcaa-2541-4fee-9931-2267322c525f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:16.106616 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4bcaa-2541-4fee-9931-2267322c525f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:16.108060 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4bcaa-2541-4fee-9931-2267322c525f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:16.114192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:16.118164 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:16.121945 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 286/583] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:16.128191 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4bcaa-2541-4fee-9931-2267322c525f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:16.134110 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bf36a-7c69-42f3-a3d9-22dc48175411 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:16.177475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d467d-b6cc-4a32-9ca0-a0a40c5cc37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:16.178579 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d467d-b6cc-4a32-9ca0-a0a40c5cc37c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:16.178870 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d467d-b6cc-4a32-9ca0-a0a40c5cc37c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:16.179431 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d467d-b6cc-4a32-9ca0-a0a40c5cc37c None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:16.180293 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d467d-b6cc-4a32-9ca0-a0a40c5cc37c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:16.180839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d467d-b6cc-4a32-9ca0-a0a40c5cc37c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:16.182569 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d467d-b6cc-4a32-9ca0-a0a40c5cc37c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:16.201842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 298/584] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Aug 4 10:12:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:16.202750 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d467d-b6cc-4a32-9ca0-a0a40c5cc37c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:16.238405 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4bcaa-2541-4fee-9931-2267322c525f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:16.274348 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd856a-5c38-4990-986d-66cafd1ce4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:16.275136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd856a-5c38-4990-986d-66cafd1ce4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:16.275544 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd856a-5c38-4990-986d-66cafd1ce4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:16.275926 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd856a-5c38-4990-986d-66cafd1ce4d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:16.276862 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd856a-5c38-4990-986d-66cafd1ce4d8 None admin] RBAC: Adding query filter params (role.id=88ed5b6546c64ac09d03064e12ca7f10, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=878797620be54b74a3e8582c78ba78d2) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:16.277347 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd856a-5c38-4990-986d-66cafd1ce4d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:16.278875 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd856a-5c38-4990-986d-66cafd1ce4d8 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:16.296197 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 287/585] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:12:16 2022] GET /identity/v3/role_assignments?user.id=878797620be54b74a3e8582c78ba78d2&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=88ed5b6546c64ac09d03064e12ca7f10 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:16.296197 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd856a-5c38-4990-986d-66cafd1ce4d8 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:16.328387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d467d-b6cc-4a32-9ca0-a0a40c5cc37c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:16.365922 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:16.367682 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0afde6-cb1b-451c-bb9b-205cbc768c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:16.368410 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0afde6-cb1b-451c-bb9b-205cbc768c18 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:16.368727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0afde6-cb1b-451c-bb9b-205cbc768c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:16.369102 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0afde6-cb1b-451c-bb9b-205cbc768c18 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:16.369871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0afde6-cb1b-451c-bb9b-205cbc768c18 None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:16.370163 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0afde6-cb1b-451c-bb9b-205cbc768c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:16.371592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0afde6-cb1b-451c-bb9b-205cbc768c18 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:16.387030 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 299/586] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:12:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:16.388041 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0afde6-cb1b-451c-bb9b-205cbc768c18 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:16.392231 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:16.415547 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd856a-5c38-4990-986d-66cafd1ce4d8 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:16.457631 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c972b-880f-4cdd-be2e-28852bd02dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:16.458520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c972b-880f-4cdd-be2e-28852bd02dfa None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:16.458902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c972b-880f-4cdd-be2e-28852bd02dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:16.459282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c972b-880f-4cdd-be2e-28852bd02dfa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:16.468189 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c972b-880f-4cdd-be2e-28852bd02dfa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:16.469857 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c972b-880f-4cdd-be2e-28852bd02dfa None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:16.482938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-113c972b-880f-4cdd-be2e-28852bd02dfa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 10:12:16.482938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:16.482938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:16.482938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:16.482938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:16.482938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:16.482938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:16.482938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:16.482938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:16.482938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:16.482938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:16.482938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:16.482938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:16.482938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:16.482938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:16.482938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:16.484103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:16.484103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:16.484103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:16.484103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:16.484103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:16.484103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:16.484103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:16.484103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:16.484103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:16.484103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:16.484103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:16.484103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:16.484103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:16.484103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:16.484103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:16.484103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:16.484103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:16.484103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:16.485236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:16.485236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:16.485236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:16.485236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:16.485236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:16.485236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:16.485236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:16.485236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:16.485236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 10:12:16.485236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:16.492345 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 288/587] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:12:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:16.492345 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c972b-880f-4cdd-be2e-28852bd02dfa None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:16.525599 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0afde6-cb1b-451c-bb9b-205cbc768c18 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:16.563182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e706e31-a462-4ee7-8236-96d6bb0cf1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:16.563830 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e706e31-a462-4ee7-8236-96d6bb0cf1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:16.564118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e706e31-a462-4ee7-8236-96d6bb0cf1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:16.564947 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e706e31-a462-4ee7-8236-96d6bb0cf1f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:16.578860 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e706e31-a462-4ee7-8236-96d6bb0cf1f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:16.581349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e706e31-a462-4ee7-8236-96d6bb0cf1f6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:16.600311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-8e706e31-a462-4ee7-8236-96d6bb0cf1f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:16.600311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:16.600311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:16.600311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:16.600311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:16.600311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:16.600311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:16.600311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:16.600311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:16.600311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:16.600311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:16.600311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:16.600311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:16.600311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:16.600311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:16.601384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:16.601384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:16.601384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:16.601384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:16.601384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:16.601384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:16.601384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:16.601384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:16.601384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:16.601384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:16.601384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:16.601384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:16.601384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:16.601384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:16.601384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:16.601384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:16.601384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:16.602857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:16.602857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:16.602857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:16.602857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:16.608187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 300/588] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:16.608187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e706e31-a462-4ee7-8236-96d6bb0cf1f6 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:16.609855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c972b-880f-4cdd-be2e-28852bd02dfa None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:16.640873 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:16.655207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe1790-293c-482f-b697-60585566f419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:16.656216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe1790-293c-482f-b697-60585566f419 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:16.656705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe1790-293c-482f-b697-60585566f419 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:16.657204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe1790-293c-482f-b697-60585566f419 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:16.669023 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe1790-293c-482f-b697-60585566f419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:16.670790 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe1790-293c-482f-b697-60585566f419 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:16.674479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:16.687726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-e6fe1790-293c-482f-b697-60585566f419 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:16.687726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:16.687726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:16.687726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:16.687726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:16.687726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:16.687726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:16.687726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:16.687726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:16.687726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:16.687726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:16.687726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:16.687726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:16.687726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:16.687726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:16.688797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:16.688797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:16.688797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:16.688797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:16.688797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:16.688797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:16.688797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:16.688797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:16.688797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:16.688797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:16.688797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:16.688797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:16.688797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:16.688797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:16.688797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:16.688797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:16.688797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:16.690232 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:16.690232 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:16.690232 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:16.690232 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:16.692525 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 289/589] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:16.693613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe1790-293c-482f-b697-60585566f419 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:16.731283 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e706e31-a462-4ee7-8236-96d6bb0cf1f6 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:16.778068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91006008-f146-4377-8fa3-7068ffc45751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:16.778886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91006008-f146-4377-8fa3-7068ffc45751 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:16.779178 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91006008-f146-4377-8fa3-7068ffc45751 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:16.779457 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91006008-f146-4377-8fa3-7068ffc45751 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:16.780340 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91006008-f146-4377-8fa3-7068ffc45751 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:16.780660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91006008-f146-4377-8fa3-7068ffc45751 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:16.782128 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91006008-f146-4377-8fa3-7068ffc45751 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:16.805750 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 301/590] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Aug 4 10:12:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:16.806785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91006008-f146-4377-8fa3-7068ffc45751 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:16.815752 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe1790-293c-482f-b697-60585566f419 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:16.853468 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d57a3-9cab-49d7-8cf7-56bd18295e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:16.854558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d57a3-9cab-49d7-8cf7-56bd18295e99 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:16.855044 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d57a3-9cab-49d7-8cf7-56bd18295e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:16.855619 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d57a3-9cab-49d7-8cf7-56bd18295e99 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:16.856635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d57a3-9cab-49d7-8cf7-56bd18295e99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:16.857148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d57a3-9cab-49d7-8cf7-56bd18295e99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:16.858940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d57a3-9cab-49d7-8cf7-56bd18295e99 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:16.873335 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 290/591] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:16.874499 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d57a3-9cab-49d7-8cf7-56bd18295e99 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:16.913313 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:16.916248 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91006008-f146-4377-8fa3-7068ffc45751 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:16.931442 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:16.952961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614265bd-c2c3-4769-bf34-b0f7301b2509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:16.953587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614265bd-c2c3-4769-bf34-b0f7301b2509 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:16.954352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614265bd-c2c3-4769-bf34-b0f7301b2509 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:16.954640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614265bd-c2c3-4769-bf34-b0f7301b2509 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:16.955916 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614265bd-c2c3-4769-bf34-b0f7301b2509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:16.956253 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614265bd-c2c3-4769-bf34-b0f7301b2509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:16.957922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614265bd-c2c3-4769-bf34-b0f7301b2509 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:16.972823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 302/592] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:16.974043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614265bd-c2c3-4769-bf34-b0f7301b2509 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:16.997015 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d57a3-9cab-49d7-8cf7-56bd18295e99 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:17.038024 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656321c-20ef-4758-9be8-0179c5194def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:17.038680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656321c-20ef-4758-9be8-0179c5194def None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:17.038963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656321c-20ef-4758-9be8-0179c5194def None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:17.039240 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656321c-20ef-4758-9be8-0179c5194def None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:17.053537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656321c-20ef-4758-9be8-0179c5194def None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:17.055240 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656321c-20ef-4758-9be8-0179c5194def None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:17.074975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-3656321c-20ef-4758-9be8-0179c5194def None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:17.074975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:17.074975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:17.074975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:17.074975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:17.074975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:17.074975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:17.074975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:17.074975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:17.074975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:17.074975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:17.074975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:17.074975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:17.074975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:17.074975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:17.075888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:17.075888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:17.075888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:17.075888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:17.075888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:17.075888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:17.075888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:17.075888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:17.075888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:17.075888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:17.075888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:17.075888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:17.075888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:17.075888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:17.075888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:17.075888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:17.075888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:17.077151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:17.077151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:17.077151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:17.077151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:17.079332 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 291/593] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:17.080962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656321c-20ef-4758-9be8-0179c5194def None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:17.103763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614265bd-c2c3-4769-bf34-b0f7301b2509 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:17.142768 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe39aaf-6815-44bc-86a2-567e1161dcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:17.143414 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe39aaf-6815-44bc-86a2-567e1161dcdb None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:17.143698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe39aaf-6815-44bc-86a2-567e1161dcdb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:17.143973 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe39aaf-6815-44bc-86a2-567e1161dcdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:17.153106 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe39aaf-6815-44bc-86a2-567e1161dcdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:17.154561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe39aaf-6815-44bc-86a2-567e1161dcdb None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:17.169060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-dbe39aaf-6815-44bc-86a2-567e1161dcdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:17.169060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:17.169060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:17.169060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:17.169060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:17.169060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:17.169060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:17.169060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:17.169060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:17.169060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:17.169060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:17.169060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:17.169060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:17.169060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:17.169060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:17.169949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:17.169949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:17.169949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:17.169949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:17.169949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:17.169949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:17.169949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:17.169949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:17.169949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:17.169949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:17.169949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:17.169949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:17.169949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:17.169949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:17.169949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:17.169949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:17.169949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:17.170851 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:17.170851 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:17.170851 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:17.170851 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:17.170851 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:17.170851 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:17.170851 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:17.170851 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:17.172260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 303/594] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:17.173306 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe39aaf-6815-44bc-86a2-567e1161dcdb None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:17.192791 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:17.210625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656321c-20ef-4758-9be8-0179c5194def None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:17.217175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:17.262804 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb03521-0645-41e4-b679-ebdb479d7eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:17.263459 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb03521-0645-41e4-b679-ebdb479d7eec None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:17.263743 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb03521-0645-41e4-b679-ebdb479d7eec None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:17.264020 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb03521-0645-41e4-b679-ebdb479d7eec None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:17.274913 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb03521-0645-41e4-b679-ebdb479d7eec None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:17.276706 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb03521-0645-41e4-b679-ebdb479d7eec None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:17.294005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-8eb03521-0645-41e4-b679-ebdb479d7eec None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 10:12:17.294005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:17.294005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:17.294005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:17.294005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:17.294005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:17.294005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:17.294005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:17.294005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:17.294005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:17.294005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:17.294005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:17.294005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:17.294005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:17.294005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:17.294005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:17.294982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:17.294982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:17.294982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:17.294982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:17.294982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:17.294982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:17.294982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:17.294982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:17.294982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:17.294982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:17.294982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:17.294982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:17.294982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:17.294982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:17.294982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:17.294982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:17.294982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:17.294982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:17.295902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:17.295902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:17.295902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:17.295902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:17.295902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:17.295902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:17.295902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:17.295902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:17.295902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 10:12:17.295902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:17.295902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 292/595] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:17.296510 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb03521-0645-41e4-b679-ebdb479d7eec None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:17.301757 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe39aaf-6815-44bc-86a2-567e1161dcdb None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:17.338713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13edca6-0839-47d7-8278-4dcd9645ebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:17.340202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13edca6-0839-47d7-8278-4dcd9645ebab None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:17.340703 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13edca6-0839-47d7-8278-4dcd9645ebab None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:17.341180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13edca6-0839-47d7-8278-4dcd9645ebab None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:17.342075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13edca6-0839-47d7-8278-4dcd9645ebab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:17.342592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13edca6-0839-47d7-8278-4dcd9645ebab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:17.344363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13edca6-0839-47d7-8278-4dcd9645ebab None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:17.357952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 304/596] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:17.359111 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13edca6-0839-47d7-8278-4dcd9645ebab None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:17.421513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb03521-0645-41e4-b679-ebdb479d7eec None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:17.466117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478c88f-1bf8-4a4c-84d1-f9c3d0f62951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:17.466727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478c88f-1bf8-4a4c-84d1-f9c3d0f62951 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:17.467009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478c88f-1bf8-4a4c-84d1-f9c3d0f62951 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:17.467346 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478c88f-1bf8-4a4c-84d1-f9c3d0f62951 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:17.468028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478c88f-1bf8-4a4c-84d1-f9c3d0f62951 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:17.468393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478c88f-1bf8-4a4c-84d1-f9c3d0f62951 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:17.469822 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478c88f-1bf8-4a4c-84d1-f9c3d0f62951 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:17.479358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:17.489344 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13edca6-0839-47d7-8278-4dcd9645ebab None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:17.499223 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 293/597] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:17.500450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478c88f-1bf8-4a4c-84d1-f9c3d0f62951 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:17.516822 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:17.531460 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c45c8e-536d-4d74-817f-044325567dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:17.532110 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c45c8e-536d-4d74-817f-044325567dac None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:17.532424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c45c8e-536d-4d74-817f-044325567dac None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:17.532704 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c45c8e-536d-4d74-817f-044325567dac None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:17.534236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c45c8e-536d-4d74-817f-044325567dac None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:17.534548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c45c8e-536d-4d74-817f-044325567dac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:17.536246 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c45c8e-536d-4d74-817f-044325567dac None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:17.559517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 305/598] 10.222.0.48 () {56 vars in 1139 bytes} [Thu Aug 4 10:12:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:17.560468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c45c8e-536d-4d74-817f-044325567dac None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:17.640401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478c88f-1bf8-4a4c-84d1-f9c3d0f62951 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:17.686648 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d6a11-5fdd-4383-a551-03c5e3cb0315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:17.687245 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d6a11-5fdd-4383-a551-03c5e3cb0315 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:17.687529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d6a11-5fdd-4383-a551-03c5e3cb0315 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:17.687803 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d6a11-5fdd-4383-a551-03c5e3cb0315 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:17.689164 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c45c8e-536d-4d74-817f-044325567dac None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:17.694815 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d6a11-5fdd-4383-a551-03c5e3cb0315 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:17.696289 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d6a11-5fdd-4383-a551-03c5e3cb0315 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:17.708056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-4d0d6a11-5fdd-4383-a551-03c5e3cb0315 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:17.708056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:17.708056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:17.708056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:17.708056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:17.708056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:17.708056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:17.708056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:17.708056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:17.708056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:17.708056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:17.708056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:17.708056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:17.708056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:17.708056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:17.708970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:17.708970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:17.708970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:17.708970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:17.708970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:17.708970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:17.708970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:17.708970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:17.708970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:17.708970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:17.708970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:17.708970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:17.708970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:17.708970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:17.708970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:17.708970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:17.708970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:17.709846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:17.709846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:17.709846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:17.709846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:17.709846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:17.709846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:17.709846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:17.709846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:17.709846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 294/599] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:17.710316 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d6a11-5fdd-4383-a551-03c5e3cb0315 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:17.732579 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacac402-67c7-4aad-a914-0703e89572bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:17.733262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacac402-67c7-4aad-a914-0703e89572bf None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:17.733545 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacac402-67c7-4aad-a914-0703e89572bf None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:17.733824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacac402-67c7-4aad-a914-0703e89572bf None admin] PATH_INFO: `/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/0dc15e64c987488f812d1cdd0c82c7ea/roles/88ed5b6546c64ac09d03064e12ca7f10` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:17.749834 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacac402-67c7-4aad-a914-0703e89572bf None admin] RBAC: Authorizing `identity:create_grant(project_id=7e37543156ee42a0818bf5cfe747fdc2, user_id=0dc15e64c987488f812d1cdd0c82c7ea, role_id=88ed5b6546c64ac09d03064e12ca7f10)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:17.751317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacac402-67c7-4aad-a914-0703e89572bf None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:17.766662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 306/600] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:12:17 2022] PUT /identity/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/0dc15e64c987488f812d1cdd0c82c7ea/roles/88ed5b6546c64ac09d03064e12ca7f10 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:12:17.769452 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb046b1d-1fa2-4d1b-b956-000a1a486c7a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:17.770245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb046b1d-1fa2-4d1b-b956-000a1a486c7a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:17.770738 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb046b1d-1fa2-4d1b-b956-000a1a486c7a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:17.777326 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 307/601] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:17.777326 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb046b1d-1fa2-4d1b-b956-000a1a486c7a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:17.781356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:17.788995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:17.829365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d6a11-5fdd-4383-a551-03c5e3cb0315 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:17.878559 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e72e0-4bd9-479f-9943-53dafd1160b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:17.879262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e72e0-4bd9-479f-9943-53dafd1160b3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:17.879557 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e72e0-4bd9-479f-9943-53dafd1160b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:17.879838 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e72e0-4bd9-479f-9943-53dafd1160b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:17.892866 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e72e0-4bd9-479f-9943-53dafd1160b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:17.894397 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e72e0-4bd9-479f-9943-53dafd1160b3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:17.911593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-617e72e0-4bd9-479f-9943-53dafd1160b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:17.911593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:17.911593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:17.911593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:17.911593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:17.911593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:17.911593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:17.911593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:17.911593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:17.911593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:17.911593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:17.911593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:17.911593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:17.911593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:17.911593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:17.912563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:17.912563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:17.912563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:17.912563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:17.912563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:17.912563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:17.912563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:17.912563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:17.912563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:17.912563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:17.912563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:17.912563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:17.912563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:17.912563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:17.912563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:17.912563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:17.912563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:17.913458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:17.913458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:17.913458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:17.913458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:17.913458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 295/602] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:17.914349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f715499-8dd1-4d33-8860-3c0aa52e3cf8 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:17.914689 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f715499-8dd1-4d33-8860-3c0aa52e3cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:17.915044 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f715499-8dd1-4d33-8860-3c0aa52e3cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:17.936561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-6f715499-8dd1-4d33-8860-3c0aa52e3cf8 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:17.937849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6f715499-8dd1-4d33-8860-3c0aa52e3cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:17.939990 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb046b1d-1fa2-4d1b-b956-000a1a486c7a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:17.980472 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de0def-0bd7-4a30-adb6-df1201f1ec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:17.981471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de0def-0bd7-4a30-adb6-df1201f1ec65 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:17.981964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de0def-0bd7-4a30-adb6-df1201f1ec65 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:17.982442 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de0def-0bd7-4a30-adb6-df1201f1ec65 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:17.983422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de0def-0bd7-4a30-adb6-df1201f1ec65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:17.983737 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de0def-0bd7-4a30-adb6-df1201f1ec65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:17.987367 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de0def-0bd7-4a30-adb6-df1201f1ec65 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:17.999937 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 308/603] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:18.000891 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de0def-0bd7-4a30-adb6-df1201f1ec65 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:18.025609 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 296/604] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:18.032306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f715499-8dd1-4d33-8860-3c0aa52e3cf8 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:18.086097 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:18.107704 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:18.130789 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de0def-0bd7-4a30-adb6-df1201f1ec65 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:18.166739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f715499-8dd1-4d33-8860-3c0aa52e3cf8 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:18.167152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afad31-2ecd-47a8-8584-c68d7ee2b274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:18.167842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afad31-2ecd-47a8-8584-c68d7ee2b274 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:18.168130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afad31-2ecd-47a8-8584-c68d7ee2b274 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:18.168454 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afad31-2ecd-47a8-8584-c68d7ee2b274 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:18.169202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afad31-2ecd-47a8-8584-c68d7ee2b274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:18.169516 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afad31-2ecd-47a8-8584-c68d7ee2b274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:18.171420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afad31-2ecd-47a8-8584-c68d7ee2b274 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:18.184466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 309/605] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:18.185517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afad31-2ecd-47a8-8584-c68d7ee2b274 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:18.208505 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b23c1-7159-49fa-b7bf-2253c62ece61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:18.210018 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b23c1-7159-49fa-b7bf-2253c62ece61 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:18.210588 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b23c1-7159-49fa-b7bf-2253c62ece61 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:18.211067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b23c1-7159-49fa-b7bf-2253c62ece61 None admin] PATH_INFO: `/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/180731bbc26c4681965dfd9cf0c1f063/roles/88ed5b6546c64ac09d03064e12ca7f10` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:18.228092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b23c1-7159-49fa-b7bf-2253c62ece61 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e37543156ee42a0818bf5cfe747fdc2, user_id=180731bbc26c4681965dfd9cf0c1f063, role_id=88ed5b6546c64ac09d03064e12ca7f10)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:18.230010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b23c1-7159-49fa-b7bf-2253c62ece61 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:18.249554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 297/606] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:12:18 2022] PUT /identity/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/180731bbc26c4681965dfd9cf0c1f063/roles/88ed5b6546c64ac09d03064e12ca7f10 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:12:18.250850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b23c1-7159-49fa-b7bf-2253c62ece61 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:18.352662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afad31-2ecd-47a8-8584-c68d7ee2b274 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:18.379290 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:18.383054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b23c1-7159-49fa-b7bf-2253c62ece61 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:18.411648 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:18.434085 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b216dc3-8dc0-41c0-a746-5c1b23145755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:18.434749 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b216dc3-8dc0-41c0-a746-5c1b23145755 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:18.435035 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b216dc3-8dc0-41c0-a746-5c1b23145755 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:18.435313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b216dc3-8dc0-41c0-a746-5c1b23145755 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:18.458415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b216dc3-8dc0-41c0-a746-5c1b23145755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:18.459530 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cd6a2-70bb-462a-9d83-00c18afe68a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:18.460124 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd6a2-70bb-462a-9d83-00c18afe68a6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:18.460440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd6a2-70bb-462a-9d83-00c18afe68a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:18.460717 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd6a2-70bb-462a-9d83-00c18afe68a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:18.463655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-5b216dc3-8dc0-41c0-a746-5c1b23145755 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:18.463655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:18.463655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:18.463655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:18.463655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:18.463655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:18.463655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:18.463655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:18.463655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:18.463655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:18.463655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:18.463655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:18.463655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:18.463655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:18.463655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:18.463655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:18.464625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:18.464625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:18.464625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:18.464625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:18.464625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:18.464625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:18.464625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:18.464625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:18.464625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:18.464625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:18.464625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:18.464625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:18.464625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:18.464625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:18.464625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:18.464625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:18.465436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:18.465436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:18.465436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:18.465436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:18.465436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:18.465436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:18.465436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:18.465436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:18.465436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:18.465436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:18.465436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:18.465436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:18.465436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 310/607] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:18.466598 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c80b6-b662-4c54-9b77-3b14f02980f0 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:18.466695 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c80b6-b662-4c54-9b77-3b14f02980f0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:18.469009 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c80b6-b662-4c54-9b77-3b14f02980f0 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:18.469144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cd6a2-70bb-462a-9d83-00c18afe68a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:18.469889 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cd6a2-70bb-462a-9d83-00c18afe68a6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:18.472737 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 311/608] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:18.474174 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41816f31-e248-43a8-b29d-fa41f7f3000c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:18.474461 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41816f31-e248-43a8-b29d-fa41f7f3000c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:18.474724 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41816f31-e248-43a8-b29d-fa41f7f3000c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:18.483128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-e55cd6a2-70bb-462a-9d83-00c18afe68a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:18.483128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:18.483128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:18.483128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:18.483128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:18.483128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:18.483128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:18.483128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:18.483128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:18.483128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:18.483128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:18.483128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:18.483128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:18.483128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:18.483128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:18.484236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:18.484236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:18.484236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:18.484236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:18.484236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:18.484236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:18.484236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:18.484236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:18.484236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:18.484236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:18.484236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:18.484236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:18.484236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:18.484236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:18.484236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:18.484236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:18.484236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:18.485314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:18.485314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:18.485314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:18.485314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:18.485314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:18.485314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:18.485314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:18.485314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:18.489938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 298/609] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:18.490900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cd6a2-70bb-462a-9d83-00c18afe68a6 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:18.497771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-41816f31-e248-43a8-b29d-fa41f7f3000c None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:18.499223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-41816f31-e248-43a8-b29d-fa41f7f3000c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:18.590330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 312/610] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:18.591286 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41816f31-e248-43a8-b29d-fa41f7f3000c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:18.623245 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cd6a2-70bb-462a-9d83-00c18afe68a6 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:18.664125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad025960-b2c6-49dd-afc0-2dcc21bd1d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:18.665486 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad025960-b2c6-49dd-afc0-2dcc21bd1d10 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:18.665992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad025960-b2c6-49dd-afc0-2dcc21bd1d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:18.666465 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad025960-b2c6-49dd-afc0-2dcc21bd1d10 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:18.667891 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad025960-b2c6-49dd-afc0-2dcc21bd1d10 None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:18.668428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad025960-b2c6-49dd-afc0-2dcc21bd1d10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:18.670521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad025960-b2c6-49dd-afc0-2dcc21bd1d10 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:18.683073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 299/611] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:12:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:18.684431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad025960-b2c6-49dd-afc0-2dcc21bd1d10 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:18.718672 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:18.720891 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41816f31-e248-43a8-b29d-fa41f7f3000c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:18.736486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:18.763815 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357f1e0-96bd-44da-afc2-0fd3ef13c059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:18.764514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357f1e0-96bd-44da-afc2-0fd3ef13c059 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:18.764801 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357f1e0-96bd-44da-afc2-0fd3ef13c059 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:18.765081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357f1e0-96bd-44da-afc2-0fd3ef13c059 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:18.765826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357f1e0-96bd-44da-afc2-0fd3ef13c059 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:18.766137 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357f1e0-96bd-44da-afc2-0fd3ef13c059 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:18.768362 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357f1e0-96bd-44da-afc2-0fd3ef13c059 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:18.786439 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 313/612] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:18.787071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357f1e0-96bd-44da-afc2-0fd3ef13c059 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:18.825273 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad025960-b2c6-49dd-afc0-2dcc21bd1d10 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:18.870952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f606d13-4f57-462d-b82e-e461399b48e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:18.871808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f606d13-4f57-462d-b82e-e461399b48e2 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:18.872225 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f606d13-4f57-462d-b82e-e461399b48e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:18.873250 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f606d13-4f57-462d-b82e-e461399b48e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:18.884724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f606d13-4f57-462d-b82e-e461399b48e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:18.891613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-4f606d13-4f57-462d-b82e-e461399b48e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:18.891613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:18.891613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:18.891613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:18.891613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:18.891613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:18.891613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:18.891613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:18.891613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:18.891613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:18.891613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:18.891613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:18.891613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:18.891613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:18.891613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:18.891613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:18.893393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:18.893393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:18.893393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:18.893393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:18.893393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:18.893393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:18.893393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:18.893393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:18.893393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:18.893393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:18.893393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:18.893393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:18.893393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:18.893393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:18.893393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:18.893393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:18.894204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:18.894204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:18.894204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:18.894204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:18.894204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:18.894204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:18.894204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:18.894204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:18.894204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:18.894204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:18.894204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:18.894204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:18.894204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 300/613] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:18.894869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f606d13-4f57-462d-b82e-e461399b48e2 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:18.912698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357f1e0-96bd-44da-afc2-0fd3ef13c059 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:18.966701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b7f84-63c5-4507-84be-e3fa1cd8e219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:18.967358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b7f84-63c5-4507-84be-e3fa1cd8e219 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:18.967645 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b7f84-63c5-4507-84be-e3fa1cd8e219 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:18.967927 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b7f84-63c5-4507-84be-e3fa1cd8e219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:18.980013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b7f84-63c5-4507-84be-e3fa1cd8e219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:18.981619 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b7f84-63c5-4507-84be-e3fa1cd8e219 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:18.997807 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:18.998959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-928b7f84-63c5-4507-84be-e3fa1cd8e219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:18.998959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:18.998959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:18.998959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:18.998959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:18.998959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:18.998959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:18.998959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:18.998959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:18.998959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:18.998959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:18.998959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:18.998959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:18.998959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:18.998959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:19.000095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:19.000095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:19.000095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:19.000095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:19.000095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:19.000095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:19.000095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:19.000095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:19.000095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:19.000095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:19.000095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:19.000095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:19.000095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:19.000095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:19.000095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:19.000095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:19.000095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:19.001369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:19.001369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:19.001369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:19.001369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:19.003761 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 314/614] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:19.004944 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b7f84-63c5-4507-84be-e3fa1cd8e219 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:19.024148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f606d13-4f57-462d-b82e-e461399b48e2 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:19.034380 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:19.060724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f9c58-fbd7-477f-ad76-fdb3b2bffb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:19.061883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f9c58-fbd7-477f-ad76-fdb3b2bffb78 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:19.062261 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f9c58-fbd7-477f-ad76-fdb3b2bffb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:19.062640 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f9c58-fbd7-477f-ad76-fdb3b2bffb78 None admin] PATH_INFO: `/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/2021ac71491f4bebb0fbd91c533dc383/roles/88ed5b6546c64ac09d03064e12ca7f10` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:19.078972 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f9c58-fbd7-477f-ad76-fdb3b2bffb78 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e37543156ee42a0818bf5cfe747fdc2, user_id=2021ac71491f4bebb0fbd91c533dc383, role_id=88ed5b6546c64ac09d03064e12ca7f10)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:19.081433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f9c58-fbd7-477f-ad76-fdb3b2bffb78 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:19.095263 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 301/615] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:12:18 2022] PUT /identity/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/2021ac71491f4bebb0fbd91c533dc383/roles/88ed5b6546c64ac09d03064e12ca7f10 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:12:19.104622 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f9c58-fbd7-477f-ad76-fdb3b2bffb78 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:19.122081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b7f84-63c5-4507-84be-e3fa1cd8e219 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:19.167533 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67814de5-092d-4bb5-8ff9-e775f2e8ac83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:19.169590 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67814de5-092d-4bb5-8ff9-e775f2e8ac83 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:19.170152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67814de5-092d-4bb5-8ff9-e775f2e8ac83 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:19.170656 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67814de5-092d-4bb5-8ff9-e775f2e8ac83 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:19.171656 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67814de5-092d-4bb5-8ff9-e775f2e8ac83 None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:19.172253 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67814de5-092d-4bb5-8ff9-e775f2e8ac83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:19.175590 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67814de5-092d-4bb5-8ff9-e775f2e8ac83 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:19.190767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 315/616] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:12:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:19.196194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67814de5-092d-4bb5-8ff9-e775f2e8ac83 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:19.312865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f9c58-fbd7-477f-ad76-fdb3b2bffb78 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:19.317571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:19.334878 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67814de5-092d-4bb5-8ff9-e775f2e8ac83 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:19.345537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:19.362843 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a8bd5-771a-43a1-a560-d88bd375b4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:19.375690 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aea3cd-7695-4278-81d8-d37e2808bda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:19.376372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aea3cd-7695-4278-81d8-d37e2808bda4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:19.376577 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a8bd5-771a-43a1-a560-d88bd375b4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:19.377290 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aea3cd-7695-4278-81d8-d37e2808bda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:19.377547 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a8bd5-771a-43a1-a560-d88bd375b4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:19.377650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aea3cd-7695-4278-81d8-d37e2808bda4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:19.377749 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a8bd5-771a-43a1-a560-d88bd375b4c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:19.378432 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a8bd5-771a-43a1-a560-d88bd375b4c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:19.378745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a8bd5-771a-43a1-a560-d88bd375b4c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:19.380135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a8bd5-771a-43a1-a560-d88bd375b4c4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:19.389281 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aea3cd-7695-4278-81d8-d37e2808bda4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:19.390758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aea3cd-7695-4278-81d8-d37e2808bda4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:19.408020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-15aea3cd-7695-4278-81d8-d37e2808bda4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:19.408020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:19.408020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:19.408020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:19.408020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:19.408020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:19.408020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:19.408020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:19.408020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:19.408020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:19.408020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:19.408020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:19.408020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:19.408020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:19.408020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:19.409417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:19.409417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:19.409417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:19.409417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:19.409417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:19.409417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:19.409417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:19.409417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:19.409417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:19.409417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:19.409417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:19.409417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:19.409417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:19.409417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:19.409417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:19.409417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:19.409417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:19.410521 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:19.410521 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:19.410521 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:19.410521 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:19.410521 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 316/617] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:19.410964 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 302/618] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:19.416002 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aea3cd-7695-4278-81d8-d37e2808bda4 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:19.416279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a8bd5-771a-43a1-a560-d88bd375b4c4 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:19.541164 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aea3cd-7695-4278-81d8-d37e2808bda4 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:19.583518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac0525-2d15-4e30-a4f4-2447dc73ca8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:19.584087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac0525-2d15-4e30-a4f4-2447dc73ca8b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:19.584402 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac0525-2d15-4e30-a4f4-2447dc73ca8b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:19.584686 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac0525-2d15-4e30-a4f4-2447dc73ca8b None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:19.585399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac0525-2d15-4e30-a4f4-2447dc73ca8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:19.585783 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac0525-2d15-4e30-a4f4-2447dc73ca8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:19.587610 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac0525-2d15-4e30-a4f4-2447dc73ca8b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:19.597566 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:19.614118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 317/619] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:19.615820 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac0525-2d15-4e30-a4f4-2447dc73ca8b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:19.667143 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a8bd5-771a-43a1-a560-d88bd375b4c4 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:19.724634 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb9971-39b1-439c-8a09-36a0afafe731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:19.725581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb9971-39b1-439c-8a09-36a0afafe731 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:19.726297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb9971-39b1-439c-8a09-36a0afafe731 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:19.727217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb9971-39b1-439c-8a09-36a0afafe731 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:19.743188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb9971-39b1-439c-8a09-36a0afafe731 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:19.746494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb9971-39b1-439c-8a09-36a0afafe731 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:19.772403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-4cdb9971-39b1-439c-8a09-36a0afafe731 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 10:12:19.772403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:19.772403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:19.772403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:19.772403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:19.772403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:19.772403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:19.772403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:19.772403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:19.772403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:19.772403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:19.772403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:19.772403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:19.772403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:19.772403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:19.772403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:19.773733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:19.773733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:19.773733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:19.773733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:19.773733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:19.773733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:19.773733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:19.773733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:19.773733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:19.773733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:19.773733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:19.773733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:19.773733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:19.773733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:19.773733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:19.773733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:19.773733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:19.773733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:19.774854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:19.774854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:19.774854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:19.774854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:19.774854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:19.774854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:19.774854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:19.774854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:19.774854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 10:12:19.774854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:19.785142 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 303/620] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Aug 4 10:12:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:19.786056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb9971-39b1-439c-8a09-36a0afafe731 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:19.806186 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac0525-2d15-4e30-a4f4-2447dc73ca8b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:19.844155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa818f60-163f-486c-9985-9d165d51d82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:19.844818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa818f60-163f-486c-9985-9d165d51d82e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:19.845094 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa818f60-163f-486c-9985-9d165d51d82e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:19.846106 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa818f60-163f-486c-9985-9d165d51d82e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:19.854009 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa818f60-163f-486c-9985-9d165d51d82e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:19.855627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa818f60-163f-486c-9985-9d165d51d82e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:19.868701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-aa818f60-163f-486c-9985-9d165d51d82e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 10:12:19.868701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:19.868701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:19.868701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:19.868701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:19.868701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:19.868701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:19.868701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:19.868701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:19.868701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:19.868701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:19.868701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:19.868701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:19.868701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:19.868701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:19.868701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:19.869863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:19.869863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:19.869863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:19.869863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:19.869863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:19.869863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:19.869863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:19.869863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:19.869863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:19.869863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:19.869863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:19.869863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:19.869863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:19.869863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:19.869863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:19.869863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:19.869863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:19.869863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:19.870966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:19.870966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:19.870966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:19.870966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:19.870966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:19.870966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:19.870966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:19.870966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:19.870966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 10:12:19.870966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:19.870966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 318/621] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:12:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:19.875935 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa818f60-163f-486c-9985-9d165d51d82e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:19.934438 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:19.952663 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:19.997739 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa818f60-163f-486c-9985-9d165d51d82e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:20.024346 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb9971-39b1-439c-8a09-36a0afafe731 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:20.035138 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2874921-5936-4720-b16e-0a204022b077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:20.036094 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2874921-5936-4720-b16e-0a204022b077 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:20.036656 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2874921-5936-4720-b16e-0a204022b077 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:20.037149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2874921-5936-4720-b16e-0a204022b077 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:20.038168 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2874921-5936-4720-b16e-0a204022b077 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:20.038689 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2874921-5936-4720-b16e-0a204022b077 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:20.040382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2874921-5936-4720-b16e-0a204022b077 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:20.059458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 319/622] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Aug 4 10:12:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:20.065520 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2874921-5936-4720-b16e-0a204022b077 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:20.132616 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387bb0d-6e2e-4884-a8fa-eddad3e5c772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:20.133198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387bb0d-6e2e-4884-a8fa-eddad3e5c772 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:20.133494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387bb0d-6e2e-4884-a8fa-eddad3e5c772 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:20.133781 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387bb0d-6e2e-4884-a8fa-eddad3e5c772 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:20.134609 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387bb0d-6e2e-4884-a8fa-eddad3e5c772 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:20.134926 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387bb0d-6e2e-4884-a8fa-eddad3e5c772 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:20.137801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387bb0d-6e2e-4884-a8fa-eddad3e5c772 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:20.161529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 304/623] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Aug 4 10:12:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:20.163382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12a7b1-7ba6-4e23-bdb8-2364ffbfd800 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:20.163830 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12a7b1-7ba6-4e23-bdb8-2364ffbfd800 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:20.164587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12a7b1-7ba6-4e23-bdb8-2364ffbfd800 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:20.170704 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 305/624] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:20.171005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12a7b1-7ba6-4e23-bdb8-2364ffbfd800 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:20.179116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2874921-5936-4720-b16e-0a204022b077 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:20.197842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:20.219467 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb4453-dc19-44a5-8d26-094877e3cc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:20.220325 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb4453-dc19-44a5-8d26-094877e3cc90 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:20.220789 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb4453-dc19-44a5-8d26-094877e3cc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:20.221165 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb4453-dc19-44a5-8d26-094877e3cc90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:20.231857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb4453-dc19-44a5-8d26-094877e3cc90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:20.233541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb4453-dc19-44a5-8d26-094877e3cc90 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:20.249858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-2fdb4453-dc19-44a5-8d26-094877e3cc90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:20.249858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:20.249858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:20.249858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:20.249858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:20.249858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:20.249858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:20.249858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:20.249858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:20.249858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:20.249858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:20.249858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:20.249858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:20.249858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:20.249858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:20.250874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:20.250874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:20.250874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:20.250874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:20.250874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:20.250874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:20.250874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:20.250874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:20.250874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:20.250874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:20.250874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:20.250874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:20.250874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:20.250874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:20.250874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:20.250874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:20.250874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:20.252528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:20.252528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:20.252528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:20.252528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:20.254144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 320/625] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:20.255592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dfa60-7327-40ef-9e82-de07852be96f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:20.255962 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dfa60-7327-40ef-9e82-de07852be96f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:20.256391 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dfa60-7327-40ef-9e82-de07852be96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:20.275924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f03dfa60-7327-40ef-9e82-de07852be96f None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:20.277301 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f03dfa60-7327-40ef-9e82-de07852be96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:20.310618 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12a7b1-7ba6-4e23-bdb8-2364ffbfd800 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:20.325276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:20.352093 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38d288-efe3-4906-9797-b835c3205143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:20.352946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38d288-efe3-4906-9797-b835c3205143 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:20.353338 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38d288-efe3-4906-9797-b835c3205143 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:20.353728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38d288-efe3-4906-9797-b835c3205143 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:20.364489 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 321/626] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:20.365766 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03dfa60-7327-40ef-9e82-de07852be96f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:20.433601 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38d288-efe3-4906-9797-b835c3205143 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:20.435375 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38d288-efe3-4906-9797-b835c3205143 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:20.500450 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:20.505934 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03dfa60-7327-40ef-9e82-de07852be96f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:20.547181 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ff5d2-6ca8-4e6f-bbef-1da30d27ebe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:20.547818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ff5d2-6ca8-4e6f-bbef-1da30d27ebe5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:20.548113 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ff5d2-6ca8-4e6f-bbef-1da30d27ebe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:20.549063 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ff5d2-6ca8-4e6f-bbef-1da30d27ebe5 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:20.549911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ff5d2-6ca8-4e6f-bbef-1da30d27ebe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:20.550169 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ff5d2-6ca8-4e6f-bbef-1da30d27ebe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:20.551560 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ff5d2-6ca8-4e6f-bbef-1da30d27ebe5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:20.562933 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 306/627] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:12:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:12:20.564138 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38d288-efe3-4906-9797-b835c3205143 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:20.568903 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 322/628] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:20.569818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ff5d2-6ca8-4e6f-bbef-1da30d27ebe5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:20.578342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:20.676997 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ff5d2-6ca8-4e6f-bbef-1da30d27ebe5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:20.682564 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38d288-efe3-4906-9797-b835c3205143 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:20.713005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98b98f-a4dc-4ff5-a971-7fb434a886c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:20.713571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98b98f-a4dc-4ff5-a971-7fb434a886c6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:20.713873 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98b98f-a4dc-4ff5-a971-7fb434a886c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:20.714139 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98b98f-a4dc-4ff5-a971-7fb434a886c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:20.719109 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba20ae-2cd2-4256-b0b1-933ad8486f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:20.719756 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba20ae-2cd2-4256-b0b1-933ad8486f4a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:20.720043 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba20ae-2cd2-4256-b0b1-933ad8486f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:20.720937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba20ae-2cd2-4256-b0b1-933ad8486f4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:20.725762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98b98f-a4dc-4ff5-a971-7fb434a886c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:20.727218 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98b98f-a4dc-4ff5-a971-7fb434a886c6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:20.732047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba20ae-2cd2-4256-b0b1-933ad8486f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:20.738102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-d9ba20ae-2cd2-4256-b0b1-933ad8486f4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:20.738102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:20.738102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:20.738102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:20.738102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:20.738102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:20.738102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:20.738102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:20.738102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:20.738102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:20.738102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:20.738102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:20.738102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:20.738102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:20.738102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:20.738102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:20.739028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:20.739028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:20.739028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:20.739028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:20.739028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:20.739028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:20.739028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:20.739028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:20.739028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:20.739028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:20.739028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:20.739028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:20.739028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:20.739028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:20.739028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:20.739028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:20.739869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:20.739869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:20.739869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:20.739869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:20.739869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:20.739869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:20.739869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:20.739869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:20.739869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:20.739869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:20.739869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:20.739869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:20.739869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 307/629] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:20.740593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba20ae-2cd2-4256-b0b1-933ad8486f4a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:20.742263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-ad98b98f-a4dc-4ff5-a971-7fb434a886c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:20.742263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:20.742263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:20.742263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:20.742263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:20.742263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:20.742263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:20.742263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:20.742263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:20.742263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:20.742263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:20.742263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:20.742263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:20.742263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:20.742263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:20.748394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:20.748394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:20.748394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:20.748394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:20.748394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:20.748394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:20.748394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:20.748394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:20.748394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:20.748394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:20.748394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:20.748394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:20.748394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:20.748394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:20.748394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:20.748394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:20.748394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:20.749300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:20.749300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:20.749300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:20.749300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:20.749300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 323/630] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:20.749300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef19e1c-9dd3-406d-b37f-cc9fca45e0b3 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:20.749300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef19e1c-9dd3-406d-b37f-cc9fca45e0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:20.749300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef19e1c-9dd3-406d-b37f-cc9fca45e0b3 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:20.749300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 324/631] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:20.749810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef19e1c-9dd3-406d-b37f-cc9fca45e0b3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:20.760876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:20.822443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:20.855791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef19e1c-9dd3-406d-b37f-cc9fca45e0b3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:20.861693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba20ae-2cd2-4256-b0b1-933ad8486f4a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:20.891509 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84911020-ada1-4917-a311-9f99f76d79c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:20.892686 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84911020-ada1-4917-a311-9f99f76d79c4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:20.892970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84911020-ada1-4917-a311-9f99f76d79c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:20.893299 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84911020-ada1-4917-a311-9f99f76d79c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:20.893912 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84911020-ada1-4917-a311-9f99f76d79c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:20.894217 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84911020-ada1-4917-a311-9f99f76d79c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:20.895593 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84911020-ada1-4917-a311-9f99f76d79c4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:20.903413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de11605-c1dd-4247-a8af-9891ba7abdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:20.903875 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 325/632] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:12:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:20.904544 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de11605-c1dd-4247-a8af-9891ba7abdea None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:20.904709 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84911020-ada1-4917-a311-9f99f76d79c4 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:20.905177 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de11605-c1dd-4247-a8af-9891ba7abdea None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:20.905458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de11605-c1dd-4247-a8af-9891ba7abdea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:20.917284 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de11605-c1dd-4247-a8af-9891ba7abdea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:20.918839 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de11605-c1dd-4247-a8af-9891ba7abdea None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:20.931253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-0de11605-c1dd-4247-a8af-9891ba7abdea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:20.931253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:20.931253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:20.931253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:20.931253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:20.931253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:20.931253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:20.931253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:20.931253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:20.931253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:20.931253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:20.931253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:20.931253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:20.931253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:20.931253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:20.932145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:20.932145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:20.932145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:20.932145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:20.932145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:20.932145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:20.932145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:20.932145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:20.932145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:20.932145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:20.932145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:20.932145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:20.932145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:20.932145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:20.932145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:20.932145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:20.932145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:20.933074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:20.933074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:20.933074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:20.933074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:20.933074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:20.933074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:20.933074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:20.933074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:20.933074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 308/633] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:20.934212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee199a2a-092d-4885-bd8e-ad40a471b4ab None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:20.934212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee199a2a-092d-4885-bd8e-ad40a471b4ab None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:20.934212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee199a2a-092d-4885-bd8e-ad40a471b4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:20.952331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ee199a2a-092d-4885-bd8e-ad40a471b4ab None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:20.953528 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ee199a2a-092d-4885-bd8e-ad40a471b4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:20.987283 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:21.018311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84911020-ada1-4917-a311-9f99f76d79c4 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:21.032526 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 309/634] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:21.032526 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee199a2a-092d-4885-bd8e-ad40a471b4ab None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:21.058241 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0429ba6-ab1b-4461-b2ec-3cd7f4872dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:21.058940 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0429ba6-ab1b-4461-b2ec-3cd7f4872dec None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:21.059226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0429ba6-ab1b-4461-b2ec-3cd7f4872dec None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:21.059508 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0429ba6-ab1b-4461-b2ec-3cd7f4872dec None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:21.060304 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0429ba6-ab1b-4461-b2ec-3cd7f4872dec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:21.060653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0429ba6-ab1b-4461-b2ec-3cd7f4872dec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:21.062297 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0429ba6-ab1b-4461-b2ec-3cd7f4872dec None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:21.075564 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 326/635] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:21.076442 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0429ba6-ab1b-4461-b2ec-3cd7f4872dec None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:21.108508 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:21.156595 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee199a2a-092d-4885-bd8e-ad40a471b4ab None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:21.179690 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0429ba6-ab1b-4461-b2ec-3cd7f4872dec None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:21.196070 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595993f-374e-45a8-8563-cb9c19811a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:21.196738 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595993f-374e-45a8-8563-cb9c19811a61 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:21.197018 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595993f-374e-45a8-8563-cb9c19811a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:21.197299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595993f-374e-45a8-8563-cb9c19811a61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:21.208496 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595993f-374e-45a8-8563-cb9c19811a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:21.210258 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:21.210918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595993f-374e-45a8-8563-cb9c19811a61 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:21.216247 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea024c3b-e911-4cd8-9545-d629916b9cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:21.216876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea024c3b-e911-4cd8-9545-d629916b9cef None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:21.217160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea024c3b-e911-4cd8-9545-d629916b9cef None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:21.217465 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea024c3b-e911-4cd8-9545-d629916b9cef None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:21.218216 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea024c3b-e911-4cd8-9545-d629916b9cef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:21.218943 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea024c3b-e911-4cd8-9545-d629916b9cef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:21.221217 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea024c3b-e911-4cd8-9545-d629916b9cef None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:21.227208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-8595993f-374e-45a8-8563-cb9c19811a61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:21.227208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:21.227208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:21.227208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:21.227208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:21.227208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:21.227208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:21.227208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:21.227208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:21.227208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:21.227208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:21.227208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:21.227208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:21.227208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:21.227208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:21.228068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:21.228068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:21.228068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:21.228068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:21.228068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:21.228068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:21.228068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:21.228068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:21.228068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:21.228068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:21.228068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:21.228068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:21.228068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:21.228068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:21.228068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:21.228068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:21.228068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:21.228999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:21.228999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:21.228999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:21.228999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:21.228999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 310/636] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:21.229274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595993f-374e-45a8-8563-cb9c19811a61 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:21.238762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 327/637] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:21.239889 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea024c3b-e911-4cd8-9545-d629916b9cef None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:21.343409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595993f-374e-45a8-8563-cb9c19811a61 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:21.349845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea024c3b-e911-4cd8-9545-d629916b9cef None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:21.357119 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:21.380325 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4584b-6ba0-43cf-add4-fa6980529132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:21.380971 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4584b-6ba0-43cf-add4-fa6980529132 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:21.381253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4584b-6ba0-43cf-add4-fa6980529132 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:21.381526 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4584b-6ba0-43cf-add4-fa6980529132 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:21.386074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11426dc4-160c-4e74-b06b-8f6a2e269161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:21.386722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11426dc4-160c-4e74-b06b-8f6a2e269161 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:21.387007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11426dc4-160c-4e74-b06b-8f6a2e269161 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:21.387289 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11426dc4-160c-4e74-b06b-8f6a2e269161 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:21.391752 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4584b-6ba0-43cf-add4-fa6980529132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:21.394289 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11426dc4-160c-4e74-b06b-8f6a2e269161 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:21.395739 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11426dc4-160c-4e74-b06b-8f6a2e269161 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:21.397156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-5ad4584b-6ba0-43cf-add4-fa6980529132 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:21.397156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:21.397156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:21.397156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:21.397156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:21.397156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:21.397156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:21.397156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:21.397156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:21.397156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:21.397156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:21.397156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:21.397156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:21.397156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:21.397156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:21.397156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:21.398089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:21.398089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:21.398089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:21.398089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:21.398089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:21.398089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:21.398089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:21.398089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:21.398089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:21.398089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:21.398089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:21.398089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:21.398089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:21.398089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:21.398089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:21.398089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:21.398906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:21.398906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:21.398906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:21.398906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:21.398906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:21.398906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:21.398906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:21.398906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:21.398906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:21.398906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:21.398906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:21.398906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:21.398906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 311/638] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:21.399576 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4584b-6ba0-43cf-add4-fa6980529132 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:21.409264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-11426dc4-160c-4e74-b06b-8f6a2e269161 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:21.409264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:21.409264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:21.409264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:21.409264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:21.409264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:21.409264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:21.409264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:21.409264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:21.409264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:21.409264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:21.409264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:21.409264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:21.409264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:21.409264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:21.410245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:21.410245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:21.410245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:21.410245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:21.410245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:21.410245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:21.410245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:21.410245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:21.410245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:21.410245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:21.410245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:21.410245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:21.410245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:21.410245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:21.410245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:21.410245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:21.410245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:21.411114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:21.411114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:21.411114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:21.411114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:21.411114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:21.411114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:21.411114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:21.411114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:21.411114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 328/639] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:21.411114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11426dc4-160c-4e74-b06b-8f6a2e269161 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:21.463592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:21.501235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4584b-6ba0-43cf-add4-fa6980529132 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:21.510577 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11426dc4-160c-4e74-b06b-8f6a2e269161 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:21.535920 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d330c53-064a-4f0b-80c8-dde99d8b1a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:21.535920 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d330c53-064a-4f0b-80c8-dde99d8b1a4b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:21.536226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d330c53-064a-4f0b-80c8-dde99d8b1a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:21.536390 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d330c53-064a-4f0b-80c8-dde99d8b1a4b None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:21.537087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d330c53-064a-4f0b-80c8-dde99d8b1a4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:21.537396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d330c53-064a-4f0b-80c8-dde99d8b1a4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:21.538801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d330c53-064a-4f0b-80c8-dde99d8b1a4b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:21.546413 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78930cb-735a-4dc4-bfec-351891665881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:21.547084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78930cb-735a-4dc4-bfec-351891665881 None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:21.547368 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78930cb-735a-4dc4-bfec-351891665881 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:21.547668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78930cb-735a-4dc4-bfec-351891665881 None admin] PATH_INFO: `/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/878797620be54b74a3e8582c78ba78d2/roles/88ed5b6546c64ac09d03064e12ca7f10` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:21.550987 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 312/640] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:21.552211 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2ec1d-c5f5-4355-9a90-df17a84abcee None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:21.552503 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2ec1d-c5f5-4355-9a90-df17a84abcee None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:21.552780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2ec1d-c5f5-4355-9a90-df17a84abcee None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:21.554147 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 313/641] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:21.554680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2ec1d-c5f5-4355-9a90-df17a84abcee None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:21.563041 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78930cb-735a-4dc4-bfec-351891665881 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e37543156ee42a0818bf5cfe747fdc2, user_id=878797620be54b74a3e8582c78ba78d2, role_id=88ed5b6546c64ac09d03064e12ca7f10)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:21.564604 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78930cb-735a-4dc4-bfec-351891665881 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:21.577079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 329/642] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:12:21 2022] PUT /identity/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/878797620be54b74a3e8582c78ba78d2/roles/88ed5b6546c64ac09d03064e12ca7f10 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:12:21.577872 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78930cb-735a-4dc4-bfec-351891665881 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:21.589399 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:21.677347 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2ec1d-c5f5-4355-9a90-df17a84abcee None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:21.711249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78930cb-735a-4dc4-bfec-351891665881 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:21.713059 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:21.715975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3682d7c-659b-40bc-b644-0ad87742221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:21.716671 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3682d7c-659b-40bc-b644-0ad87742221c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:21.716953 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3682d7c-659b-40bc-b644-0ad87742221c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:21.717236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3682d7c-659b-40bc-b644-0ad87742221c None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:21.717966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3682d7c-659b-40bc-b644-0ad87742221c None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:21.718340 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3682d7c-659b-40bc-b644-0ad87742221c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:21.719748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3682d7c-659b-40bc-b644-0ad87742221c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:21.730807 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 314/643] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:12:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:21.731868 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3682d7c-659b-40bc-b644-0ad87742221c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:21.762573 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f91c4a-537c-4004-9e63-2e3753d7b5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:21.763111 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f91c4a-537c-4004-9e63-2e3753d7b5de None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:21.763400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f91c4a-537c-4004-9e63-2e3753d7b5de None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:21.763687 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f91c4a-537c-4004-9e63-2e3753d7b5de None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:21.764474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f91c4a-537c-4004-9e63-2e3753d7b5de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:21.764788 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f91c4a-537c-4004-9e63-2e3753d7b5de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:21.766239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f91c4a-537c-4004-9e63-2e3753d7b5de None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:21.778285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 330/644] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:21.779518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b37ec-37a4-403a-a800-d250ea85d158 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:21.779810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b37ec-37a4-403a-a800-d250ea85d158 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:21.780093 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b37ec-37a4-403a-a800-d250ea85d158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:21.798516 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-bd5b37ec-37a4-403a-a800-d250ea85d158 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:21.800314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-bd5b37ec-37a4-403a-a800-d250ea85d158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:21.842279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:21.850670 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3682d7c-659b-40bc-b644-0ad87742221c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:21.876711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 331/645] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:21.876711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b37ec-37a4-403a-a800-d250ea85d158 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:21.891456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec86005-3cf1-4898-8efa-eb1ce50eb939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:21.892256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec86005-3cf1-4898-8efa-eb1ce50eb939 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:21.892705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec86005-3cf1-4898-8efa-eb1ce50eb939 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:21.893053 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec86005-3cf1-4898-8efa-eb1ce50eb939 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:21.902187 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec86005-3cf1-4898-8efa-eb1ce50eb939 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:21.903630 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec86005-3cf1-4898-8efa-eb1ce50eb939 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:21.917205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-eec86005-3cf1-4898-8efa-eb1ce50eb939 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 10:12:21.917205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:21.917205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:21.917205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:21.917205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:21.917205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:21.917205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:21.917205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:21.917205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:21.917205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:21.917205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:21.917205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:21.917205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:21.917205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:21.917205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:21.917205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:21.918153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:21.918153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:21.918153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:21.918153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:21.918153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:21.918153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:21.918153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:21.918153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:21.918153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:21.918153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:21.918153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:21.918153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:21.918153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:21.918153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:21.918153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:21.918153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:21.918153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:21.918153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:21.919207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:21.919207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:21.919207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:21.919207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:21.919207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:21.919207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:21.919207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:21.919207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:21.919207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 10:12:21.919207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:21.919207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 315/646] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:12:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:21.919207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec86005-3cf1-4898-8efa-eb1ce50eb939 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:21.979479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:21.989076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b37ec-37a4-403a-a800-d250ea85d158 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:22.025631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fea27-cb01-4a52-b162-70a2f7c2338a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:22.026206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fea27-cb01-4a52-b162-70a2f7c2338a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:22.026494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fea27-cb01-4a52-b162-70a2f7c2338a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:22.026771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fea27-cb01-4a52-b162-70a2f7c2338a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:22.027218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec86005-3cf1-4898-8efa-eb1ce50eb939 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:22.039515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fea27-cb01-4a52-b162-70a2f7c2338a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:22.041032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fea27-cb01-4a52-b162-70a2f7c2338a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:22.060782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-5c1fea27-cb01-4a52-b162-70a2f7c2338a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:22.060782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:22.060782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:22.060782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:22.060782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:22.060782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:22.060782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:22.060782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:22.060782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:22.060782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:22.060782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:22.060782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:22.060782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:22.060782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:22.060782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:22.061977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:22.061977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:22.061977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:22.061977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:22.061977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:22.061977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:22.061977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:22.061977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:22.061977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:22.061977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:22.061977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:22.061977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:22.061977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:22.061977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:22.061977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:22.061977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:22.061977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:22.062857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:22.062857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:22.062857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:22.062857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:22.062857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 332/647] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:22.063716 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fea27-cb01-4a52-b162-70a2f7c2338a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:22.071153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9cf96-75b2-4568-a255-7623eb277be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:22.071796 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9cf96-75b2-4568-a255-7623eb277be9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:22.072082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9cf96-75b2-4568-a255-7623eb277be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:22.072391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9cf96-75b2-4568-a255-7623eb277be9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:22.073213 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9cf96-75b2-4568-a255-7623eb277be9 None admin] RBAC: Adding query filter params (role.id=88ed5b6546c64ac09d03064e12ca7f10, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=592539924feb44ad8ea520d8539b6608) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:22.073530 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9cf96-75b2-4568-a255-7623eb277be9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:22.075009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9cf96-75b2-4568-a255-7623eb277be9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:22.088478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 316/648] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:12:21 2022] GET /identity/v3/role_assignments?user.id=592539924feb44ad8ea520d8539b6608&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=88ed5b6546c64ac09d03064e12ca7f10 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:22.088478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9cf96-75b2-4568-a255-7623eb277be9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:22.144586 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:22.209529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9cf96-75b2-4568-a255-7623eb277be9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:22.247559 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91255136-35d8-44d1-bac3-3b3de69b334f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:22.248304 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91255136-35d8-44d1-bac3-3b3de69b334f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:22.248589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91255136-35d8-44d1-bac3-3b3de69b334f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:22.248863 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91255136-35d8-44d1-bac3-3b3de69b334f None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:22.249668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91255136-35d8-44d1-bac3-3b3de69b334f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:22.249974 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91255136-35d8-44d1-bac3-3b3de69b334f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:22.251652 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91255136-35d8-44d1-bac3-3b3de69b334f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:22.271877 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 317/649] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Aug 4 10:12:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:22.272755 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91255136-35d8-44d1-bac3-3b3de69b334f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:22.317967 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fea27-cb01-4a52-b162-70a2f7c2338a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:22.359196 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43af9f9-8cd2-4b74-a37c-64688408b72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:22.359940 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43af9f9-8cd2-4b74-a37c-64688408b72c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:22.360271 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43af9f9-8cd2-4b74-a37c-64688408b72c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:22.360548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43af9f9-8cd2-4b74-a37c-64688408b72c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:22.366870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:22.375443 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43af9f9-8cd2-4b74-a37c-64688408b72c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:22.382212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-d43af9f9-8cd2-4b74-a37c-64688408b72c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:22.382212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:22.382212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:22.382212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:22.382212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:22.382212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:22.382212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:22.382212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:22.382212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:22.382212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:22.382212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:22.382212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:22.382212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:22.382212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:22.382212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:22.382212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:22.383130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:22.383130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:22.383130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:22.383130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:22.383130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:22.383130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:22.383130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:22.383130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:22.383130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:22.383130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:22.383130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:22.383130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:22.383130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:22.383130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:22.383130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:22.383130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:22.383960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:22.383960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:22.383960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:22.383960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:22.383960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:22.383960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:22.383960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:22.383960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:22.383960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:22.383960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:22.383960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:22.383960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:22.384620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 333/650] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:22.385432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43af9f9-8cd2-4b74-a37c-64688408b72c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:22.388999 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:22.403082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91255136-35d8-44d1-bac3-3b3de69b334f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:22.453208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dd7b8-1a99-4e60-8638-a94f6128efa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:22.453840 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dd7b8-1a99-4e60-8638-a94f6128efa1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:22.454124 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dd7b8-1a99-4e60-8638-a94f6128efa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:22.454404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20dd7b8-1a99-4e60-8638-a94f6128efa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:22.455914 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dd7b8-1a99-4e60-8638-a94f6128efa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:22.456268 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dd7b8-1a99-4e60-8638-a94f6128efa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:22.458515 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20dd7b8-1a99-4e60-8638-a94f6128efa1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:22.474913 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 318/651] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:22.476022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dd7b8-1a99-4e60-8638-a94f6128efa1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:22.495451 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43af9f9-8cd2-4b74-a37c-64688408b72c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:22.535697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1447159-1773-46f0-8b29-96c35cae7549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:22.536361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1447159-1773-46f0-8b29-96c35cae7549 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:22.536629 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1447159-1773-46f0-8b29-96c35cae7549 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:22.536907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1447159-1773-46f0-8b29-96c35cae7549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:22.601136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20dd7b8-1a99-4e60-8638-a94f6128efa1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:22.609043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1447159-1773-46f0-8b29-96c35cae7549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:22.610526 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1447159-1773-46f0-8b29-96c35cae7549 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:22.613341 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:22.644462 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ab1ae-a76f-4506-a179-ff5d39320c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:22.645969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ab1ae-a76f-4506-a179-ff5d39320c25 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:22.646759 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ab1ae-a76f-4506-a179-ff5d39320c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:22.647481 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ab1ae-a76f-4506-a179-ff5d39320c25 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:22.648724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ab1ae-a76f-4506-a179-ff5d39320c25 None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:22.649284 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ab1ae-a76f-4506-a179-ff5d39320c25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:22.650855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ab1ae-a76f-4506-a179-ff5d39320c25 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:22.653576 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:22.662972 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 319/652] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:12:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:22.664194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ab1ae-a76f-4506-a179-ff5d39320c25 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:22.724834 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 334/653] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:12:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:12:22.725299 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1447159-1773-46f0-8b29-96c35cae7549 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:22.782124 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ab1ae-a76f-4506-a179-ff5d39320c25 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:22.819491 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704eba3a-79c0-4d1f-a968-6c966bc4edcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:22.820502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704eba3a-79c0-4d1f-a968-6c966bc4edcc None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:22.820939 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704eba3a-79c0-4d1f-a968-6c966bc4edcc None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:22.821353 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704eba3a-79c0-4d1f-a968-6c966bc4edcc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:22.831605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704eba3a-79c0-4d1f-a968-6c966bc4edcc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:22.833113 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704eba3a-79c0-4d1f-a968-6c966bc4edcc None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:22.848307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-704eba3a-79c0-4d1f-a968-6c966bc4edcc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 10:12:22.848307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:22.848307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:22.848307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:22.848307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:22.848307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:22.848307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:22.848307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:22.848307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:22.848307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:22.848307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:22.848307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:22.848307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:22.848307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:22.848307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:22.848307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:22.849309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:22.849309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:22.849309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:22.849309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:22.849309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:22.849309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:22.849309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:22.849309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:22.849309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:22.849309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:22.849309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:22.849309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:22.849309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:22.849309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:22.849309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:22.849309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:22.849309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:22.849309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:22.850219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:22.850219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:22.850219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:22.850219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:22.850219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:22.850219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:22.850219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:22.850219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:22.850219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 10:12:22.850219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:22.850750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 320/654] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:12:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:22.851337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704eba3a-79c0-4d1f-a968-6c966bc4edcc None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:22.867587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1447159-1773-46f0-8b29-96c35cae7549 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:22.870627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:22.915093 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2e510-0a6b-4100-a0d0-19c30e1e414e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:22.916019 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2e510-0a6b-4100-a0d0-19c30e1e414e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:22.916991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2e510-0a6b-4100-a0d0-19c30e1e414e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:22.917419 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2e510-0a6b-4100-a0d0-19c30e1e414e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:22.923030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:22.936686 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2e510-0a6b-4100-a0d0-19c30e1e414e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:22.938365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2e510-0a6b-4100-a0d0-19c30e1e414e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:22.958849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-85f2e510-0a6b-4100-a0d0-19c30e1e414e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:22.958849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:22.958849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:22.958849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:22.958849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:22.958849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:22.958849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:22.958849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:22.958849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:22.958849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:22.958849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:22.958849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:22.958849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:22.958849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:22.958849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:22.959904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:22.959904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:22.959904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:22.959904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:22.959904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:22.959904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:22.959904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:22.959904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:22.959904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:22.959904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:22.959904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:22.959904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:22.959904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:22.959904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:22.959904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:22.959904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:22.959904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:22.960853 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:22.960853 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:22.960853 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:22.960853 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:22.966218 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 335/655] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:22.966218 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2e510-0a6b-4100-a0d0-19c30e1e414e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:22.986862 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704eba3a-79c0-4d1f-a968-6c966bc4edcc None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:23.030396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f269a7-79f0-49b7-98b7-897dc6104dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:23.031192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f269a7-79f0-49b7-98b7-897dc6104dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:23.031484 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f269a7-79f0-49b7-98b7-897dc6104dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:23.031765 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f269a7-79f0-49b7-98b7-897dc6104dc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:23.046039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f269a7-79f0-49b7-98b7-897dc6104dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:23.048118 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f269a7-79f0-49b7-98b7-897dc6104dc5 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:23.067331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-30f269a7-79f0-49b7-98b7-897dc6104dc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:23.067331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:23.067331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:23.067331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:23.067331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:23.067331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:23.067331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:23.067331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:23.067331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:23.067331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:23.067331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:23.067331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:23.067331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:23.067331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:23.067331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:23.068580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:23.068580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:23.068580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:23.068580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:23.068580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:23.068580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:23.068580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:23.068580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:23.068580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:23.068580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:23.068580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:23.068580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:23.068580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:23.068580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:23.068580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:23.068580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:23.068580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:23.069474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:23.069474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:23.069474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:23.069474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:23.072239 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 321/656] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:23.073252 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f269a7-79f0-49b7-98b7-897dc6104dc5 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:23.101095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2e510-0a6b-4100-a0d0-19c30e1e414e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:23.147047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c68e1-306f-4f3c-91ae-a79986450bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:23.148727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c68e1-306f-4f3c-91ae-a79986450bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:23.149376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c68e1-306f-4f3c-91ae-a79986450bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:23.149948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c68e1-306f-4f3c-91ae-a79986450bf8 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:23.151215 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c68e1-306f-4f3c-91ae-a79986450bf8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:23.152092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c68e1-306f-4f3c-91ae-a79986450bf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:23.154023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c68e1-306f-4f3c-91ae-a79986450bf8 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:23.179264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 336/657] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Aug 4 10:12:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:23.180117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c68e1-306f-4f3c-91ae-a79986450bf8 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:23.201290 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f269a7-79f0-49b7-98b7-897dc6104dc5 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:23.201951 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:23.215539 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:23.249738 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b06b6-e401-4a3f-bb16-8efbfd07e55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:23.250379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b06b6-e401-4a3f-bb16-8efbfd07e55f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:23.250664 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b06b6-e401-4a3f-bb16-8efbfd07e55f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:23.250944 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b06b6-e401-4a3f-bb16-8efbfd07e55f None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:23.252233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b06b6-e401-4a3f-bb16-8efbfd07e55f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:23.252549 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b06b6-e401-4a3f-bb16-8efbfd07e55f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:23.253932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b06b6-e401-4a3f-bb16-8efbfd07e55f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:23.274563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 322/658] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:23.274563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b06b6-e401-4a3f-bb16-8efbfd07e55f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:23.321198 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c68e1-306f-4f3c-91ae-a79986450bf8 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:23.370119 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b856b64-d3a8-4f8d-adb9-a7d7d751fb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:23.370735 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b856b64-d3a8-4f8d-adb9-a7d7d751fb55 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:23.371020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b856b64-d3a8-4f8d-adb9-a7d7d751fb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:23.371296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b856b64-d3a8-4f8d-adb9-a7d7d751fb55 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:23.371986 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b856b64-d3a8-4f8d-adb9-a7d7d751fb55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:23.372315 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b856b64-d3a8-4f8d-adb9-a7d7d751fb55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:23.373692 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b856b64-d3a8-4f8d-adb9-a7d7d751fb55 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:23.385815 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 337/659] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:23.386663 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b856b64-d3a8-4f8d-adb9-a7d7d751fb55 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:23.420452 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b06b6-e401-4a3f-bb16-8efbfd07e55f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:23.469851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda80f19-43ab-4cad-9245-029ac86e1d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:23.471259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda80f19-43ab-4cad-9245-029ac86e1d4d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:23.471552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda80f19-43ab-4cad-9245-029ac86e1d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:23.471831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda80f19-43ab-4cad-9245-029ac86e1d4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:23.474003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:23.501825 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b856b64-d3a8-4f8d-adb9-a7d7d751fb55 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:23.529684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:23.543203 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8003f-08cf-4294-b263-d5b5fe3f5c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:23.544018 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8003f-08cf-4294-b263-d5b5fe3f5c55 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:23.544724 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8003f-08cf-4294-b263-d5b5fe3f5c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:23.544863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8003f-08cf-4294-b263-d5b5fe3f5c55 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:23.554335 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8003f-08cf-4294-b263-d5b5fe3f5c55 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:23.555928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8003f-08cf-4294-b263-d5b5fe3f5c55 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:23.569444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-3fa8003f-08cf-4294-b263-d5b5fe3f5c55 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 10:12:23.569444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:23.569444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:23.569444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:23.569444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:23.569444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:23.569444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:23.569444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:23.569444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:23.569444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:23.569444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:23.569444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:23.569444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:23.569444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:23.569444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:23.569444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:23.570420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:23.570420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:23.570420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:23.570420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:23.570420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:23.570420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:23.570420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:23.570420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:23.570420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:23.570420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:23.570420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:23.570420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:23.570420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:23.570420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:23.570420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:23.570420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:23.570420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:23.570420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:23.571342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:23.571342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:23.571342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:23.571342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:23.571342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:23.571342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:23.571342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:23.571342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:23.571342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 10:12:23.571342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:23.571342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 338/660] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:23.571931 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8003f-08cf-4294-b263-d5b5fe3f5c55 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:23.574248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda80f19-43ab-4cad-9245-029ac86e1d4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:23.580486 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda80f19-43ab-4cad-9245-029ac86e1d4d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:23.684353 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8003f-08cf-4294-b263-d5b5fe3f5c55 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:23.711444 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 323/661] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:12:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:12:23.711444 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda80f19-43ab-4cad-9245-029ac86e1d4d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:23.734162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c3a63-5a7d-4b71-b876-07b45e0dfee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:23.734812 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c3a63-5a7d-4b71-b876-07b45e0dfee4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:23.735101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c3a63-5a7d-4b71-b876-07b45e0dfee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:23.735380 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c3a63-5a7d-4b71-b876-07b45e0dfee4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:23.737576 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:23.743259 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c3a63-5a7d-4b71-b876-07b45e0dfee4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:23.744839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c3a63-5a7d-4b71-b876-07b45e0dfee4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:23.757954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-cd8c3a63-5a7d-4b71-b876-07b45e0dfee4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:23.757954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:23.757954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:23.757954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:23.757954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:23.757954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:23.757954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:23.757954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:23.757954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:23.757954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:23.757954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:23.757954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:23.757954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:23.757954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:23.757954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:23.758848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:23.758848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:23.758848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:23.758848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:23.758848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:23.758848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:23.758848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:23.758848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:23.758848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:23.758848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:23.758848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:23.758848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:23.758848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:23.758848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:23.758848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:23.758848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:23.758848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:23.759734 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:23.759734 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:23.759734 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:23.759734 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:23.759734 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:23.759734 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:23.759734 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:23.759734 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:23.759734 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 339/662] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:23.761048 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e3a21-3196-4988-86f5-c3ef0a4047bb None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:23.761048 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e3a21-3196-4988-86f5-c3ef0a4047bb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:23.761196 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e3a21-3196-4988-86f5-c3ef0a4047bb None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:23.767911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 340/663] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:23.767911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e3a21-3196-4988-86f5-c3ef0a4047bb None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:23.798824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:23.833234 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda80f19-43ab-4cad-9245-029ac86e1d4d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:23.868553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d192fe-805c-443d-aa28-b7e691100a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:23.869328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d192fe-805c-443d-aa28-b7e691100a36 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:23.869726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d192fe-805c-443d-aa28-b7e691100a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:23.870111 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d192fe-805c-443d-aa28-b7e691100a36 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:23.870920 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d192fe-805c-443d-aa28-b7e691100a36 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:23.871234 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d192fe-805c-443d-aa28-b7e691100a36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:23.872700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d192fe-805c-443d-aa28-b7e691100a36 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:23.874885 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e3a21-3196-4988-86f5-c3ef0a4047bb None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:23.894925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 324/664] 10.222.0.48 () {56 vars in 1139 bytes} [Thu Aug 4 10:12:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:23.894925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d192fe-805c-443d-aa28-b7e691100a36 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:23.917491 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3874ea7-2fb6-4620-9126-36f095c481b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:23.918147 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3874ea7-2fb6-4620-9126-36f095c481b5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:23.918430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3874ea7-2fb6-4620-9126-36f095c481b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:23.918714 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3874ea7-2fb6-4620-9126-36f095c481b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:23.929517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3874ea7-2fb6-4620-9126-36f095c481b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:23.930986 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3874ea7-2fb6-4620-9126-36f095c481b5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:23.947188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-c3874ea7-2fb6-4620-9126-36f095c481b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:23.947188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:23.947188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:23.947188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:23.947188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:23.947188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:23.947188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:23.947188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:23.947188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:23.947188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:23.947188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:23.947188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:23.947188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:23.947188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:23.947188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:23.948272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:23.948272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:23.948272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:23.948272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:23.948272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:23.948272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:23.948272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:23.948272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:23.948272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:23.948272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:23.948272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:23.948272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:23.948272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:23.948272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:23.948272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:23.948272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:23.948272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:23.949149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:23.949149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:23.949149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:23.949149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:23.949149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 341/665] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:23.949469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111604a4-6763-4bcc-95e3-bd77ee970890 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:23.949757 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111604a4-6763-4bcc-95e3-bd77ee970890 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:23.950030 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111604a4-6763-4bcc-95e3-bd77ee970890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:23.969390 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-111604a4-6763-4bcc-95e3-bd77ee970890 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:23.971301 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-111604a4-6763-4bcc-95e3-bd77ee970890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:24.010616 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d192fe-805c-443d-aa28-b7e691100a36 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:24.021451 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:24.038718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:24.050521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed26335-b1a4-4e83-9083-a87b40747261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:24.051404 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 342/666] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:24.051631 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed26335-b1a4-4e83-9083-a87b40747261 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:24.052148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed26335-b1a4-4e83-9083-a87b40747261 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:24.052293 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111604a4-6763-4bcc-95e3-bd77ee970890 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:24.052893 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed26335-b1a4-4e83-9083-a87b40747261 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:24.053867 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed26335-b1a4-4e83-9083-a87b40747261 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:24.054636 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed26335-b1a4-4e83-9083-a87b40747261 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:24.057263 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed26335-b1a4-4e83-9083-a87b40747261 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:24.072155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 325/667] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:24.073019 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed26335-b1a4-4e83-9083-a87b40747261 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:24.170090 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111604a4-6763-4bcc-95e3-bd77ee970890 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:24.187856 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed26335-b1a4-4e83-9083-a87b40747261 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:24.209771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401016e-ad73-4822-a6c4-8e2bcaf9ffe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:24.210640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401016e-ad73-4822-a6c4-8e2bcaf9ffe3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:24.211079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401016e-ad73-4822-a6c4-8e2bcaf9ffe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:24.211509 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401016e-ad73-4822-a6c4-8e2bcaf9ffe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:24.223751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63830031-d313-441f-ae3b-526274eca408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:24.224409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63830031-d313-441f-ae3b-526274eca408 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:24.224698 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63830031-d313-441f-ae3b-526274eca408 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:24.224979 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63830031-d313-441f-ae3b-526274eca408 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:24.225675 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63830031-d313-441f-ae3b-526274eca408 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:24.225987 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63830031-d313-441f-ae3b-526274eca408 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:24.227351 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63830031-d313-441f-ae3b-526274eca408 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:24.239654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 326/668] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:24.240791 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63830031-d313-441f-ae3b-526274eca408 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:24.265488 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:24.291118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401016e-ad73-4822-a6c4-8e2bcaf9ffe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:24.292623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401016e-ad73-4822-a6c4-8e2bcaf9ffe3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:24.294209 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:24.357052 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63830031-d313-441f-ae3b-526274eca408 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:24.392738 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff847894-6da3-4425-aab0-ffc2adb09452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:24.393463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff847894-6da3-4425-aab0-ffc2adb09452 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:24.393750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff847894-6da3-4425-aab0-ffc2adb09452 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:24.394027 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff847894-6da3-4425-aab0-ffc2adb09452 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:24.394845 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff847894-6da3-4425-aab0-ffc2adb09452 None admin] RBAC: Adding query filter params (role.id=88ed5b6546c64ac09d03064e12ca7f10, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=0dc15e64c987488f812d1cdd0c82c7ea) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:24.395161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff847894-6da3-4425-aab0-ffc2adb09452 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:24.400363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 343/669] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:12:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:12:24.400363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401016e-ad73-4822-a6c4-8e2bcaf9ffe3 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:24.400603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff847894-6da3-4425-aab0-ffc2adb09452 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:24.402709 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 327/670] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:12:24 2022] GET /identity/v3/role_assignments?user.id=0dc15e64c987488f812d1cdd0c82c7ea&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=88ed5b6546c64ac09d03064e12ca7f10 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:24.403356 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff847894-6da3-4425-aab0-ffc2adb09452 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:24.490668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:24.515775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff847894-6da3-4425-aab0-ffc2adb09452 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:24.526233 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401016e-ad73-4822-a6c4-8e2bcaf9ffe3 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:24.531794 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:24.562480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7104e-f0df-4d5a-9f92-4abeb2b3338d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:24.563370 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7104e-f0df-4d5a-9f92-4abeb2b3338d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:24.563635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7104e-f0df-4d5a-9f92-4abeb2b3338d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:24.563948 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7104e-f0df-4d5a-9f92-4abeb2b3338d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:24.572428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7104e-f0df-4d5a-9f92-4abeb2b3338d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:24.573528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2324a40-ee51-44d5-8679-f8f933a0e736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:24.573980 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7104e-f0df-4d5a-9f92-4abeb2b3338d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:24.574186 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2324a40-ee51-44d5-8679-f8f933a0e736 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:24.574460 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2324a40-ee51-44d5-8679-f8f933a0e736 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:24.574745 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2324a40-ee51-44d5-8679-f8f933a0e736 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:24.587819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-46f7104e-f0df-4d5a-9f92-4abeb2b3338d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:24.587819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:24.587819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:24.587819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:24.587819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:24.587819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:24.587819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:24.587819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:24.587819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:24.587819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:24.587819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:24.587819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:24.587819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:24.587819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:24.587819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:24.588943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:24.588943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:24.588943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:24.588943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:24.588943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:24.588943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:24.588943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:24.588943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:24.588943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:24.588943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:24.588943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:24.588943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:24.588943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:24.588943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:24.588943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:24.588943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:24.588943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:24.589820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:24.589820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:24.589820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:24.589820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:24.589820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:24.589820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:24.589820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:24.589820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:24.589820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 328/671] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:24.590287 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2324a40-ee51-44d5-8679-f8f933a0e736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:24.590364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553be84-3d61-4939-9417-9d06b61f4a97 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:24.590434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553be84-3d61-4939-9417-9d06b61f4a97 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:24.591105 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553be84-3d61-4939-9417-9d06b61f4a97 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:24.596265 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 329/672] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:24.596265 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553be84-3d61-4939-9417-9d06b61f4a97 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:24.596456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-b2324a40-ee51-44d5-8679-f8f933a0e736 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:24.596456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:24.596456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:24.596456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:24.596456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:24.596456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:24.596456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:24.596456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:24.596456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:24.596456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:24.596456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:24.596456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:24.596456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:24.596456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:24.596456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:24.596456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:24.597836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:24.597836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:24.597836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:24.597836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:24.597836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:24.597836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:24.597836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:24.597836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:24.597836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:24.597836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:24.597836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:24.597836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:24.597836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:24.597836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:24.597836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:24.597836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:24.600904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:24.600904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:24.600904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:24.600904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:24.600904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:24.600904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:24.600904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:24.600904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:24.600904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:24.600904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:24.600904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:24.600904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:24.600904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 344/673] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:24.600904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2324a40-ee51-44d5-8679-f8f933a0e736 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:24.712041 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553be84-3d61-4939-9417-9d06b61f4a97 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:24.716110 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2324a40-ee51-44d5-8679-f8f933a0e736 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:24.750377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1b8dd-113e-462a-8f5e-30934c0b2193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:24.750948 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1b8dd-113e-462a-8f5e-30934c0b2193 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:24.751260 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1b8dd-113e-462a-8f5e-30934c0b2193 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:24.751528 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1b8dd-113e-462a-8f5e-30934c0b2193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:24.754043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7c502-3815-4a74-9667-079c238b1eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:24.754821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7c502-3815-4a74-9667-079c238b1eba None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:24.755107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7c502-3815-4a74-9667-079c238b1eba None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:24.755382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7c502-3815-4a74-9667-079c238b1eba None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:24.756129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7c502-3815-4a74-9667-079c238b1eba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:24.756467 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7c502-3815-4a74-9667-079c238b1eba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:24.757949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7c502-3815-4a74-9667-079c238b1eba None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:24.761205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:24.762086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1b8dd-113e-462a-8f5e-30934c0b2193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:24.763824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1b8dd-113e-462a-8f5e-30934c0b2193 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:24.777464 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 345/674] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:24.777464 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b8dae-23ad-4e78-b422-2a1ad50c8789 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:24.777464 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b8dae-23ad-4e78-b422-2a1ad50c8789 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:24.777464 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b8dae-23ad-4e78-b422-2a1ad50c8789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:24.785800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-16e1b8dd-113e-462a-8f5e-30934c0b2193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:24.785800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:24.785800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:24.785800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:24.785800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:24.785800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:24.785800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:24.785800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:24.785800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:24.785800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:24.785800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:24.785800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:24.785800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:24.785800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:24.785800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:24.786661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:24.786661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:24.786661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:24.786661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:24.786661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:24.786661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:24.786661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:24.786661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:24.786661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:24.786661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:24.786661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:24.786661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:24.786661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:24.786661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:24.786661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:24.786661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:24.786661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:24.787521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:24.787521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:24.787521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:24.787521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:24.791627 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 330/675] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:24.792482 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1b8dd-113e-462a-8f5e-30934c0b2193 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:24.793709 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c84b8dae-23ad-4e78-b422-2a1ad50c8789 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:24.794882 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c84b8dae-23ad-4e78-b422-2a1ad50c8789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:24.818630 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:24.869691 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 346/676] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:24.870839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b8dae-23ad-4e78-b422-2a1ad50c8789 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:24.903245 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1b8dd-113e-462a-8f5e-30934c0b2193 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:24.946459 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45809847-d602-46c2-9797-00b36432d8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:24.947393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45809847-d602-46c2-9797-00b36432d8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:24.947760 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45809847-d602-46c2-9797-00b36432d8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:24.948132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45809847-d602-46c2-9797-00b36432d8a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:24.949118 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45809847-d602-46c2-9797-00b36432d8a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:24.949462 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45809847-d602-46c2-9797-00b36432d8a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:24.950857 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45809847-d602-46c2-9797-00b36432d8a2 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:24.965002 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 331/677] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:12:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:24.965002 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45809847-d602-46c2-9797-00b36432d8a2 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:24.990752 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b8dae-23ad-4e78-b422-2a1ad50c8789 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:25.020153 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:25.029701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6265d6-6f82-467d-ab79-384e76c503d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:25.030496 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6265d6-6f82-467d-ab79-384e76c503d6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:25.030764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6265d6-6f82-467d-ab79-384e76c503d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:25.031341 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6265d6-6f82-467d-ab79-384e76c503d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:25.032132 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6265d6-6f82-467d-ab79-384e76c503d6 None admin] RBAC: Adding query filter params (role.id=88ed5b6546c64ac09d03064e12ca7f10, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=180731bbc26c4681965dfd9cf0c1f063) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:25.032472 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6265d6-6f82-467d-ab79-384e76c503d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:25.034654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6265d6-6f82-467d-ab79-384e76c503d6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:25.052197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 347/678] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:12:24 2022] GET /identity/v3/role_assignments?user.id=180731bbc26c4681965dfd9cf0c1f063&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=88ed5b6546c64ac09d03064e12ca7f10 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:25.052197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6265d6-6f82-467d-ab79-384e76c503d6 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:25.082175 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:25.091687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45809847-d602-46c2-9797-00b36432d8a2 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:25.132746 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c8e7c-230b-45d4-a506-7835a7d7ced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:25.133498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c8e7c-230b-45d4-a506-7835a7d7ced9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:25.133846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c8e7c-230b-45d4-a506-7835a7d7ced9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:25.134124 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c8e7c-230b-45d4-a506-7835a7d7ced9 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:25.134835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c8e7c-230b-45d4-a506-7835a7d7ced9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:25.135141 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c8e7c-230b-45d4-a506-7835a7d7ced9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:25.136695 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c8e7c-230b-45d4-a506-7835a7d7ced9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:25.151362 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 332/679] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:25.152453 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c8e7c-230b-45d4-a506-7835a7d7ced9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:25.158552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6265d6-6f82-467d-ab79-384e76c503d6 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:25.198265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31151e-d3c3-4331-9c23-341b7af31d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:25.199104 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31151e-d3c3-4331-9c23-341b7af31d63 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:25.199486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31151e-d3c3-4331-9c23-341b7af31d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:25.199879 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31151e-d3c3-4331-9c23-341b7af31d63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:25.212998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31151e-d3c3-4331-9c23-341b7af31d63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:25.219206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-0f31151e-d3c3-4331-9c23-341b7af31d63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:12:25.219206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:25.219206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:25.219206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:25.219206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:25.219206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:25.219206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:25.219206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:25.219206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:25.219206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:25.219206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:25.219206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:25.219206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:25.219206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:25.219206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:25.219206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:25.221003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:25.221003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:25.221003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:25.221003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:25.221003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:25.221003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:25.221003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:25.221003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:25.221003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:25.221003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:25.221003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:25.221003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:25.221003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:25.221003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:25.221003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:25.221003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:25.222001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:25.222001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:25.222001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:25.222001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:25.222001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:25.222001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:25.222001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:25.222001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:25.222001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:25.222001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:25.222001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:12:25.222001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:25.222986 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 348/680] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:12:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:25.224124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31151e-d3c3-4331-9c23-341b7af31d63 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:25.285354 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:25.288220 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c8e7c-230b-45d4-a506-7835a7d7ced9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:25.330804 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f349d-3f28-4f8d-972c-30d5a46cbc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:25.331461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f349d-3f28-4f8d-972c-30d5a46cbc26 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:25.331740 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f349d-3f28-4f8d-972c-30d5a46cbc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:25.332021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f349d-3f28-4f8d-972c-30d5a46cbc26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:25.344462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31151e-d3c3-4331-9c23-341b7af31d63 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:25.344991 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f349d-3f28-4f8d-972c-30d5a46cbc26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:25.347188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f349d-3f28-4f8d-972c-30d5a46cbc26 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:25.360376 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:25.369579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-6c9f349d-3f28-4f8d-972c-30d5a46cbc26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:25.369579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:25.369579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:25.369579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:25.369579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:25.369579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:25.369579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:25.369579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:25.369579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:25.369579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:25.369579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:25.369579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:25.369579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:25.369579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:25.369579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:25.370476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:25.370476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:25.370476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:25.370476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:25.370476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:25.370476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:25.370476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:25.370476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:25.370476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:25.370476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:25.370476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:25.370476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:25.370476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:25.370476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:25.370476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:25.370476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:25.370476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:25.371602 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:25.371602 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:25.371602 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:25.371602 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:25.371602 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 333/681] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:25.372834 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f349d-3f28-4f8d-972c-30d5a46cbc26 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:25.395259 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3115e6-182b-4191-b805-2c2e9c1adbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:25.396781 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3115e6-182b-4191-b805-2c2e9c1adbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:25.397244 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3115e6-182b-4191-b805-2c2e9c1adbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:25.397731 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3115e6-182b-4191-b805-2c2e9c1adbe7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:25.408790 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3115e6-182b-4191-b805-2c2e9c1adbe7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:25.410800 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3115e6-182b-4191-b805-2c2e9c1adbe7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:25.432116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-9d3115e6-182b-4191-b805-2c2e9c1adbe7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:25.432116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:25.432116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:25.432116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:25.432116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:25.432116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:25.432116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:25.432116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:25.432116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:25.432116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:25.432116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:25.432116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:25.432116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:25.432116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:25.432116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:25.433149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:25.433149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:25.433149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:25.433149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:25.433149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:25.433149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:25.433149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:25.433149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:25.433149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:25.433149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:25.433149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:25.433149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:25.433149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:25.433149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:25.433149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:25.433149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:25.433149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:25.434025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:25.434025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:25.434025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:25.434025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:25.434025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:25.434025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:25.434025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:25.434025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:25.441246 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 349/682] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:25.441246 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3115e6-182b-4191-b805-2c2e9c1adbe7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:25.492024 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f349d-3f28-4f8d-972c-30d5a46cbc26 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:25.528727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f37dc2-2fad-4226-be3a-7bdaddfd4218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:25.529510 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f37dc2-2fad-4226-be3a-7bdaddfd4218 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:25.529898 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f37dc2-2fad-4226-be3a-7bdaddfd4218 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:25.530290 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f37dc2-2fad-4226-be3a-7bdaddfd4218 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:25.531185 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f37dc2-2fad-4226-be3a-7bdaddfd4218 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:25.531598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f37dc2-2fad-4226-be3a-7bdaddfd4218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:25.533750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f37dc2-2fad-4226-be3a-7bdaddfd4218 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:25.548576 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 334/683] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:12:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:25.549504 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f37dc2-2fad-4226-be3a-7bdaddfd4218 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:25.574222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3115e6-182b-4191-b805-2c2e9c1adbe7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:25.589609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:25.616522 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:25.624837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0494bc-ba04-40ee-a306-3d38e469db9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:25.625665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0494bc-ba04-40ee-a306-3d38e469db9e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:25.626098 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0494bc-ba04-40ee-a306-3d38e469db9e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:25.626561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0494bc-ba04-40ee-a306-3d38e469db9e None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:25.627412 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0494bc-ba04-40ee-a306-3d38e469db9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:25.627889 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0494bc-ba04-40ee-a306-3d38e469db9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:25.629457 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0494bc-ba04-40ee-a306-3d38e469db9e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:25.642786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 350/684] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:25.643908 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0494bc-ba04-40ee-a306-3d38e469db9e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:25.666991 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f37dc2-2fad-4226-be3a-7bdaddfd4218 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:25.703588 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd7a4a-fdd6-4e0b-aeb4-fa6d0974a359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:25.704441 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd7a4a-fdd6-4e0b-aeb4-fa6d0974a359 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:25.704782 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd7a4a-fdd6-4e0b-aeb4-fa6d0974a359 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:25.705067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd7a4a-fdd6-4e0b-aeb4-fa6d0974a359 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:25.705880 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd7a4a-fdd6-4e0b-aeb4-fa6d0974a359 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:25.706188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd7a4a-fdd6-4e0b-aeb4-fa6d0974a359 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:25.707623 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd7a4a-fdd6-4e0b-aeb4-fa6d0974a359 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:25.721662 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 335/685] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:25.722501 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd7a4a-fdd6-4e0b-aeb4-fa6d0974a359 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:25.777869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0494bc-ba04-40ee-a306-3d38e469db9e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:25.830404 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374f0aa-b591-47c5-bea3-287490cef82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:25.832030 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374f0aa-b591-47c5-bea3-287490cef82d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:25.832514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374f0aa-b591-47c5-bea3-287490cef82d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:25.832976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374f0aa-b591-47c5-bea3-287490cef82d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:25.833897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd7a4a-fdd6-4e0b-aeb4-fa6d0974a359 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:25.847195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374f0aa-b591-47c5-bea3-287490cef82d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:25.849203 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374f0aa-b591-47c5-bea3-287490cef82d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:25.856231 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:25.871836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-0374f0aa-b591-47c5-bea3-287490cef82d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:25.871836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:25.871836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:25.871836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:25.871836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:25.871836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:25.871836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:25.871836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:25.871836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:25.871836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:25.871836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:25.871836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:25.871836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:25.871836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:25.871836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:25.872803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:25.872803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:25.872803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:25.872803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:25.872803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:25.872803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:25.872803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:25.872803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:25.872803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:25.872803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:25.872803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:25.872803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:25.872803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:25.872803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:25.872803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:25.872803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:25.872803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:25.873655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:25.873655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:25.873655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:25.873655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:25.877658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 351/686] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:25.878474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374f0aa-b591-47c5-bea3-287490cef82d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:25.880130 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b856d2-7390-437b-bf35-7f2aa772673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:25.881357 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b856d2-7390-437b-bf35-7f2aa772673a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:25.881876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b856d2-7390-437b-bf35-7f2aa772673a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:25.882411 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b856d2-7390-437b-bf35-7f2aa772673a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:25.893281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b856d2-7390-437b-bf35-7f2aa772673a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:25.895062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b856d2-7390-437b-bf35-7f2aa772673a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:25.914837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-e2b856d2-7390-437b-bf35-7f2aa772673a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 10:12:25.914837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:25.914837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:25.914837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:25.914837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:25.914837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:25.914837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:25.914837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:25.914837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:25.914837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:25.914837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:25.914837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:25.914837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:25.914837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:25.914837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:25.914837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:25.915808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:25.915808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:25.915808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:25.915808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:25.915808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:25.915808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:25.915808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:25.915808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:25.915808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:25.915808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:25.915808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:25.915808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:25.915808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:25.915808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:25.915808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:25.915808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:25.915808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:25.915808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:25.916758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:25.916758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:25.916758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:25.916758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:25.916758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:25.916758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:25.916758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:25.916758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:25.916758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 10:12:25.916758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:25.921130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:25.924433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 336/687] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:12:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:25.925946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b856d2-7390-437b-bf35-7f2aa772673a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:26.007510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374f0aa-b591-47c5-bea3-287490cef82d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:26.046051 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a8e40-572f-4ec9-b243-6ca75f4f10d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:26.046653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a8e40-572f-4ec9-b243-6ca75f4f10d3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:26.046980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a8e40-572f-4ec9-b243-6ca75f4f10d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:26.047257 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a8e40-572f-4ec9-b243-6ca75f4f10d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:26.048626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a8e40-572f-4ec9-b243-6ca75f4f10d3 None admin] RBAC: Adding query filter params (role.id=88ed5b6546c64ac09d03064e12ca7f10, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=2021ac71491f4bebb0fbd91c533dc383) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:26.048954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a8e40-572f-4ec9-b243-6ca75f4f10d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:26.050382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a8e40-572f-4ec9-b243-6ca75f4f10d3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:26.056878 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 352/688] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:12:25 2022] GET /identity/v3/role_assignments?user.id=2021ac71491f4bebb0fbd91c533dc383&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=88ed5b6546c64ac09d03064e12ca7f10 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:26.057775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a8e40-572f-4ec9-b243-6ca75f4f10d3 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:26.078980 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b856d2-7390-437b-bf35-7f2aa772673a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:26.126885 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd8c1f-6ce0-48cd-aafa-69e4865d2135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:26.127816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd8c1f-6ce0-48cd-aafa-69e4865d2135 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:26.128299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd8c1f-6ce0-48cd-aafa-69e4865d2135 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:26.128724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd8c1f-6ce0-48cd-aafa-69e4865d2135 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:26.129828 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd8c1f-6ce0-48cd-aafa-69e4865d2135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:26.130302 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd8c1f-6ce0-48cd-aafa-69e4865d2135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:26.132572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd8c1f-6ce0-48cd-aafa-69e4865d2135 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:26.148912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 337/689] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:26.154508 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd8c1f-6ce0-48cd-aafa-69e4865d2135 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:26.175927 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:26.198588 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a8e40-572f-4ec9-b243-6ca75f4f10d3 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:26.202089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:26.245770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5add9c-004f-4ba0-aed8-75bf0d6650da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:26.247144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5add9c-004f-4ba0-aed8-75bf0d6650da None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:26.247681 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5add9c-004f-4ba0-aed8-75bf0d6650da None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:26.248233 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5add9c-004f-4ba0-aed8-75bf0d6650da None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:26.249917 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5add9c-004f-4ba0-aed8-75bf0d6650da None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:26.250486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5add9c-004f-4ba0-aed8-75bf0d6650da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:26.252582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5add9c-004f-4ba0-aed8-75bf0d6650da None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:26.278438 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 353/690] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Aug 4 10:12:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:26.285817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5add9c-004f-4ba0-aed8-75bf0d6650da None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:26.319826 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd8c1f-6ce0-48cd-aafa-69e4865d2135 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:26.375085 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c0655-e865-4808-af97-4d91698ddb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:26.375891 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c0655-e865-4808-af97-4d91698ddb27 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:26.376882 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c0655-e865-4808-af97-4d91698ddb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:26.377324 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c0655-e865-4808-af97-4d91698ddb27 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:26.384927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c0655-e865-4808-af97-4d91698ddb27 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:26.386368 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c0655-e865-4808-af97-4d91698ddb27 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:26.402269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-632c0655-e865-4808-af97-4d91698ddb27 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 10:12:26.402269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:26.402269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:26.402269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:26.402269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:26.402269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:26.402269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:26.402269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:26.402269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:26.402269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:26.402269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:26.402269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:26.402269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:26.402269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:26.402269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:26.402269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:26.403301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:26.403301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:26.403301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:26.403301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:26.403301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:26.403301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:26.403301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:26.403301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:26.403301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:26.403301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:26.403301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:26.403301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:26.403301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:26.403301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:26.403301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:26.403301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:26.403301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:26.403301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:26.404233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:26.404233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:26.404233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:26.404233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:26.404233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:26.404233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:26.404233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:26.404233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:26.404233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 10:12:26.404233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:26.404233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 338/691] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Aug 4 10:12:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:26.419901 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c0655-e865-4808-af97-4d91698ddb27 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:26.429206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5add9c-004f-4ba0-aed8-75bf0d6650da None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:26.481135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d93732-7cd2-4b27-aa91-99e86c2f385e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:26.481876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d93732-7cd2-4b27-aa91-99e86c2f385e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:26.482172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d93732-7cd2-4b27-aa91-99e86c2f385e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:26.482449 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d93732-7cd2-4b27-aa91-99e86c2f385e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:26.506139 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:26.562461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:26.567175 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c0655-e865-4808-af97-4d91698ddb27 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:26.588134 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d93732-7cd2-4b27-aa91-99e86c2f385e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:26.589629 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d93732-7cd2-4b27-aa91-99e86c2f385e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:26.605203 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313baf2-4b66-4df3-adf2-9fbce5be7b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:26.606165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313baf2-4b66-4df3-adf2-9fbce5be7b34 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:26.606675 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313baf2-4b66-4df3-adf2-9fbce5be7b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:26.607151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313baf2-4b66-4df3-adf2-9fbce5be7b34 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:26.608153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313baf2-4b66-4df3-adf2-9fbce5be7b34 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:26.608702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313baf2-4b66-4df3-adf2-9fbce5be7b34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:26.610557 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313baf2-4b66-4df3-adf2-9fbce5be7b34 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:26.644769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 339/692] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Aug 4 10:12:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:26.651053 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313baf2-4b66-4df3-adf2-9fbce5be7b34 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:26.744342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 354/693] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:12:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:12:26.745800 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7ab97-026f-4d44-98ba-746bba4838ab None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:26.746080 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7ab97-026f-4d44-98ba-746bba4838ab None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:26.746410 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7ab97-026f-4d44-98ba-746bba4838ab None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:26.747961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 355/694] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:26.753592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4eb70-b120-494c-9a4a-61e9b4e1864c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:26.753887 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4eb70-b120-494c-9a4a-61e9b4e1864c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:26.754148 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4eb70-b120-494c-9a4a-61e9b4e1864c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:26.775535 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-19e4eb70-b120-494c-9a4a-61e9b4e1864c None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:26.776765 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-19e4eb70-b120-494c-9a4a-61e9b4e1864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:26.781047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313baf2-4b66-4df3-adf2-9fbce5be7b34 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:26.818431 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:26.829245 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3960f-5097-4fb0-9aff-cb91b9aac306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:26.831159 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3960f-5097-4fb0-9aff-cb91b9aac306 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:26.831665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3960f-5097-4fb0-9aff-cb91b9aac306 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:26.832184 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3960f-5097-4fb0-9aff-cb91b9aac306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:26.852218 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 356/695] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:26.852218 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4eb70-b120-494c-9a4a-61e9b4e1864c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:26.877421 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:26.935904 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3960f-5097-4fb0-9aff-cb91b9aac306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:26.937628 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3960f-5097-4fb0-9aff-cb91b9aac306 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:27.002115 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4eb70-b120-494c-9a4a-61e9b4e1864c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:27.043642 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f8ff6-7b15-4508-b796-605a6fe0b93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:27.044390 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f8ff6-7b15-4508-b796-605a6fe0b93b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:27.044679 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f8ff6-7b15-4508-b796-605a6fe0b93b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:27.044956 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f8ff6-7b15-4508-b796-605a6fe0b93b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:27.055805 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f8ff6-7b15-4508-b796-605a6fe0b93b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:27.057481 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 340/696] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:12:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 10:12:27.057598 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f8ff6-7b15-4508-b796-605a6fe0b93b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:27.058864 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3960f-5097-4fb0-9aff-cb91b9aac306 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:27.079007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-9d5f8ff6-7b15-4508-b796-605a6fe0b93b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:27.079007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:27.079007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:27.079007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:27.079007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:27.079007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:27.079007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:27.079007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:27.079007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:27.079007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:27.079007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:27.079007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:27.079007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:27.079007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:27.079007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:27.080856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:27.080856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:27.080856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:27.080856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:27.080856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:27.080856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:27.080856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:27.080856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:27.080856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:27.080856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:27.080856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:27.080856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:27.080856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:27.080856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:27.080856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:27.080856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:27.080856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:27.081749 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:27.081749 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:27.081749 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:27.081749 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:27.089171 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 357/697] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:27.089465 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f8ff6-7b15-4508-b796-605a6fe0b93b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:27.126931 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:27.141188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:27.201461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3960f-5097-4fb0-9aff-cb91b9aac306 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:27.214208 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f8ff6-7b15-4508-b796-605a6fe0b93b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:27.239657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac2c7a-73c4-43f2-b377-ab7fffbe4e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:27.240399 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac2c7a-73c4-43f2-b377-ab7fffbe4e0e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:27.240684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac2c7a-73c4-43f2-b377-ab7fffbe4e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:27.241011 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac2c7a-73c4-43f2-b377-ab7fffbe4e0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:27.254232 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac2c7a-73c4-43f2-b377-ab7fffbe4e0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:27.255682 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac2c7a-73c4-43f2-b377-ab7fffbe4e0e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:27.260873 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a1dc4-81a7-4cba-8506-d4ef7fadc977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:27.261803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1dc4-81a7-4cba-8506-d4ef7fadc977 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:27.262349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1dc4-81a7-4cba-8506-d4ef7fadc977 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:27.263438 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1dc4-81a7-4cba-8506-d4ef7fadc977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:27.272047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-3dac2c7a-73c4-43f2-b377-ab7fffbe4e0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:27.272047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:27.272047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:27.272047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:27.272047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:27.272047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:27.272047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:27.272047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:27.272047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:27.272047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:27.272047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:27.272047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:27.272047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:27.272047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:27.272047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:27.272956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:27.272956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:27.272956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:27.272956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:27.272956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:27.272956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:27.272956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:27.272956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:27.272956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:27.272956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:27.272956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:27.272956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:27.272956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:27.272956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:27.272956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:27.272956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:27.272956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:27.273805 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:27.273805 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:27.273805 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:27.273805 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:27.273805 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 341/698] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:27.274108 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac2c7a-73c4-43f2-b377-ab7fffbe4e0e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:27.281157 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a1dc4-81a7-4cba-8506-d4ef7fadc977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:27.284644 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a1dc4-81a7-4cba-8506-d4ef7fadc977 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:27.312403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-2e2a1dc4-81a7-4cba-8506-d4ef7fadc977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:27.312403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:27.312403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:27.312403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:27.312403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:27.312403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:27.312403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:27.312403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:27.312403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:27.312403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:27.312403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:27.312403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:27.312403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:27.312403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:27.312403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:27.313343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:27.313343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:27.313343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:27.313343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:27.313343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:27.313343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:27.313343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:27.313343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:27.313343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:27.313343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:27.313343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:27.313343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:27.313343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:27.313343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:27.313343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:27.313343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:27.313343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:27.314930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:27.314930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:27.314930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:27.314930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:27.317773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 358/699] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:27.318983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a1dc4-81a7-4cba-8506-d4ef7fadc977 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:27.391105 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac2c7a-73c4-43f2-b377-ab7fffbe4e0e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:27.402768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:27.410868 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:27.429050 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c3f0e-7ceb-4320-85b7-25f6f4d37c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:27.429810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c3f0e-7ceb-4320-85b7-25f6f4d37c57 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:27.430184 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c3f0e-7ceb-4320-85b7-25f6f4d37c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:27.430554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c3f0e-7ceb-4320-85b7-25f6f4d37c57 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:27.431479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c3f0e-7ceb-4320-85b7-25f6f4d37c57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:27.431789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c3f0e-7ceb-4320-85b7-25f6f4d37c57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:27.433302 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c3f0e-7ceb-4320-85b7-25f6f4d37c57 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:27.438157 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a1dc4-81a7-4cba-8506-d4ef7fadc977 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:27.447431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 342/700] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:27.448504 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c3f0e-7ceb-4320-85b7-25f6f4d37c57 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:27.481625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3db6cd-f81d-452f-a025-90c486fc6dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:27.482488 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3db6cd-f81d-452f-a025-90c486fc6dfe None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:27.482921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3db6cd-f81d-452f-a025-90c486fc6dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:27.483493 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3db6cd-f81d-452f-a025-90c486fc6dfe None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:27.484365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3db6cd-f81d-452f-a025-90c486fc6dfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:27.484840 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3db6cd-f81d-452f-a025-90c486fc6dfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:27.486797 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3db6cd-f81d-452f-a025-90c486fc6dfe None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:27.499771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 359/701] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:27.500645 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3db6cd-f81d-452f-a025-90c486fc6dfe None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:27.560855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c3f0e-7ceb-4320-85b7-25f6f4d37c57 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:27.597766 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8fba1-47ad-4c5c-af5d-2d82d3a61c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:27.598437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8fba1-47ad-4c5c-af5d-2d82d3a61c76 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:27.598666 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8fba1-47ad-4c5c-af5d-2d82d3a61c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:27.598945 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8fba1-47ad-4c5c-af5d-2d82d3a61c76 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:27.599646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8fba1-47ad-4c5c-af5d-2d82d3a61c76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:27.599953 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8fba1-47ad-4c5c-af5d-2d82d3a61c76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:27.601371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8fba1-47ad-4c5c-af5d-2d82d3a61c76 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:27.614103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 343/702] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:27.615116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6825930-7962-44e7-89e5-750826759bbe None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:27.615406 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6825930-7962-44e7-89e5-750826759bbe None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:27.615685 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6825930-7962-44e7-89e5-750826759bbe None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:27.617082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 344/703] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:27.621951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6825930-7962-44e7-89e5-750826759bbe None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:27.631660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3db6cd-f81d-452f-a025-90c486fc6dfe None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:27.656339 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:27.667101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193a271-0647-480d-b4f3-3b53ac8c6a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:27.667757 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193a271-0647-480d-b4f3-3b53ac8c6a8b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:27.668045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193a271-0647-480d-b4f3-3b53ac8c6a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:27.668353 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193a271-0647-480d-b4f3-3b53ac8c6a8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:27.679612 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193a271-0647-480d-b4f3-3b53ac8c6a8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:27.681126 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193a271-0647-480d-b4f3-3b53ac8c6a8b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:27.683512 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:27.695841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-b193a271-0647-480d-b4f3-3b53ac8c6a8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:27.695841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:27.695841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:27.695841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:27.695841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:27.695841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:27.695841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:27.695841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:27.695841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:27.695841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:27.695841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:27.695841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:27.695841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:27.695841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:27.695841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:27.697140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:27.697140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:27.697140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:27.697140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:27.697140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:27.697140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:27.697140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:27.697140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:27.697140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:27.697140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:27.697140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:27.697140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:27.697140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:27.697140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:27.697140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:27.697140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:27.697140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:27.698349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:27.698349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:27.698349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:27.698349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:27.698349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:27.698349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:27.698349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:27.698349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:27.707174 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 360/704] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:27.707174 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193a271-0647-480d-b4f3-3b53ac8c6a8b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:27.752440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6825930-7962-44e7-89e5-750826759bbe None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:27.789095 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f1135-42c3-43c1-92ba-8ee2600ebb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:27.789716 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f1135-42c3-43c1-92ba-8ee2600ebb3d None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:27.790002 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f1135-42c3-43c1-92ba-8ee2600ebb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:27.790279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f1135-42c3-43c1-92ba-8ee2600ebb3d None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:27.790950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f1135-42c3-43c1-92ba-8ee2600ebb3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:27.792428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f1135-42c3-43c1-92ba-8ee2600ebb3d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:27.807447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193a271-0647-480d-b4f3-3b53ac8c6a8b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:27.813605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 345/705] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Aug 4 10:12:27 2022] POST /identity/v3/users => generated 254 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:12:27.815461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d496710-1151-4858-a771-d1c41755d5dc None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:27.815753 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d496710-1151-4858-a771-d1c41755d5dc None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:27.816036 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d496710-1151-4858-a771-d1c41755d5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:27.835922 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-6d496710-1151-4858-a771-d1c41755d5dc None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:27.837245 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6d496710-1151-4858-a771-d1c41755d5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:27.861516 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7cb34-f48a-4d8f-981f-ba6d7c45fd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:27.863016 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7cb34-f48a-4d8f-981f-ba6d7c45fd4b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:27.863369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7cb34-f48a-4d8f-981f-ba6d7c45fd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:27.863719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7cb34-f48a-4d8f-981f-ba6d7c45fd4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:27.872885 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7cb34-f48a-4d8f-981f-ba6d7c45fd4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:27.874748 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7cb34-f48a-4d8f-981f-ba6d7c45fd4b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:27.892328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-cec7cb34-f48a-4d8f-981f-ba6d7c45fd4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:27.892328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:27.892328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:27.892328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:27.892328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:27.892328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:27.892328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:27.892328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:27.892328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:27.892328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:27.892328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:27.892328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:27.892328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:27.892328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:27.892328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:27.893827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:27.893827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:27.893827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:27.893827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:27.893827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:27.893827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:27.893827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:27.893827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:27.893827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:27.893827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:27.893827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:27.893827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:27.893827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:27.893827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:27.893827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:27.893827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:27.893827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:27.895436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:27.895436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:27.895436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:27.895436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:27.895436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:27.895436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:27.895436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:27.895436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:27.895436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 361/706] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:27.895436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7cb34-f48a-4d8f-981f-ba6d7c45fd4b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:27.940620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 346/707] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:27.941598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d496710-1151-4858-a771-d1c41755d5dc None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:27.975423 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:27.981382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:28.036432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7cb34-f48a-4d8f-981f-ba6d7c45fd4b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:28.089586 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008391a9-701a-49a9-bf07-25fbca111a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:28.090413 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008391a9-701a-49a9-bf07-25fbca111a94 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:28.090797 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008391a9-701a-49a9-bf07-25fbca111a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:28.091176 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008391a9-701a-49a9-bf07-25fbca111a94 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:28.092043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008391a9-701a-49a9-bf07-25fbca111a94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:28.092483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008391a9-701a-49a9-bf07-25fbca111a94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:28.095698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008391a9-701a-49a9-bf07-25fbca111a94 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:28.107274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d496710-1151-4858-a771-d1c41755d5dc None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:28.117429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 362/708] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:28.118823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008391a9-701a-49a9-bf07-25fbca111a94 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:28.153231 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5f9ea-425e-4ca0-9a40-d7b9f9117781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:28.154166 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5f9ea-425e-4ca0-9a40-d7b9f9117781 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:28.154780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5f9ea-425e-4ca0-9a40-d7b9f9117781 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:28.155065 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5f9ea-425e-4ca0-9a40-d7b9f9117781 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:28.156111 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5f9ea-425e-4ca0-9a40-d7b9f9117781 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:28.156451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5f9ea-425e-4ca0-9a40-d7b9f9117781 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:28.159334 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5f9ea-425e-4ca0-9a40-d7b9f9117781 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:28.175363 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 347/709] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:28.180304 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5f9ea-425e-4ca0-9a40-d7b9f9117781 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:28.250599 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008391a9-701a-49a9-bf07-25fbca111a94 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:28.265837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:28.274319 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:28.293544 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5f9ea-425e-4ca0-9a40-d7b9f9117781 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:28.295479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0d763-8d7a-4b9b-a7ef-bb3b7b4e9f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:28.296379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0d763-8d7a-4b9b-a7ef-bb3b7b4e9f64 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:28.296669 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0d763-8d7a-4b9b-a7ef-bb3b7b4e9f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:28.296946 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0d763-8d7a-4b9b-a7ef-bb3b7b4e9f64 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:28.297586 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0d763-8d7a-4b9b-a7ef-bb3b7b4e9f64 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:28.299448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0d763-8d7a-4b9b-a7ef-bb3b7b4e9f64 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:28.311933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-57e0d763-8d7a-4b9b-a7ef-bb3b7b4e9f64 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 10:12:28.311933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:28.311933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:12:28.311933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:12:28.311933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:12:28.311933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:12:28.311933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:12:28.311933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:28.311933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 10:12:28.311933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:28.311933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:28.311933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:28.311933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:28.311933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:28.311933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:28.311933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:28.314584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:28.314584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:28.314584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:28.314584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:28.314584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:28.314584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:28.314584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:28.314584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:12:28.314584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:12:28.314584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:12:28.314584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:12:28.314584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:28.314584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:28.314584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:28.314584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:28.314584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:28.316712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:28.316712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:28.316712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:28.316712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:28.316712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:28.316712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:28.316712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:28.316712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:28.316712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:28.316712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:28.316712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:28.316712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:12:28.316712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:28.316712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 10:12:28.316712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:28.316712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 363/710] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Aug 4 10:12:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:28.328225 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0d763-8d7a-4b9b-a7ef-bb3b7b4e9f64 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:28.333486 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ef34a-0b7f-43cb-88d4-6ee571f64f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:28.334117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ef34a-0b7f-43cb-88d4-6ee571f64f17 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:28.334404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ef34a-0b7f-43cb-88d4-6ee571f64f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:28.334683 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ef34a-0b7f-43cb-88d4-6ee571f64f17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:28.335479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ef34a-0b7f-43cb-88d4-6ee571f64f17 None admin] RBAC: Adding query filter params (role.id=88ed5b6546c64ac09d03064e12ca7f10, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=878797620be54b74a3e8582c78ba78d2) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:28.335794 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ef34a-0b7f-43cb-88d4-6ee571f64f17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:28.337315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ef34a-0b7f-43cb-88d4-6ee571f64f17 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:28.343667 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 348/711] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:12:28 2022] GET /identity/v3/role_assignments?user.id=878797620be54b74a3e8582c78ba78d2&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=88ed5b6546c64ac09d03064e12ca7f10 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:28.344521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ef34a-0b7f-43cb-88d4-6ee571f64f17 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:28.435802 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0d763-8d7a-4b9b-a7ef-bb3b7b4e9f64 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:28.477388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d0f8d-c212-4441-91c6-99e16b2d4c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:28.478166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d0f8d-c212-4441-91c6-99e16b2d4c56 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:28.478456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d0f8d-c212-4441-91c6-99e16b2d4c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:28.478722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d0f8d-c212-4441-91c6-99e16b2d4c56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:28.479541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d0f8d-c212-4441-91c6-99e16b2d4c56 None admin] RBAC: Adding query filter params (role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=592539924feb44ad8ea520d8539b6608) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:28.479860 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d0f8d-c212-4441-91c6-99e16b2d4c56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:28.481446 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d0f8d-c212-4441-91c6-99e16b2d4c56 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:28.488967 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 364/712] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:12:28 2022] GET /identity/v3/role_assignments?user.id=592539924feb44ad8ea520d8539b6608&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:28.505491 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ef34a-0b7f-43cb-88d4-6ee571f64f17 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:28.531732 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723959f-d655-411d-997a-d7357a43a1fa None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:28.532059 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723959f-d655-411d-997a-d7357a43a1fa None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:28.532354 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723959f-d655-411d-997a-d7357a43a1fa None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:28.538083 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 365/713] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:28.544329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cd34f-3e1f-4b01-9b19-5289c78397fa None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:28.544585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cd34f-3e1f-4b01-9b19-5289c78397fa None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:28.544826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cd34f-3e1f-4b01-9b19-5289c78397fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:28.569304 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f64cd34f-3e1f-4b01-9b19-5289c78397fa None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:28.570548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f64cd34f-3e1f-4b01-9b19-5289c78397fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:28.571403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0a089-31c8-4b44-9f3b-78c52f4343f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:28.572059 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0a089-31c8-4b44-9f3b-78c52f4343f1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:28.572372 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0a089-31c8-4b44-9f3b-78c52f4343f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:28.572650 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0a089-31c8-4b44-9f3b-78c52f4343f1 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:28.573348 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0a089-31c8-4b44-9f3b-78c52f4343f1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:28.573657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0a089-31c8-4b44-9f3b-78c52f4343f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:28.575048 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0a089-31c8-4b44-9f3b-78c52f4343f1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:28.582446 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 349/714] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Aug 4 10:12:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:28.587971 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0a089-31c8-4b44-9f3b-78c52f4343f1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:28.600214 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:28.632195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:28.674539 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 366/715] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:28.701689 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cd34f-3e1f-4b01-9b19-5289c78397fa None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:28.741733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0a089-31c8-4b44-9f3b-78c52f4343f1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:28.779674 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb4cfa-0b1a-4b0b-b0ee-94f403d1e833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:28.780508 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb4cfa-0b1a-4b0b-b0ee-94f403d1e833 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:28.780909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb4cfa-0b1a-4b0b-b0ee-94f403d1e833 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:28.781268 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb4cfa-0b1a-4b0b-b0ee-94f403d1e833 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:28.781935 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb4cfa-0b1a-4b0b-b0ee-94f403d1e833 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:28.782241 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb4cfa-0b1a-4b0b-b0ee-94f403d1e833 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:28.784607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb4cfa-0b1a-4b0b-b0ee-94f403d1e833 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:28.793732 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 350/716] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Aug 4 10:12:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:28.854278 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cd34f-3e1f-4b01-9b19-5289c78397fa None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:28.904486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa13f4-f6df-45f5-8f60-3c3bda323ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:28.905177 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa13f4-f6df-45f5-8f60-3c3bda323ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:28.905460 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa13f4-f6df-45f5-8f60-3c3bda323ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:28.905738 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa13f4-f6df-45f5-8f60-3c3bda323ef3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:28.906386 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa13f4-f6df-45f5-8f60-3c3bda323ef3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:28.908674 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa13f4-f6df-45f5-8f60-3c3bda323ef3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:28.922365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-8faa13f4-f6df-45f5-8f60-3c3bda323ef3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 10:12:28.922365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:28.922365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:12:28.922365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:12:28.922365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:12:28.922365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:12:28.922365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:12:28.922365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:28.922365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 10:12:28.922365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:28.922365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:28.922365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:28.922365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:28.922365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:28.922365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:28.922365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:28.922365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:28.924047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:28.924047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:28.924047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:28.924047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:28.924047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:28.924047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:28.924047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:12:28.924047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:12:28.924047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:12:28.924047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:12:28.924047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:28.924047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:28.924047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:28.924047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:28.924047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:28.924047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:28.924915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:28.924915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:28.924915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:28.924915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:28.924915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:28.924915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:28.924915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:28.924915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:28.924915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:28.924915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:28.924915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:12:28.924915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:28.924915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 10:12:28.924915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:28.924915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 367/717] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:28 2022] GET /identity/v3/services/network => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:28.932125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb4cfa-0b1a-4b0b-b0ee-94f403d1e833 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:29.024146 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:29.074371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb4cfa-0b1a-4b0b-b0ee-94f403d1e833 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:29.118612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd80a53-3801-4469-9f92-5ea2572090a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:29.119602 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd80a53-3801-4469-9f92-5ea2572090a4 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:29.120150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd80a53-3801-4469-9f92-5ea2572090a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:29.120647 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd80a53-3801-4469-9f92-5ea2572090a4 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:29.121543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd80a53-3801-4469-9f92-5ea2572090a4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:29.122075 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd80a53-3801-4469-9f92-5ea2572090a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:29.123648 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd80a53-3801-4469-9f92-5ea2572090a4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:29.132888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 351/718] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Aug 4 10:12:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:29.138982 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa13f4-f6df-45f5-8f60-3c3bda323ef3 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:29.200512 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:29.284548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa13f4-f6df-45f5-8f60-3c3bda323ef3 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:29.332375 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98f0b7-08f3-4d8f-854d-95e3b87a686e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:29.333017 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98f0b7-08f3-4d8f-854d-95e3b87a686e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:29.333303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98f0b7-08f3-4d8f-854d-95e3b87a686e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:29.333584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98f0b7-08f3-4d8f-854d-95e3b87a686e None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:29.334277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98f0b7-08f3-4d8f-854d-95e3b87a686e None admin] RBAC: Adding query filter params (type=network) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:29.334589 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98f0b7-08f3-4d8f-854d-95e3b87a686e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:29.335968 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98f0b7-08f3-4d8f-854d-95e3b87a686e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:29.342334 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 368/719] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Aug 4 10:12:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:30.589835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78050de3-41fd-495a-8d29-3f6764a068ac None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:30.590619 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78050de3-41fd-495a-8d29-3f6764a068ac None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:30.590619 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78050de3-41fd-495a-8d29-3f6764a068ac None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:30.591993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 352/720] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:30.597433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a584c-2d57-4cfc-b535-68004c82aa1b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:30.598091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a584c-2d57-4cfc-b535-68004c82aa1b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:30.598091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a584c-2d57-4cfc-b535-68004c82aa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:30.617242 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-099a584c-2d57-4cfc-b535-68004c82aa1b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:30.618448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-099a584c-2d57-4cfc-b535-68004c82aa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:30.721491 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 369/721] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:30.755627 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78050de3-41fd-495a-8d29-3f6764a068ac None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:30.791197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae39fc-ffc4-4074-bfed-94602a3fd5f3 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:30.791603 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae39fc-ffc4-4074-bfed-94602a3fd5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:30.791794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae39fc-ffc4-4074-bfed-94602a3fd5f3 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:30.794122 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 370/722] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:30.802127 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d737f-2391-4305-b2c3-b5e144af2f61 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:30.802410 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d737f-2391-4305-b2c3-b5e144af2f61 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:30.802683 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d737f-2391-4305-b2c3-b5e144af2f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:30.831161 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-923d737f-2391-4305-b2c3-b5e144af2f61 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:30.832394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-923d737f-2391-4305-b2c3-b5e144af2f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:30.883624 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:30.928937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78050de3-41fd-495a-8d29-3f6764a068ac None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:30.944481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 371/723] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 10:12:30.966896 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d737f-2391-4305-b2c3-b5e144af2f61 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:31.009526 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:31.030157 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c86cd6-f2b8-48df-9055-a99bf65fb063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:31.030824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c86cd6-f2b8-48df-9055-a99bf65fb063 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:31.031109 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c86cd6-f2b8-48df-9055-a99bf65fb063 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:31.031390 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c86cd6-f2b8-48df-9055-a99bf65fb063 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:31.057851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c86cd6-f2b8-48df-9055-a99bf65fb063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:31.072283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-29c86cd6-f2b8-48df-9055-a99bf65fb063 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:31.072283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:31.072283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:31.072283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:31.072283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:31.072283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:31.072283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:31.072283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:31.072283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:31.072283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:31.072283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:31.072283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:31.072283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:31.072283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:31.072283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:31.072283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:31.074480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:31.074480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:31.074480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:31.074480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:31.074480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:31.074480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:31.074480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:31.074480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:31.074480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:31.074480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:31.074480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:31.074480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:31.074480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:31.074480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:31.074480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:31.074480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:31.076437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:31.076437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:31.076437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:31.076437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:31.076437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:31.076437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:31.076437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:31.076437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:31.076437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:31.076437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:31.076437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:31.076437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:31.076437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 353/724] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:31.081472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c86cd6-f2b8-48df-9055-a99bf65fb063 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:31.128799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d737f-2391-4305-b2c3-b5e144af2f61 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:31.199506 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e97d5f-590a-4429-8fa1-0da297e0d727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:31.201803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e97d5f-590a-4429-8fa1-0da297e0d727 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:31.202296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e97d5f-590a-4429-8fa1-0da297e0d727 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:31.202791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e97d5f-590a-4429-8fa1-0da297e0d727 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:31.226989 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e97d5f-590a-4429-8fa1-0da297e0d727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:31.232025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-77e97d5f-590a-4429-8fa1-0da297e0d727 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:12:31.232025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:31.232025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:31.232025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:31.232025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:31.232025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:31.232025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:31.232025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:31.232025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:31.232025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:31.232025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:31.232025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:31.232025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:31.232025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:31.232025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:31.232025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:31.233075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:31.233075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:31.233075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:31.233075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:31.233075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:31.233075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:31.233075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:31.233075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:31.233075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:31.233075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:31.233075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:31.233075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:31.233075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:31.233075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:31.233075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:31.233075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:31.237530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:31.237530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:31.237530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:31.237530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:31.237530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:31.237530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:31.237530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:31.237530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:31.237530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:31.237530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:31.237530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:12:31.237530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:31.237530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 372/725] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:12:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:31.237530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c241f-a378-44b7-9bee-3486abdd275a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:31.238271 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c241f-a378-44b7-9bee-3486abdd275a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:31.238271 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c241f-a378-44b7-9bee-3486abdd275a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:31.238271 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 373/726] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:31.245206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c241f-a378-44b7-9bee-3486abdd275a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:31.269979 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c86cd6-f2b8-48df-9055-a99bf65fb063 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:31.275731 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:31.308095 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5116dcc-230e-46b5-a3d8-7399672dfb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:31.308786 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5116dcc-230e-46b5-a3d8-7399672dfb24 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:31.309071 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5116dcc-230e-46b5-a3d8-7399672dfb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:31.309369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5116dcc-230e-46b5-a3d8-7399672dfb24 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:31.310097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5116dcc-230e-46b5-a3d8-7399672dfb24 None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:31.310404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5116dcc-230e-46b5-a3d8-7399672dfb24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:31.312039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5116dcc-230e-46b5-a3d8-7399672dfb24 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:31.321095 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 354/727] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:12:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:31.322364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148d5f4-1b01-4ea0-af02-ed172b402c20 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:31.322656 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148d5f4-1b01-4ea0-af02-ed172b402c20 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:31.322939 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148d5f4-1b01-4ea0-af02-ed172b402c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:31.341657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-f148d5f4-1b01-4ea0-af02-ed172b402c20 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:31.342928 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f148d5f4-1b01-4ea0-af02-ed172b402c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:31.370650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c241f-a378-44b7-9bee-3486abdd275a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:31.396290 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:31.415135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d65a5-11fb-45f2-a3d0-3d96a76d9fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:31.424198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 355/728] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:31.424198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148d5f4-1b01-4ea0-af02-ed172b402c20 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:31.425097 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d65a5-11fb-45f2-a3d0-3d96a76d9fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:31.425699 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d65a5-11fb-45f2-a3d0-3d96a76d9fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:31.426175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d65a5-11fb-45f2-a3d0-3d96a76d9fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:31.427112 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d65a5-11fb-45f2-a3d0-3d96a76d9fd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:31.427798 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d65a5-11fb-45f2-a3d0-3d96a76d9fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:31.429585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d65a5-11fb-45f2-a3d0-3d96a76d9fd2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:31.445000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 374/729] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:12:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:31.451039 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d65a5-11fb-45f2-a3d0-3d96a76d9fd2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:31.528272 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148d5f4-1b01-4ea0-af02-ed172b402c20 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:31.565199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:31.568135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a29c12-3db4-45f1-b75d-88649387d81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:31.568823 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a29c12-3db4-45f1-b75d-88649387d81d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:31.569107 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a29c12-3db4-45f1-b75d-88649387d81d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:31.569384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a29c12-3db4-45f1-b75d-88649387d81d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:31.580649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a29c12-3db4-45f1-b75d-88649387d81d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:31.581909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a29c12-3db4-45f1-b75d-88649387d81d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:31.585582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d65a5-11fb-45f2-a3d0-3d96a76d9fd2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:31.597723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-f2a29c12-3db4-45f1-b75d-88649387d81d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:31.597723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:31.597723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:31.597723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:31.597723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:31.597723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:31.597723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:31.597723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:31.597723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:31.597723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:31.597723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:31.597723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:31.597723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:31.597723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:31.597723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:31.598942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:31.598942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:31.598942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:31.598942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:31.598942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:31.598942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:31.598942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:31.598942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:31.598942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:31.598942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:31.598942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:31.598942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:31.598942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:31.598942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:31.598942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:31.598942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:31.598942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:31.600702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:31.600702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:31.600702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:31.600702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:31.600702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 356/730] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:31.600702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a29c12-3db4-45f1-b75d-88649387d81d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:31.630328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0229fe3-ea0e-40b8-925b-fcf5b94f6312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:31.631069 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0229fe3-ea0e-40b8-925b-fcf5b94f6312 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:31.631358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0229fe3-ea0e-40b8-925b-fcf5b94f6312 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:31.631706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0229fe3-ea0e-40b8-925b-fcf5b94f6312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:31.640377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:31.644851 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0229fe3-ea0e-40b8-925b-fcf5b94f6312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:31.646327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0229fe3-ea0e-40b8-925b-fcf5b94f6312 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:31.662239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-b0229fe3-ea0e-40b8-925b-fcf5b94f6312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:31.662239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:31.662239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:31.662239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:31.662239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:31.662239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:31.662239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:31.662239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:31.662239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:31.662239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:31.662239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:31.662239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:31.662239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:31.662239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:31.662239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:31.663166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:31.663166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:31.663166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:31.663166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:31.663166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:31.663166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:31.663166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:31.663166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:31.663166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:31.663166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:31.663166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:31.663166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:31.663166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:31.663166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:31.663166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:31.663166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:31.663166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:31.664033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:31.664033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:31.664033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:31.664033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:31.664033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 375/731] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:31.664955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d422166-05a2-44b1-a5b7-975cef48124b None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:31.665180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d422166-05a2-44b1-a5b7-975cef48124b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:31.665459 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d422166-05a2-44b1-a5b7-975cef48124b None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:31.666846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 376/732] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:31.667363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d422166-05a2-44b1-a5b7-975cef48124b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:31.720358 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a29c12-3db4-45f1-b75d-88649387d81d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:31.757715 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71a23f-332a-477d-b386-6b1ca8e9c8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:31.758185 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71a23f-332a-477d-b386-6b1ca8e9c8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:31.758472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71a23f-332a-477d-b386-6b1ca8e9c8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:31.758753 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71a23f-332a-477d-b386-6b1ca8e9c8f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:31.771035 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71a23f-332a-477d-b386-6b1ca8e9c8f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:31.776513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-9c71a23f-332a-477d-b386-6b1ca8e9c8f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:12:31.776513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:31.776513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:31.776513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:31.776513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:31.776513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:31.776513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:31.776513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:31.776513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:31.776513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:31.776513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:31.776513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:31.776513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:31.776513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:31.776513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:31.776513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:31.777587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:31.777587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:31.777587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:31.777587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:31.777587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:31.777587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:31.777587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:31.777587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:31.777587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:31.777587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:31.777587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:31.777587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:31.777587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:31.777587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:31.777587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:31.777587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:31.778456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:31.778456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:31.778456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:31.778456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:31.778456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:31.778456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:31.778456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:31.778456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:31.778456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:31.778456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:31.778456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:12:31.778456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:31.778456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 357/733] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:12:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:31.778456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71a23f-332a-477d-b386-6b1ca8e9c8f3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:31.790654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d422166-05a2-44b1-a5b7-975cef48124b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:31.828958 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ca4c7-1a50-4e68-9756-1b9fe089d821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:31.830646 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ca4c7-1a50-4e68-9756-1b9fe089d821 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:31.830929 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ca4c7-1a50-4e68-9756-1b9fe089d821 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:31.831214 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ca4c7-1a50-4e68-9756-1b9fe089d821 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:31.831906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ca4c7-1a50-4e68-9756-1b9fe089d821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:31.832249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ca4c7-1a50-4e68-9756-1b9fe089d821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:31.833633 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ca4c7-1a50-4e68-9756-1b9fe089d821 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:31.840420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:31.846954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 377/734] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:31.852357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ba9e4-5eb5-4562-a287-6946d50cdc06 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:31.852651 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ba9e4-5eb5-4562-a287-6946d50cdc06 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:31.852931 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ba9e4-5eb5-4562-a287-6946d50cdc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:31.871313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-663ba9e4-5eb5-4562-a287-6946d50cdc06 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:31.872579 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-663ba9e4-5eb5-4562-a287-6946d50cdc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:31.951221 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 378/735] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:31.952099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ba9e4-5eb5-4562-a287-6946d50cdc06 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:32.004575 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:32.010943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71a23f-332a-477d-b386-6b1ca8e9c8f3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:32.045900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ecafd-bebd-4ae8-b5bb-0892cccda6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:32.046524 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ecafd-bebd-4ae8-b5bb-0892cccda6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:32.046809 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ecafd-bebd-4ae8-b5bb-0892cccda6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:32.047084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ecafd-bebd-4ae8-b5bb-0892cccda6b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:32.047778 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ecafd-bebd-4ae8-b5bb-0892cccda6b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:32.048763 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ecafd-bebd-4ae8-b5bb-0892cccda6b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:32.050240 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ecafd-bebd-4ae8-b5bb-0892cccda6b5 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:32.061861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 358/736] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:32.062667 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ecafd-bebd-4ae8-b5bb-0892cccda6b5 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:32.067843 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ba9e4-5eb5-4562-a287-6946d50cdc06 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:32.095853 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:32.104897 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4803d-0533-4f9d-ad58-9962763cba9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:32.105521 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4803d-0533-4f9d-ad58-9962763cba9d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:32.105803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4803d-0533-4f9d-ad58-9962763cba9d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:32.106078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4803d-0533-4f9d-ad58-9962763cba9d None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:32.107543 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4803d-0533-4f9d-ad58-9962763cba9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:32.107972 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4803d-0533-4f9d-ad58-9962763cba9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:32.110405 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4803d-0533-4f9d-ad58-9962763cba9d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:32.124009 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 379/737] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:12:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:32.126232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b738118-7da3-445d-8aa6-79bf73729a9d None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:32.126723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b738118-7da3-445d-8aa6-79bf73729a9d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:32.127177 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b738118-7da3-445d-8aa6-79bf73729a9d None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:32.132519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 380/738] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:32.132519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b738118-7da3-445d-8aa6-79bf73729a9d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:32.167246 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ecafd-bebd-4ae8-b5bb-0892cccda6b5 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:32.202410 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af21e43-78ea-4d7a-bafb-3e4eb93ca524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:32.203052 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af21e43-78ea-4d7a-bafb-3e4eb93ca524 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:32.203336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af21e43-78ea-4d7a-bafb-3e4eb93ca524 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:32.203606 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af21e43-78ea-4d7a-bafb-3e4eb93ca524 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:32.211436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af21e43-78ea-4d7a-bafb-3e4eb93ca524 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:32.212907 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af21e43-78ea-4d7a-bafb-3e4eb93ca524 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:32.224705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-6af21e43-78ea-4d7a-bafb-3e4eb93ca524 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 10:12:32.224705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:32.224705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:32.224705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:32.224705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:32.224705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:32.224705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:32.224705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:32.224705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:32.224705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:32.224705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:32.224705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:32.224705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:32.224705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:32.224705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:32.224705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:32.225789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:32.225789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:32.225789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:32.225789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:32.225789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:32.225789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:32.225789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:32.225789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:32.225789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:32.225789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:32.225789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:32.225789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:32.225789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:32.225789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:32.225789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:32.225789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:32.225789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:32.225789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:32.226718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:32.226718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:32.226718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:32.226718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:32.226718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:32.226718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:32.226718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:32.226718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:32.226718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 10:12:32.226718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:32.226718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 359/739] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Aug 4 10:12:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:32.227298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af21e43-78ea-4d7a-bafb-3e4eb93ca524 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:32.244112 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b738118-7da3-445d-8aa6-79bf73729a9d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:32.245337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:32.279528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18df9d-a147-411b-84c7-e12e8180a520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:32.280079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18df9d-a147-411b-84c7-e12e8180a520 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:32.280390 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18df9d-a147-411b-84c7-e12e8180a520 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:32.280667 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18df9d-a147-411b-84c7-e12e8180a520 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:32.281350 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18df9d-a147-411b-84c7-e12e8180a520 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:32.283362 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18df9d-a147-411b-84c7-e12e8180a520 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:32.299892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 381/740] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Aug 4 10:12:32 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:12:32.300867 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18df9d-a147-411b-84c7-e12e8180a520 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:32.344638 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af21e43-78ea-4d7a-bafb-3e4eb93ca524 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:32.371707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:32.400919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a08116-3af1-4b7f-bab9-51c150c0dc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:32.401169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a08116-3af1-4b7f-bab9-51c150c0dc87 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:32.401330 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a08116-3af1-4b7f-bab9-51c150c0dc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:32.401605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a08116-3af1-4b7f-bab9-51c150c0dc87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:32.410915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a08116-3af1-4b7f-bab9-51c150c0dc87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:32.412464 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a08116-3af1-4b7f-bab9-51c150c0dc87 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:32.426632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-56a08116-3af1-4b7f-bab9-51c150c0dc87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 10:12:32.426632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:32.426632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:32.426632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:32.426632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:32.426632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:32.426632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:32.426632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:32.426632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:32.426632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:32.426632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:32.426632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:32.426632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:32.426632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:32.426632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:32.426632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:32.427678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:32.427678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:32.427678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:32.427678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:32.427678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:32.427678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:32.427678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:32.427678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:32.427678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:32.427678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:32.427678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:32.427678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:32.427678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:32.427678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:32.427678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:32.427678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:32.427678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:32.427678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:32.428925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:32.428925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:32.428925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:32.428925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:32.428925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:32.428925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:32.428925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:32.428925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:32.428925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 10:12:32.428925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:32.428925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 360/741] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Aug 4 10:12:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:32.429688 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c4e21-589d-4bfe-909e-bcb93c8f0210 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:32.430058 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c4e21-589d-4bfe-909e-bcb93c8f0210 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:32.430158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c4e21-589d-4bfe-909e-bcb93c8f0210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:32.446299 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18df9d-a147-411b-84c7-e12e8180a520 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:32.450833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a80c4e21-589d-4bfe-909e-bcb93c8f0210 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:32.452048 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a80c4e21-589d-4bfe-909e-bcb93c8f0210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:32.498565 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6260a-8e04-4f2b-93a7-4110dec7b058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:32.499486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6260a-8e04-4f2b-93a7-4110dec7b058 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:32.499915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6260a-8e04-4f2b-93a7-4110dec7b058 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:32.500424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6260a-8e04-4f2b-93a7-4110dec7b058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:32.513212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6260a-8e04-4f2b-93a7-4110dec7b058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:32.514700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6260a-8e04-4f2b-93a7-4110dec7b058 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:32.530077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-ccb6260a-8e04-4f2b-93a7-4110dec7b058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:32.530077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:32.530077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:32.530077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:32.530077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:32.530077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:32.530077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:32.530077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:32.530077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:32.530077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:32.530077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:32.530077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:32.530077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:32.530077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:32.530077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:32.530952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:32.530952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:32.530952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:32.530952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:32.530952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:32.530952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:32.530952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:32.530952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:32.530952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:32.530952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:32.530952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:32.530952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:32.530952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:32.530952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:32.530952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:32.530952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:32.530952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:32.531823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:32.531823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:32.531823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:32.531823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:32.531823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 382/742] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:32.532857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6260a-8e04-4f2b-93a7-4110dec7b058 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:32.540521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 361/743] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 10:12:32.541602 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c4e21-589d-4bfe-909e-bcb93c8f0210 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:32.544540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:32.649298 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6260a-8e04-4f2b-93a7-4110dec7b058 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:32.651267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:32.658646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c4e21-589d-4bfe-909e-bcb93c8f0210 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:32.695484 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7cd9b-e0f0-410f-8c58-ced683948dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:32.696114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7cd9b-e0f0-410f-8c58-ced683948dfb None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:32.696537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7cd9b-e0f0-410f-8c58-ced683948dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:32.696818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7cd9b-e0f0-410f-8c58-ced683948dfb None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:32.697748 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7cd9b-e0f0-410f-8c58-ced683948dfb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:32.698064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7cd9b-e0f0-410f-8c58-ced683948dfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:32.699507 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7cd9b-e0f0-410f-8c58-ced683948dfb None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:32.703064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce914b7-ab8f-4b0c-913b-e3e096df8c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:32.703691 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce914b7-ab8f-4b0c-913b-e3e096df8c68 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:32.703974 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce914b7-ab8f-4b0c-913b-e3e096df8c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:32.704857 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce914b7-ab8f-4b0c-913b-e3e096df8c68 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:32.705875 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce914b7-ab8f-4b0c-913b-e3e096df8c68 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:32.706188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce914b7-ab8f-4b0c-913b-e3e096df8c68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:32.707605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce914b7-ab8f-4b0c-913b-e3e096df8c68 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:32.722825 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 383/744] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Aug 4 10:12:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:32.722825 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7cd9b-e0f0-410f-8c58-ced683948dfb None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:32.729112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 362/745] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Aug 4 10:12:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:32.729112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce914b7-ab8f-4b0c-913b-e3e096df8c68 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:32.800571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:32.838850 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7cd9b-e0f0-410f-8c58-ced683948dfb None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:32.841924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce914b7-ab8f-4b0c-913b-e3e096df8c68 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:32.875787 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb264e9c-c1f0-442b-835c-dcf378cc8bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:32.876018 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d42bea-5ffe-4848-95aa-0a833d68be21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:32.877160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d42bea-5ffe-4848-95aa-0a833d68be21 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:32.877427 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb264e9c-c1f0-442b-835c-dcf378cc8bc6 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:32.877427 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb264e9c-c1f0-442b-835c-dcf378cc8bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:32.877582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d42bea-5ffe-4848-95aa-0a833d68be21 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:32.877759 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d42bea-5ffe-4848-95aa-0a833d68be21 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:32.877939 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb264e9c-c1f0-442b-835c-dcf378cc8bc6 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:32.878398 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d42bea-5ffe-4848-95aa-0a833d68be21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:32.878495 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb264e9c-c1f0-442b-835c-dcf378cc8bc6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:32.878704 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d42bea-5ffe-4848-95aa-0a833d68be21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:32.879858 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb264e9c-c1f0-442b-835c-dcf378cc8bc6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:32.880072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d42bea-5ffe-4848-95aa-0a833d68be21 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:32.893720 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 384/746] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:32.894557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d42bea-5ffe-4848-95aa-0a833d68be21 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:32.912204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 363/747] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Aug 4 10:12:32 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:12:32.912204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb264e9c-c1f0-442b-835c-dcf378cc8bc6 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:32.931512 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:33.054190 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d42bea-5ffe-4848-95aa-0a833d68be21 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:33.059540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb264e9c-c1f0-442b-835c-dcf378cc8bc6 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:33.086261 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:33.102731 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb387334-f1f0-40d8-993d-d296b7238cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:33.103368 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb387334-f1f0-40d8-993d-d296b7238cbd None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:33.103654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb387334-f1f0-40d8-993d-d296b7238cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:33.103951 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb387334-f1f0-40d8-993d-d296b7238cbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:33.114107 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d481d-a979-4441-a133-62e2128bf031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:33.114806 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d481d-a979-4441-a133-62e2128bf031 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:33.114989 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d481d-a979-4441-a133-62e2128bf031 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:33.115266 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d481d-a979-4441-a133-62e2128bf031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:33.133024 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d481d-a979-4441-a133-62e2128bf031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:33.134188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d481d-a979-4441-a133-62e2128bf031 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:33.149641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-0e5d481d-a979-4441-a133-62e2128bf031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:33.149641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:33.149641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:33.149641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:33.149641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:33.149641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:33.149641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:33.149641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:33.149641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:33.149641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:33.149641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:33.149641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:33.149641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:33.149641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:33.149641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:33.150546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:33.150546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:33.150546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:33.150546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:33.150546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:33.150546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:33.150546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:33.150546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:33.150546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:33.150546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:33.150546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:33.150546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:33.150546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:33.150546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:33.150546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:33.150546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:33.150546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:33.151437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:33.151437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:33.151437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:33.151437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:33.151437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 364/748] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:33.151718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d481d-a979-4441-a133-62e2128bf031 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:33.194544 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb387334-f1f0-40d8-993d-d296b7238cbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:33.196183 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb387334-f1f0-40d8-993d-d296b7238cbd None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:33.219105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:33.283408 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d481d-a979-4441-a133-62e2128bf031 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:33.315939 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 385/749] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:12:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:12:33.317487 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb387334-f1f0-40d8-993d-d296b7238cbd None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:33.319799 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325bd00-8cda-4269-87e3-5dca38a5b95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:33.320820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325bd00-8cda-4269-87e3-5dca38a5b95d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:33.321109 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325bd00-8cda-4269-87e3-5dca38a5b95d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:33.321391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325bd00-8cda-4269-87e3-5dca38a5b95d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:33.330012 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325bd00-8cda-4269-87e3-5dca38a5b95d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:33.331331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325bd00-8cda-4269-87e3-5dca38a5b95d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:33.343668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-0325bd00-8cda-4269-87e3-5dca38a5b95d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 10:12:33.343668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:33.343668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:33.343668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:33.343668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:33.343668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:33.343668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:33.343668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:33.343668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:33.343668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:33.343668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:33.343668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:33.343668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:33.343668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:33.343668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:33.343668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:33.344649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:33.344649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:33.344649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:33.344649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:33.344649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:33.344649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:33.344649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:33.344649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:33.344649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:33.344649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:33.344649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:33.344649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:33.344649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:33.344649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:33.344649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:33.344649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:33.344649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:33.344649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:33.346150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:33.346150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:33.346150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:33.346150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:33.346150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:33.346150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:33.346150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:33.346150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:33.346150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 10:12:33.346150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:33.350171 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 365/750] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:12:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:33.351027 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325bd00-8cda-4269-87e3-5dca38a5b95d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:33.381173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:33.431495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb387334-f1f0-40d8-993d-d296b7238cbd None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:33.458925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:33.468692 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325bd00-8cda-4269-87e3-5dca38a5b95d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:33.480073 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b67adf-283f-440b-904b-f6cdf2e05425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:33.481276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b67adf-283f-440b-904b-f6cdf2e05425 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:33.481566 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b67adf-283f-440b-904b-f6cdf2e05425 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:33.481846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b67adf-283f-440b-904b-f6cdf2e05425 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:33.482543 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b67adf-283f-440b-904b-f6cdf2e05425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:33.482860 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b67adf-283f-440b-904b-f6cdf2e05425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:33.485011 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b67adf-283f-440b-904b-f6cdf2e05425 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:33.502280 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 386/751] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:33.503517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b67adf-283f-440b-904b-f6cdf2e05425 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:33.510810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b87ba9-eaed-4570-ad9a-80bc824044ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:33.511742 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b87ba9-eaed-4570-ad9a-80bc824044ac None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:33.512258 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b87ba9-eaed-4570-ad9a-80bc824044ac None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:33.512784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b87ba9-eaed-4570-ad9a-80bc824044ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:33.526427 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b87ba9-eaed-4570-ad9a-80bc824044ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:33.528220 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b87ba9-eaed-4570-ad9a-80bc824044ac None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:33.546543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-47b87ba9-eaed-4570-ad9a-80bc824044ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:33.546543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:33.546543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:33.546543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:33.546543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:33.546543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:33.546543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:33.546543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:33.546543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:33.546543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:33.546543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:33.546543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:33.546543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:33.546543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:33.546543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:33.547476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:33.547476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:33.547476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:33.547476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:33.547476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:33.547476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:33.547476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:33.547476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:33.547476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:33.547476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:33.547476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:33.547476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:33.547476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:33.547476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:33.547476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:33.547476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:33.547476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:33.548899 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:33.548899 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:33.548899 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:33.548899 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:33.551139 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 366/752] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:33.552142 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b87ba9-eaed-4570-ad9a-80bc824044ac None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:33.646134 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:33.649592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b67adf-283f-440b-904b-f6cdf2e05425 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:33.669448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b87ba9-eaed-4570-ad9a-80bc824044ac None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:33.695520 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b8a15-83a0-41cb-8c48-92f2934e700a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:33.696618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b8a15-83a0-41cb-8c48-92f2934e700a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:33.697259 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b8a15-83a0-41cb-8c48-92f2934e700a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:33.697740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b8a15-83a0-41cb-8c48-92f2934e700a None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:33.698762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b8a15-83a0-41cb-8c48-92f2934e700a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:33.699291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b8a15-83a0-41cb-8c48-92f2934e700a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:33.701051 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b8a15-83a0-41cb-8c48-92f2934e700a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:33.715328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d9cc1-f0a8-4079-a81c-69f95eb34d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:33.715981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d9cc1-f0a8-4079-a81c-69f95eb34d0e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:33.716306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d9cc1-f0a8-4079-a81c-69f95eb34d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:33.716582 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d9cc1-f0a8-4079-a81c-69f95eb34d0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:33.722586 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 387/753] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Aug 4 10:12:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:33.723761 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b8a15-83a0-41cb-8c48-92f2934e700a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:33.724980 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d9cc1-f0a8-4079-a81c-69f95eb34d0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:33.726441 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d9cc1-f0a8-4079-a81c-69f95eb34d0e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:33.743827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-d43d9cc1-f0a8-4079-a81c-69f95eb34d0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:33.743827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:33.743827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:33.743827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:33.743827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:33.743827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:33.743827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:33.743827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:33.743827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:33.743827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:33.743827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:33.743827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:33.743827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:33.743827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:33.743827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:33.744811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:33.744811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:33.744811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:33.744811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:33.744811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:33.744811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:33.744811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:33.744811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:33.744811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:33.744811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:33.744811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:33.744811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:33.744811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:33.744811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:33.744811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:33.744811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:33.744811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:33.745687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:33.745687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:33.745687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:33.745687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:33.745687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:33.745687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:33.745687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:33.745687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:33.745687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 367/754] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:33.746900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d9cc1-f0a8-4079-a81c-69f95eb34d0e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:33.772752 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:33.852649 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b8a15-83a0-41cb-8c48-92f2934e700a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:33.884203 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d9cc1-f0a8-4079-a81c-69f95eb34d0e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:33.891323 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89525b-9c83-4086-9106-fdd22003ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:33.892556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89525b-9c83-4086-9106-fdd22003ccee None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:33.892836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89525b-9c83-4086-9106-fdd22003ccee None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:33.893172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89525b-9c83-4086-9106-fdd22003ccee None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:33.893875 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89525b-9c83-4086-9106-fdd22003ccee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:33.894183 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89525b-9c83-4086-9106-fdd22003ccee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:33.896119 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89525b-9c83-4086-9106-fdd22003ccee None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:33.916253 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 388/755] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:33.917439 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89525b-9c83-4086-9106-fdd22003ccee None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:33.928933 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dafbf7-301b-48f5-8a23-1af9885d572d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:33.929816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dafbf7-301b-48f5-8a23-1af9885d572d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:33.929816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dafbf7-301b-48f5-8a23-1af9885d572d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:33.930109 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dafbf7-301b-48f5-8a23-1af9885d572d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:33.976569 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:34.008767 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dafbf7-301b-48f5-8a23-1af9885d572d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:34.010728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dafbf7-301b-48f5-8a23-1af9885d572d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:34.040732 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:34.046589 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89525b-9c83-4086-9106-fdd22003ccee None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:34.084827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61102c1c-bf56-47e3-89b4-34914f91d55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:34.086246 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61102c1c-bf56-47e3-89b4-34914f91d55d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:34.086742 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61102c1c-bf56-47e3-89b4-34914f91d55d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:34.087238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61102c1c-bf56-47e3-89b4-34914f91d55d None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:34.088264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61102c1c-bf56-47e3-89b4-34914f91d55d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:34.088782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61102c1c-bf56-47e3-89b4-34914f91d55d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:34.090297 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61102c1c-bf56-47e3-89b4-34914f91d55d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:34.104758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 389/756] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:34.105647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61102c1c-bf56-47e3-89b4-34914f91d55d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:34.117146 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 368/757] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:12:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:12:34.118433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dafbf7-301b-48f5-8a23-1af9885d572d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:34.205059 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:34.215933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61102c1c-bf56-47e3-89b4-34914f91d55d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:34.232192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dafbf7-301b-48f5-8a23-1af9885d572d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:34.255756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057e2c8-76e9-4c1e-b03c-ed4b7cda0e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:34.256505 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057e2c8-76e9-4c1e-b03c-ed4b7cda0e80 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:34.256859 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057e2c8-76e9-4c1e-b03c-ed4b7cda0e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:34.257141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057e2c8-76e9-4c1e-b03c-ed4b7cda0e80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:34.264385 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057e2c8-76e9-4c1e-b03c-ed4b7cda0e80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:34.265846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057e2c8-76e9-4c1e-b03c-ed4b7cda0e80 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:34.273753 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da9803-d2e9-411d-bec8-a3179040db20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:34.274427 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da9803-d2e9-411d-bec8-a3179040db20 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:34.274712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da9803-d2e9-411d-bec8-a3179040db20 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:34.274992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da9803-d2e9-411d-bec8-a3179040db20 None admin] PATH_INFO: `/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/592539924feb44ad8ea520d8539b6608/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:34.276979 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da9803-d2e9-411d-bec8-a3179040db20 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e37543156ee42a0818bf5cfe747fdc2, user_id=592539924feb44ad8ea520d8539b6608, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:34.278401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da9803-d2e9-411d-bec8-a3179040db20 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:34.278776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-3057e2c8-76e9-4c1e-b03c-ed4b7cda0e80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:34.278776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:34.278776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:34.278776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:34.278776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:34.278776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:34.278776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:34.278776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:34.278776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:34.278776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:34.278776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:34.278776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:34.278776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:34.278776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:34.278776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:34.279596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:34.279596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:34.279596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:34.279596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:34.279596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:34.279596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:34.279596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:34.279596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:34.279596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:34.279596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:34.279596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:34.279596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:34.279596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:34.279596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:34.279596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:34.279596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:34.279596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:34.280841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:34.280841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:34.280841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:34.280841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:34.280841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:34.280841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:34.280841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:34.280841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:34.280841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 390/758] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:34.281594 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057e2c8-76e9-4c1e-b03c-ed4b7cda0e80 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:34.304001 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 369/759] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:12:34 2022] PUT /identity/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/592539924feb44ad8ea520d8539b6608/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:12:34.306093 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da9803-d2e9-411d-bec8-a3179040db20 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:34.309092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:34.419825 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057e2c8-76e9-4c1e-b03c-ed4b7cda0e80 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:34.442846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da9803-d2e9-411d-bec8-a3179040db20 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:34.445051 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:34.467461 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46036b32-e142-4ab3-abe1-06288ecbd844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:34.468048 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46036b32-e142-4ab3-abe1-06288ecbd844 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:34.468648 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46036b32-e142-4ab3-abe1-06288ecbd844 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:34.468936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46036b32-e142-4ab3-abe1-06288ecbd844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:34.483421 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46036b32-e142-4ab3-abe1-06288ecbd844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:34.484725 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770a768-b3c1-4f1b-8bc6-878bfe490d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:34.484934 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46036b32-e142-4ab3-abe1-06288ecbd844 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:34.486162 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770a768-b3c1-4f1b-8bc6-878bfe490d6e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:34.486554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770a768-b3c1-4f1b-8bc6-878bfe490d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:34.486927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770a768-b3c1-4f1b-8bc6-878bfe490d6e None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:34.487990 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770a768-b3c1-4f1b-8bc6-878bfe490d6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:34.488571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770a768-b3c1-4f1b-8bc6-878bfe490d6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:34.490517 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770a768-b3c1-4f1b-8bc6-878bfe490d6e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:34.504782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-46036b32-e142-4ab3-abe1-06288ecbd844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:34.504782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:34.504782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:34.504782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:34.504782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:34.504782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:34.504782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:34.504782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:34.504782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:34.504782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:34.504782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:34.504782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:34.504782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:34.504782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:34.504782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:34.505924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:34.505924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:34.505924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:34.505924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:34.505924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:34.505924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:34.505924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:34.505924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:34.505924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:34.505924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:34.505924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:34.505924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:34.505924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:34.505924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:34.505924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:34.505924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:34.505924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:34.507159 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:34.507159 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:34.507159 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:34.507159 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:34.507159 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 391/760] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:34.507644 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22064edc-ab04-492c-9f6c-4feed033ebbf None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:34.507939 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22064edc-ab04-492c-9f6c-4feed033ebbf None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:34.508240 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22064edc-ab04-492c-9f6c-4feed033ebbf None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:34.513789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 370/762] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:34.513959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 392/762] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:34.514409 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22064edc-ab04-492c-9f6c-4feed033ebbf None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:34.514752 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770a768-b3c1-4f1b-8bc6-878bfe490d6e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:34.607377 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:34.635609 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770a768-b3c1-4f1b-8bc6-878bfe490d6e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:34.645472 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22064edc-ab04-492c-9f6c-4feed033ebbf None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:34.672128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63274bd8-5cee-4195-a150-b4003f6939c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:34.672923 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63274bd8-5cee-4195-a150-b4003f6939c4 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:34.673712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63274bd8-5cee-4195-a150-b4003f6939c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:34.674027 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63274bd8-5cee-4195-a150-b4003f6939c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:34.674703 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63274bd8-5cee-4195-a150-b4003f6939c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:34.675014 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63274bd8-5cee-4195-a150-b4003f6939c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:34.676413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63274bd8-5cee-4195-a150-b4003f6939c4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:34.684891 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c3f59-ba3f-4d68-a6ab-8de670f1176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:34.685562 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c3f59-ba3f-4d68-a6ab-8de670f1176f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:34.685961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c3f59-ba3f-4d68-a6ab-8de670f1176f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:34.686574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c3f59-ba3f-4d68-a6ab-8de670f1176f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:34.687461 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c3f59-ba3f-4d68-a6ab-8de670f1176f None admin] RBAC: Adding query filter params (role.id=88ed5b6546c64ac09d03064e12ca7f10, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=306a5f4d7e0d44bd9a27145bd35a07fc) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:34.687782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c3f59-ba3f-4d68-a6ab-8de670f1176f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:34.689541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c3f59-ba3f-4d68-a6ab-8de670f1176f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:34.689993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 371/763] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:34.691538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd226a2e-f3d1-42e7-a44a-f8eeb30b062b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:34.691832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd226a2e-f3d1-42e7-a44a-f8eeb30b062b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:34.692112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd226a2e-f3d1-42e7-a44a-f8eeb30b062b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:34.696373 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 393/764] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:12:34 2022] GET /identity/v3/role_assignments?user.id=306a5f4d7e0d44bd9a27145bd35a07fc&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=88ed5b6546c64ac09d03064e12ca7f10 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:34.697193 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c3f59-ba3f-4d68-a6ab-8de670f1176f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:34.713049 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-fd226a2e-f3d1-42e7-a44a-f8eeb30b062b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:34.714262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fd226a2e-f3d1-42e7-a44a-f8eeb30b062b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:34.732659 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:34.793143 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 372/765] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:34.818099 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd226a2e-f3d1-42e7-a44a-f8eeb30b062b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:34.887810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c3f59-ba3f-4d68-a6ab-8de670f1176f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:34.929277 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd226a2e-f3d1-42e7-a44a-f8eeb30b062b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:34.929479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412ad18-0687-49e6-9764-68fe02a6afe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:34.930017 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412ad18-0687-49e6-9764-68fe02a6afe4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:34.930302 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412ad18-0687-49e6-9764-68fe02a6afe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:34.930577 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412ad18-0687-49e6-9764-68fe02a6afe4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:34.932762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:34.940967 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412ad18-0687-49e6-9764-68fe02a6afe4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:34.942809 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412ad18-0687-49e6-9764-68fe02a6afe4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:34.957173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-9412ad18-0687-49e6-9764-68fe02a6afe4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:34.957173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:34.957173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:34.957173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:34.957173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:34.957173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:34.957173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:34.957173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:34.957173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:34.957173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:34.957173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:34.957173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:34.957173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:34.957173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:34.957173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:34.958118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:34.958118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:34.958118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:34.958118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:34.958118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:34.958118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:34.958118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:34.958118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:34.958118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:34.958118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:34.958118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:34.958118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:34.958118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:34.958118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:34.958118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:34.958118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:34.958118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:34.959064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:34.959064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:34.959064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:34.959064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:34.959064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:34.959064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:34.959064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:34.959064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:34.961779 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 394/766] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:34.967179 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412ad18-0687-49e6-9764-68fe02a6afe4 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:35.004023 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8fc42-c243-4a51-a32a-e950d357fdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:35.004685 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8fc42-c243-4a51-a32a-e950d357fdd9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:35.004973 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8fc42-c243-4a51-a32a-e950d357fdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:35.005255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8fc42-c243-4a51-a32a-e950d357fdd9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:35.005960 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8fc42-c243-4a51-a32a-e950d357fdd9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:35.007341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8fc42-c243-4a51-a32a-e950d357fdd9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:35.039382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-bef8fc42-c243-4a51-a32a-e950d357fdd9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 10:12:35.039382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:35.039382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:12:35.039382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:12:35.039382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:12:35.039382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:12:35.039382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:12:35.039382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:35.039382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 10:12:35.039382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:35.039382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:35.039382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:35.039382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:35.039382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:35.039382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:35.039382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:35.040434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:35.040434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:35.040434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:35.040434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:35.040434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:35.040434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:35.040434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:35.040434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:12:35.040434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:12:35.040434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:12:35.040434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:12:35.040434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:35.040434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:35.040434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:35.040434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:35.040434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:35.041445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:35.041445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:35.041445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:35.041445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:35.041445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:35.041445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:35.041445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:35.041445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:35.041445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:35.041445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:35.041445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:35.041445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:12:35.041445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:35.041445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 10:12:35.041445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:35.041445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 373/767] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Aug 4 10:12:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:35.050354 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8fc42-c243-4a51-a32a-e950d357fdd9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:35.086294 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:35.131083 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412ad18-0687-49e6-9764-68fe02a6afe4 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:35.178433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad1fd7-2fa4-4f6a-8e73-cedc4daebda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:35.179630 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad1fd7-2fa4-4f6a-8e73-cedc4daebda3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:35.180020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad1fd7-2fa4-4f6a-8e73-cedc4daebda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:35.180425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad1fd7-2fa4-4f6a-8e73-cedc4daebda3 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:35.181673 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad1fd7-2fa4-4f6a-8e73-cedc4daebda3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:35.182091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad1fd7-2fa4-4f6a-8e73-cedc4daebda3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:35.184201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad1fd7-2fa4-4f6a-8e73-cedc4daebda3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:35.201684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 395/768] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:35.203029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecb087-b828-4723-a0f9-75cdbe358d52 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:35.203318 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecb087-b828-4723-a0f9-75cdbe358d52 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:35.203600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecb087-b828-4723-a0f9-75cdbe358d52 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:35.208248 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 396/769] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:35.209052 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecb087-b828-4723-a0f9-75cdbe358d52 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:35.217191 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8fc42-c243-4a51-a32a-e950d357fdd9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:35.262361 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8d6a3-8bca-4890-888b-ffe6a87b9cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:35.262915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8d6a3-8bca-4890-888b-ffe6a87b9cfd None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:35.263364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8d6a3-8bca-4890-888b-ffe6a87b9cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:35.263654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8d6a3-8bca-4890-888b-ffe6a87b9cfd None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:35.264770 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8d6a3-8bca-4890-888b-ffe6a87b9cfd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:35.265085 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8d6a3-8bca-4890-888b-ffe6a87b9cfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:35.267438 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8d6a3-8bca-4890-888b-ffe6a87b9cfd None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:35.273458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 374/770] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Aug 4 10:12:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:35.275059 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ec157-8559-4013-934b-92bf2ab4892d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:35.275349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ec157-8559-4013-934b-92bf2ab4892d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:35.275590 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:35.275755 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ec157-8559-4013-934b-92bf2ab4892d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:35.299042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c89ec157-8559-4013-934b-92bf2ab4892d None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:35.300398 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c89ec157-8559-4013-934b-92bf2ab4892d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:35.336345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecb087-b828-4723-a0f9-75cdbe358d52 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:35.372702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05079ac-b9c4-444d-a456-c953f6da44cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:35.373468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05079ac-b9c4-444d-a456-c953f6da44cb None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:35.373885 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05079ac-b9c4-444d-a456-c953f6da44cb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:35.374275 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05079ac-b9c4-444d-a456-c953f6da44cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:35.375212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05079ac-b9c4-444d-a456-c953f6da44cb None admin] RBAC: Adding query filter params (role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=878797620be54b74a3e8582c78ba78d2) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:35.375818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05079ac-b9c4-444d-a456-c953f6da44cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:35.377923 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05079ac-b9c4-444d-a456-c953f6da44cb None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:35.388478 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 397/771] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:12:35 2022] GET /identity/v3/role_assignments?user.id=878797620be54b74a3e8582c78ba78d2&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:35.388478 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05079ac-b9c4-444d-a456-c953f6da44cb None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:35.408346 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 375/772] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:35.450005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ec157-8559-4013-934b-92bf2ab4892d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:35.471367 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:35.551237 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05079ac-b9c4-444d-a456-c953f6da44cb None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:35.591338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:35.622288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685db30b-8482-49c7-b85d-548d3a4daca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:35.622923 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685db30b-8482-49c7-b85d-548d3a4daca0 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:35.623207 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685db30b-8482-49c7-b85d-548d3a4daca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:35.623488 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685db30b-8482-49c7-b85d-548d3a4daca0 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:35.623950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ec157-8559-4013-934b-92bf2ab4892d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:35.624291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685db30b-8482-49c7-b85d-548d3a4daca0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:35.624518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685db30b-8482-49c7-b85d-548d3a4daca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:35.626549 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685db30b-8482-49c7-b85d-548d3a4daca0 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:35.633370 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 398/773] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Aug 4 10:12:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:35.638910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685db30b-8482-49c7-b85d-548d3a4daca0 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:35.682821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061866a5-746b-49d1-ace9-6da7d0652556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:35.682821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061866a5-746b-49d1-ace9-6da7d0652556 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:35.682821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061866a5-746b-49d1-ace9-6da7d0652556 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:35.682821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061866a5-746b-49d1-ace9-6da7d0652556 None admin] PATH_INFO: `/v3/services/network` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:35.683551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061866a5-746b-49d1-ace9-6da7d0652556 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:35.684193 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061866a5-746b-49d1-ace9-6da7d0652556 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:35.706876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-061866a5-746b-49d1-ace9-6da7d0652556 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 10:12:35.706876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:35.706876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:12:35.706876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:12:35.706876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:12:35.706876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:12:35.706876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:12:35.706876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:35.706876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 10:12:35.706876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:35.706876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:35.706876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:35.706876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:35.706876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:35.706876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:35.706876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:35.706876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:35.707894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:35.707894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:35.707894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:35.707894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:35.707894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:35.707894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:35.707894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:12:35.707894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:12:35.707894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:12:35.707894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:12:35.707894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:35.707894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:35.707894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:35.707894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:35.707894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:35.707894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:35.708745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:35.708745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:35.708745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:35.708745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:35.708745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:35.708745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:35.708745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:35.708745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:35.708745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:35.708745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:35.708745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:12:35.708745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:35.708745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 10:12:35.708745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:35.708745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 376/774] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:35 2022] GET /identity/v3/services/network => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:35.717941 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061866a5-746b-49d1-ace9-6da7d0652556 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:35.812392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685db30b-8482-49c7-b85d-548d3a4daca0 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:35.843494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:35.889745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061866a5-746b-49d1-ace9-6da7d0652556 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:35.903304 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1214e-725b-4a4c-a952-e2709e621a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:35.903950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1214e-725b-4a4c-a952-e2709e621a83 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:35.904256 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1214e-725b-4a4c-a952-e2709e621a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:35.904536 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1214e-725b-4a4c-a952-e2709e621a83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:35.905302 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1214e-725b-4a4c-a952-e2709e621a83 None admin] RBAC: Adding query filter params (interface=public, service_id=e0ec11fb0554440f84956ced05124319, region_id=RegionOne) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:35.905616 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1214e-725b-4a4c-a952-e2709e621a83 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:35.906993 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1214e-725b-4a4c-a952-e2709e621a83 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:35.928097 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 399/775] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Aug 4 10:12:35 2022] GET /identity/v3/endpoints?service_id=e0ec11fb0554440f84956ced05124319&interface=public®ion_id=RegionOne => generated 194 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:35.933336 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1214e-725b-4a4c-a952-e2709e621a83 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:35.955259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ef33a-8661-4b39-92b5-7cc6bf95ccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:35.955890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ef33a-8661-4b39-92b5-7cc6bf95ccdd None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:35.956222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ef33a-8661-4b39-92b5-7cc6bf95ccdd None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:35.956480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ef33a-8661-4b39-92b5-7cc6bf95ccdd None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:35.957570 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ef33a-8661-4b39-92b5-7cc6bf95ccdd None admin] RBAC: Adding query filter params (name=network) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:35.957890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ef33a-8661-4b39-92b5-7cc6bf95ccdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:35.959569 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ef33a-8661-4b39-92b5-7cc6bf95ccdd None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:35.965532 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 377/776] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Aug 4 10:12:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:35.974727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ef33a-8661-4b39-92b5-7cc6bf95ccdd None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:36.012385 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:36.082738 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1214e-725b-4a4c-a952-e2709e621a83 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:36.121672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c0233-b1f3-4adf-8548-2fe63ea8ef18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:36.122862 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c0233-b1f3-4adf-8548-2fe63ea8ef18 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:36.124082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c0233-b1f3-4adf-8548-2fe63ea8ef18 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:36.125211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c0233-b1f3-4adf-8548-2fe63ea8ef18 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:36.126730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c0233-b1f3-4adf-8548-2fe63ea8ef18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:36.129455 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c0233-b1f3-4adf-8548-2fe63ea8ef18 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:36.140425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 400/777] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Aug 4 10:12:35 2022] GET /identity/v3/services => generated 772 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:36.198092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ef33a-8661-4b39-92b5-7cc6bf95ccdd None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:36.252267 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac514b-85ef-4165-9305-d771a3107fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:36.253321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac514b-85ef-4165-9305-d771a3107fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:36.253803 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac514b-85ef-4165-9305-d771a3107fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:36.254272 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac514b-85ef-4165-9305-d771a3107fa3 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:36.255201 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac514b-85ef-4165-9305-d771a3107fa3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:36.255798 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac514b-85ef-4165-9305-d771a3107fa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:36.257441 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac514b-85ef-4165-9305-d771a3107fa3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:36.260295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:36.264941 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 378/778] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Aug 4 10:12:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:36.271202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c0233-b1f3-4adf-8548-2fe63ea8ef18 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:36.379785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c0233-b1f3-4adf-8548-2fe63ea8ef18 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:36.391240 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:36.419866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcd140-3771-4cc1-907e-b21bdda51ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:36.420529 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcd140-3771-4cc1-907e-b21bdda51ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:36.420813 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcd140-3771-4cc1-907e-b21bdda51ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:36.421091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcd140-3771-4cc1-907e-b21bdda51ae3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:36.421853 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fcd140-3771-4cc1-907e-b21bdda51ae3 None admin] RBAC: Adding query filter params (interface=public, service_id=26620ee227ba4d24807ae513ff55f310, region_id=RegionOne) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:36.422167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fcd140-3771-4cc1-907e-b21bdda51ae3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:36.423863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fcd140-3771-4cc1-907e-b21bdda51ae3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:36.429938 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 401/779] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Aug 4 10:12:36 2022] GET /identity/v3/endpoints?service_id=26620ee227ba4d24807ae513ff55f310&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:36.435290 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac514b-85ef-4165-9305-d771a3107fa3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:36.542718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac514b-85ef-4165-9305-d771a3107fa3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:36.577352 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39029cfc-f648-4291-86da-1b481a92e05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:36.577982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39029cfc-f648-4291-86da-1b481a92e05d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:36.578262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39029cfc-f648-4291-86da-1b481a92e05d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:36.578536 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39029cfc-f648-4291-86da-1b481a92e05d None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:36.579746 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39029cfc-f648-4291-86da-1b481a92e05d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:36.581152 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39029cfc-f648-4291-86da-1b481a92e05d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:36.586954 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 379/780] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Aug 4 10:12:36 2022] GET /identity/v3/services => generated 772 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:36.768437 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25453458-cbb7-40e2-8204-1d174b2e968d None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:36.768641 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25453458-cbb7-40e2-8204-1d174b2e968d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:36.768913 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25453458-cbb7-40e2-8204-1d174b2e968d None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:36.770598 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 402/781] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:36.781728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ababe-f2b4-4750-8148-201709b585ee None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:36.782834 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ababe-f2b4-4750-8148-201709b585ee None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:36.782912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ababe-f2b4-4750-8148-201709b585ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:36.808226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-759ababe-f2b4-4750-8148-201709b585ee None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:36.809632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-759ababe-f2b4-4750-8148-201709b585ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:36.886742 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:36.897967 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 380/782] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:36.921270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25453458-cbb7-40e2-8204-1d174b2e968d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:37.000598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878eac85-5242-4572-abdc-372e853fb013 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:37.002372 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878eac85-5242-4572-abdc-372e853fb013 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:37.002989 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878eac85-5242-4572-abdc-372e853fb013 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:37.004559 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 381/783] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:12:37.012194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e07703-5395-4102-aa94-42b8ed06fc5a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:37.012194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e07703-5395-4102-aa94-42b8ed06fc5a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:37.012194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e07703-5395-4102-aa94-42b8ed06fc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:37.032798 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-23e07703-5395-4102-aa94-42b8ed06fc5a None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:37.034124 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-23e07703-5395-4102-aa94-42b8ed06fc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:37.093136 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25453458-cbb7-40e2-8204-1d174b2e968d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:37.160189 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 382/784] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 10:12:37.161966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160eaf8-a70f-433d-9404-4ad4572b1251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:37.162797 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160eaf8-a70f-433d-9404-4ad4572b1251 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:37.163229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160eaf8-a70f-433d-9404-4ad4572b1251 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:37.163651 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160eaf8-a70f-433d-9404-4ad4572b1251 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:37.175288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160eaf8-a70f-433d-9404-4ad4572b1251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:37.180497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-f160eaf8-a70f-433d-9404-4ad4572b1251 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:12:37.180497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:37.180497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:37.180497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:37.180497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:37.180497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:37.180497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:37.180497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:37.180497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:37.180497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:37.180497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:37.180497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:37.180497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:37.180497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:37.180497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:37.180497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:37.181614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:37.181614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:37.181614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:37.181614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:37.181614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:37.181614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:37.181614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:37.181614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:37.181614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:37.181614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:37.181614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:37.181614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:37.181614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:37.181614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:37.181614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:37.181614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:37.182636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:37.182636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:37.182636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:37.182636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:37.182636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:37.182636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:37.182636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:37.182636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:37.182636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:37.182636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:37.182636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:12:37.182636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:37.184945 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 403/785] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:12:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:37.193600 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e07703-5395-4102-aa94-42b8ed06fc5a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:37.195442 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160eaf8-a70f-433d-9404-4ad4572b1251 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:37.280528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:37.321498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e07703-5395-4102-aa94-42b8ed06fc5a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:37.350547 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:37.370057 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7f0da-ba5d-4b06-acfd-4eb384be8e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:37.370700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7f0da-ba5d-4b06-acfd-4eb384be8e74 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:37.370986 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7f0da-ba5d-4b06-acfd-4eb384be8e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:37.371265 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7f0da-ba5d-4b06-acfd-4eb384be8e74 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:37.371992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7f0da-ba5d-4b06-acfd-4eb384be8e74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:37.372376 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7f0da-ba5d-4b06-acfd-4eb384be8e74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:37.373861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7f0da-ba5d-4b06-acfd-4eb384be8e74 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:37.384969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 383/786] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:12:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:37.393145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7f0da-ba5d-4b06-acfd-4eb384be8e74 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:37.426329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160eaf8-a70f-433d-9404-4ad4572b1251 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:37.466389 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80404a81-6580-48ee-ab0e-baf49c4f63ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:37.467413 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80404a81-6580-48ee-ab0e-baf49c4f63ff None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:37.467927 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80404a81-6580-48ee-ab0e-baf49c4f63ff None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:37.468434 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80404a81-6580-48ee-ab0e-baf49c4f63ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:37.480319 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80404a81-6580-48ee-ab0e-baf49c4f63ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:37.485614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-80404a81-6580-48ee-ab0e-baf49c4f63ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:37.485614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:37.485614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:37.485614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:37.485614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:37.485614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:37.485614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:37.485614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:37.485614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:37.485614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:37.485614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:37.485614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:37.485614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:37.485614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:37.485614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:37.485614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:37.486684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:37.486684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:37.486684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:37.486684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:37.486684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:37.486684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:37.486684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:37.486684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:37.486684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:37.486684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:37.486684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:37.486684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:37.486684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:37.486684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:37.486684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:37.486684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:37.487481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:37.487481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:37.487481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:37.487481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:37.487481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:37.487481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:37.487481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:37.487481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:37.487481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:37.487481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:37.487481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:37.487481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:37.494715 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 404/787] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:37.496159 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80404a81-6580-48ee-ab0e-baf49c4f63ff None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:37.613218 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:37.626847 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7f0da-ba5d-4b06-acfd-4eb384be8e74 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:37.630248 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80404a81-6580-48ee-ab0e-baf49c4f63ff None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:37.668137 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab764a2e-c7ba-46a3-818e-93daff7a38a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:37.669236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab764a2e-c7ba-46a3-818e-93daff7a38a5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:37.669728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab764a2e-c7ba-46a3-818e-93daff7a38a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:37.670213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab764a2e-c7ba-46a3-818e-93daff7a38a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:37.671244 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab764a2e-c7ba-46a3-818e-93daff7a38a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:37.671765 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab764a2e-c7ba-46a3-818e-93daff7a38a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:37.673493 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab764a2e-c7ba-46a3-818e-93daff7a38a5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:37.687703 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 405/788] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:12:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:37.689983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab764a2e-c7ba-46a3-818e-93daff7a38a5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:37.705587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b9fab-d405-4ed3-a4d4-f3f7ab5d5f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:37.706263 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b9fab-d405-4ed3-a4d4-f3f7ab5d5f7e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:37.706571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b9fab-d405-4ed3-a4d4-f3f7ab5d5f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:37.706837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b9fab-d405-4ed3-a4d4-f3f7ab5d5f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:37.737058 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b9fab-d405-4ed3-a4d4-f3f7ab5d5f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:37.738526 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b9fab-d405-4ed3-a4d4-f3f7ab5d5f7e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:37.770440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-bc1b9fab-d405-4ed3-a4d4-f3f7ab5d5f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:37.770440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:37.770440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:37.770440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:37.770440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:37.770440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:37.770440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:37.770440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:37.770440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:37.770440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:37.770440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:37.770440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:37.770440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:37.770440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:37.770440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:37.771448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:37.771448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:37.771448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:37.771448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:37.771448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:37.771448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:37.771448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:37.771448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:37.771448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:37.771448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:37.771448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:37.771448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:37.771448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:37.771448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:37.771448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:37.771448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:37.771448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:37.772523 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:37.772523 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:37.772523 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:37.772523 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:37.778697 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 384/789] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:37.786014 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b9fab-d405-4ed3-a4d4-f3f7ab5d5f7e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:37.831694 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab764a2e-c7ba-46a3-818e-93daff7a38a5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:37.868613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:37.880437 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f41ca-a7b2-4e56-a6ec-d39da4880517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:37.881421 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f41ca-a7b2-4e56-a6ec-d39da4880517 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:37.881913 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f41ca-a7b2-4e56-a6ec-d39da4880517 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:37.882491 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f41ca-a7b2-4e56-a6ec-d39da4880517 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:37.894753 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f41ca-a7b2-4e56-a6ec-d39da4880517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:37.896506 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f41ca-a7b2-4e56-a6ec-d39da4880517 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:37.911567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-913f41ca-a7b2-4e56-a6ec-d39da4880517 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:37.911567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:37.911567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:37.911567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:37.911567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:37.911567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:37.911567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:37.911567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:37.911567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:37.911567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:37.911567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:37.911567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:37.911567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:37.911567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:37.911567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:37.912510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:37.912510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:37.912510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:37.912510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:37.912510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:37.912510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:37.912510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:37.912510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:37.912510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:37.912510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:37.912510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:37.912510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:37.912510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:37.912510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:37.912510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:37.912510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:37.912510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:37.913372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:37.913372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:37.913372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:37.913372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:37.920285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 406/790] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:37.922491 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f41ca-a7b2-4e56-a6ec-d39da4880517 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:37.935336 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:38.029092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f41ca-a7b2-4e56-a6ec-d39da4880517 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:38.043265 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b9fab-d405-4ed3-a4d4-f3f7ab5d5f7e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:38.065865 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3716326-c213-4bfb-91ad-dad69900116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:38.066958 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3716326-c213-4bfb-91ad-dad69900116d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:38.067472 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3716326-c213-4bfb-91ad-dad69900116d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:38.067973 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3716326-c213-4bfb-91ad-dad69900116d None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:38.068888 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3716326-c213-4bfb-91ad-dad69900116d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:38.069426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3716326-c213-4bfb-91ad-dad69900116d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:38.071001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3716326-c213-4bfb-91ad-dad69900116d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:38.080898 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642557ee-86b2-4f55-8dd9-21378551c77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:38.081815 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642557ee-86b2-4f55-8dd9-21378551c77e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:38.081815 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642557ee-86b2-4f55-8dd9-21378551c77e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:38.082132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642557ee-86b2-4f55-8dd9-21378551c77e None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:38.082802 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642557ee-86b2-4f55-8dd9-21378551c77e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:38.083113 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642557ee-86b2-4f55-8dd9-21378551c77e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:38.084545 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642557ee-86b2-4f55-8dd9-21378551c77e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:38.090620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 407/791] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:38.092221 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ac995-47ce-4627-9e23-1dede7aa3419 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:38.092727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ac995-47ce-4627-9e23-1dede7aa3419 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:38.093211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ac995-47ce-4627-9e23-1dede7aa3419 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:38.094730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 408/792] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:38.095978 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ac995-47ce-4627-9e23-1dede7aa3419 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:38.101258 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 385/793] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:38.102545 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e02f1-fdbe-4253-a57a-94d79a6877ae None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:38.102838 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e02f1-fdbe-4253-a57a-94d79a6877ae None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:38.103117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e02f1-fdbe-4253-a57a-94d79a6877ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:38.123291 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-af2e02f1-fdbe-4253-a57a-94d79a6877ae None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:38.124929 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-af2e02f1-fdbe-4253-a57a-94d79a6877ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:38.176782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:38.204736 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 386/794] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:38.205612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e02f1-fdbe-4253-a57a-94d79a6877ae None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:38.213167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ac995-47ce-4627-9e23-1dede7aa3419 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:38.250685 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:38.252391 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e7655-115d-475a-a6be-c059b3a7ef1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:38.253685 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e7655-115d-475a-a6be-c059b3a7ef1d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:38.254995 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e7655-115d-475a-a6be-c059b3a7ef1d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:38.255484 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e7655-115d-475a-a6be-c059b3a7ef1d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:38.263602 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e7655-115d-475a-a6be-c059b3a7ef1d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:38.265392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e7655-115d-475a-a6be-c059b3a7ef1d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:38.278826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-ab1e7655-115d-475a-a6be-c059b3a7ef1d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 10:12:38.278826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:38.278826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:38.278826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:38.278826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:38.278826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:38.278826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:38.278826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:38.278826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:38.278826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:38.278826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:38.278826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:38.278826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:38.278826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:38.278826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:38.278826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:38.279767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:38.279767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:38.279767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:38.279767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:38.279767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:38.279767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:38.279767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:38.279767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:38.279767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:38.279767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:38.279767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:38.279767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:38.279767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:38.279767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:38.279767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:38.279767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:38.279767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:38.279767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:38.280728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:38.280728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:38.280728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:38.280728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:38.280728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:38.280728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:38.280728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:38.280728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:38.280728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 10:12:38.280728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:38.288638 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 409/795] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Aug 4 10:12:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:38.289694 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e7655-115d-475a-a6be-c059b3a7ef1d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:38.330448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e02f1-fdbe-4253-a57a-94d79a6877ae None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:38.368516 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941c180-0a66-439a-9ae8-4727c96e0d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:38.369222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941c180-0a66-439a-9ae8-4727c96e0d93 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:38.369505 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941c180-0a66-439a-9ae8-4727c96e0d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:38.369838 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941c180-0a66-439a-9ae8-4727c96e0d93 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:38.377807 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941c180-0a66-439a-9ae8-4727c96e0d93 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:38.379261 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941c180-0a66-439a-9ae8-4727c96e0d93 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:38.398497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-e941c180-0a66-439a-9ae8-4727c96e0d93 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 10:12:38.398497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:38.398497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:38.398497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:38.398497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:38.398497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:38.398497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:38.398497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:38.398497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:38.398497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:38.398497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:38.398497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:38.398497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:38.398497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:38.398497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:38.398497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:38.399448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:38.399448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:38.399448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:38.399448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:38.399448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:38.399448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:38.399448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:38.399448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:38.399448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:38.399448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:38.399448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:38.399448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:38.399448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:38.399448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:38.399448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:38.399448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:38.399448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:38.399448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:38.401487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:38.401487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:38.401487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:38.401487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:38.401487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:38.401487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:38.401487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:38.401487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:38.401487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 10:12:38.401487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:38.401487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 387/796] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Aug 4 10:12:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:38.401487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941c180-0a66-439a-9ae8-4727c96e0d93 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:38.402962 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e7655-115d-475a-a6be-c059b3a7ef1d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:38.435976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:38.447490 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aec573-4cb2-42ab-9489-f7a9511580e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:38.448145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aec573-4cb2-42ab-9489-f7a9511580e2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:38.448476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aec573-4cb2-42ab-9489-f7a9511580e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:38.448759 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aec573-4cb2-42ab-9489-f7a9511580e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:38.461706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aec573-4cb2-42ab-9489-f7a9511580e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:38.468384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-68aec573-4cb2-42ab-9489-f7a9511580e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:12:38.468384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:38.468384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:38.468384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:38.468384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:38.468384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:38.468384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:38.468384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:38.468384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:38.468384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:38.468384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:38.468384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:38.468384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:38.468384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:38.468384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:38.468384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:38.469296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:38.469296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:38.469296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:38.469296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:38.469296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:38.469296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:38.469296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:38.469296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:38.469296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:38.469296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:38.469296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:38.469296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:38.469296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:38.469296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:38.469296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:38.469296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:38.471494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:38.471494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:38.471494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:38.471494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:38.471494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:38.471494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:38.471494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:38.471494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:38.471494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:38.471494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:38.471494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:12:38.471494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:38.471494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 410/797] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:12:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:38.471494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aec573-4cb2-42ab-9489-f7a9511580e2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:38.518577 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:38.535814 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941c180-0a66-439a-9ae8-4727c96e0d93 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:38.585124 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccb176-42c6-4537-bda1-b0672c18c3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:38.586032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccb176-42c6-4537-bda1-b0672c18c3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:38.586319 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccb176-42c6-4537-bda1-b0672c18c3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:38.586597 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccb176-42c6-4537-bda1-b0672c18c3d5 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:38.588080 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccb176-42c6-4537-bda1-b0672c18c3d5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:38.588424 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccb176-42c6-4537-bda1-b0672c18c3d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:38.590021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccb176-42c6-4537-bda1-b0672c18c3d5 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:38.598069 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aec573-4cb2-42ab-9489-f7a9511580e2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:38.608728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 388/798] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Aug 4 10:12:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:38.609762 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccb176-42c6-4537-bda1-b0672c18c3d5 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:38.646339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef12127-6ea1-4141-a943-d273db663ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:38.646988 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef12127-6ea1-4141-a943-d273db663ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:38.647277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef12127-6ea1-4141-a943-d273db663ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:38.647562 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef12127-6ea1-4141-a943-d273db663ed3 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:38.648393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef12127-6ea1-4141-a943-d273db663ed3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:38.648710 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef12127-6ea1-4141-a943-d273db663ed3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:38.650149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef12127-6ea1-4141-a943-d273db663ed3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:38.673447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 411/799] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Aug 4 10:12:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:38.673447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd448d7-1ef0-422b-be9e-f72b10503740 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:38.673447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd448d7-1ef0-422b-be9e-f72b10503740 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:38.673447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd448d7-1ef0-422b-be9e-f72b10503740 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:38.673447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 412/800] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:38.673447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd448d7-1ef0-422b-be9e-f72b10503740 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:38.724902 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:38.727678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccb176-42c6-4537-bda1-b0672c18c3d5 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:38.766538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686489e-004c-4b7e-98ed-0cd05ac95ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:38.767614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686489e-004c-4b7e-98ed-0cd05ac95ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:38.767614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686489e-004c-4b7e-98ed-0cd05ac95ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:38.767783 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686489e-004c-4b7e-98ed-0cd05ac95ba5 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:38.768460 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686489e-004c-4b7e-98ed-0cd05ac95ba5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:38.768762 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686489e-004c-4b7e-98ed-0cd05ac95ba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:38.770133 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686489e-004c-4b7e-98ed-0cd05ac95ba5 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:38.783261 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 389/801] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:12:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:38.783261 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686489e-004c-4b7e-98ed-0cd05ac95ba5 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:38.792866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd448d7-1ef0-422b-be9e-f72b10503740 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:38.795936 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:38.829278 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed60de-dc80-4cc5-ade1-1c1cd2419530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:38.829925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed60de-dc80-4cc5-ade1-1c1cd2419530 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:38.830209 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed60de-dc80-4cc5-ade1-1c1cd2419530 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:38.830486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed60de-dc80-4cc5-ade1-1c1cd2419530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:38.841110 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed60de-dc80-4cc5-ade1-1c1cd2419530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:38.842593 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed60de-dc80-4cc5-ade1-1c1cd2419530 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:38.857818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-00ed60de-dc80-4cc5-ade1-1c1cd2419530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:38.857818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:38.857818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:38.857818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:38.857818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:38.857818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:38.857818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:38.857818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:38.857818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:38.857818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:38.857818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:38.857818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:38.857818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:38.857818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:38.857818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:38.858708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:38.858708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:38.858708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:38.858708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:38.858708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:38.858708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:38.858708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:38.858708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:38.858708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:38.858708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:38.858708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:38.858708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:38.858708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:38.858708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:38.858708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:38.858708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:38.858708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:38.859637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:38.859637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:38.859637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:38.859637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:38.859637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 413/802] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:38.861317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a0ffd-f763-4aba-8786-07842f2c5253 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:38.861706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a0ffd-f763-4aba-8786-07842f2c5253 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:38.861987 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a0ffd-f763-4aba-8786-07842f2c5253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:38.879554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c52a0ffd-f763-4aba-8786-07842f2c5253 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:38.880779 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c52a0ffd-f763-4aba-8786-07842f2c5253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:38.899665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686489e-004c-4b7e-98ed-0cd05ac95ba5 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:38.939229 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e500a4b-b5ca-49c9-a960-e500d1758eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:38.939921 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e500a4b-b5ca-49c9-a960-e500d1758eda None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:38.940232 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e500a4b-b5ca-49c9-a960-e500d1758eda None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:38.940513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e500a4b-b5ca-49c9-a960-e500d1758eda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:38.953479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 414/803] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:38.957330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a0ffd-f763-4aba-8786-07842f2c5253 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:38.996623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:39.014946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e500a4b-b5ca-49c9-a960-e500d1758eda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:39.016963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e500a4b-b5ca-49c9-a960-e500d1758eda None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:39.027251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:39.077167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a0ffd-f763-4aba-8786-07842f2c5253 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:39.112559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507531c-3874-49b9-9ba0-9f35a7a74058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:39.113207 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507531c-3874-49b9-9ba0-9f35a7a74058 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:39.113490 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507531c-3874-49b9-9ba0-9f35a7a74058 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:39.113767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507531c-3874-49b9-9ba0-9f35a7a74058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:39.120088 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 390/804] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:12:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:12:39.120954 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e500a4b-b5ca-49c9-a960-e500d1758eda None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:39.125940 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507531c-3874-49b9-9ba0-9f35a7a74058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:39.127816 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507531c-3874-49b9-9ba0-9f35a7a74058 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:39.144268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-0507531c-3874-49b9-9ba0-9f35a7a74058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:39.144268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:39.144268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:39.144268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:39.144268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:39.144268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:39.144268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:39.144268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:39.144268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:39.144268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:39.144268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:39.144268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:39.144268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:39.144268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:39.144268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:39.145201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:39.145201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:39.145201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:39.145201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:39.145201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:39.145201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:39.145201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:39.145201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:39.145201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:39.145201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:39.145201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:39.145201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:39.145201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:39.145201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:39.145201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:39.145201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:39.145201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:39.146135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:39.146135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:39.146135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:39.146135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:39.146135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 415/805] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:39.146400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507531c-3874-49b9-9ba0-9f35a7a74058 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:39.224893 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e500a4b-b5ca-49c9-a960-e500d1758eda None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:39.226583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:39.234953 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:39.248300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507531c-3874-49b9-9ba0-9f35a7a74058 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:39.260579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f7585-a86a-4c6f-93fb-d46b099dc2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:39.261191 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f7585-a86a-4c6f-93fb-d46b099dc2ff None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:39.261467 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f7585-a86a-4c6f-93fb-d46b099dc2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:39.261741 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f7585-a86a-4c6f-93fb-d46b099dc2ff None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:39.262421 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f7585-a86a-4c6f-93fb-d46b099dc2ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:39.262723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f7585-a86a-4c6f-93fb-d46b099dc2ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:39.264104 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f7585-a86a-4c6f-93fb-d46b099dc2ff None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:39.274963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 391/806] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:39.276108 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94450ab0-7ef4-4169-b661-cb788e01960a None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:39.276428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94450ab0-7ef4-4169-b661-cb788e01960a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:39.276709 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94450ab0-7ef4-4169-b661-cb788e01960a None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:39.278171 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 392/807] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:39.278860 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94450ab0-7ef4-4169-b661-cb788e01960a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:39.284793 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec78d7-61cc-41d2-bc41-29111065e2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:39.285445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec78d7-61cc-41d2-bc41-29111065e2dc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:39.285730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec78d7-61cc-41d2-bc41-29111065e2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:39.286007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec78d7-61cc-41d2-bc41-29111065e2dc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:39.286634 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec78d7-61cc-41d2-bc41-29111065e2dc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:39.288013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec78d7-61cc-41d2-bc41-29111065e2dc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:39.297295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-87ec78d7-61cc-41d2-bc41-29111065e2dc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 10:12:39.297295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:39.297295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:12:39.297295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:12:39.297295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:12:39.297295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:12:39.297295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:12:39.297295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:39.297295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 10:12:39.297295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:39.297295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:39.297295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:39.297295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:39.297295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:39.297295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:39.297295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:39.298928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:39.298928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:39.298928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:39.298928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:39.298928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:39.298928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:39.298928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:39.298928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:12:39.298928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:12:39.298928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:12:39.298928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:12:39.298928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:39.298928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:39.298928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:39.298928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:39.298928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:39.299924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:39.299924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:39.299924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:39.299924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:39.299924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:39.299924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:39.299924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:39.299924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:39.299924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:39.299924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:39.299924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:39.299924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:12:39.299924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:39.299924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 10:12:39.299924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:39.299924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 416/808] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Aug 4 10:12:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:39.301157 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec78d7-61cc-41d2-bc41-29111065e2dc None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:39.389182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94450ab0-7ef4-4169-b661-cb788e01960a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:39.401286 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec78d7-61cc-41d2-bc41-29111065e2dc None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:39.423511 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f49688-c7bc-49a2-a72a-e42c1c554393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:39.424260 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f49688-c7bc-49a2-a72a-e42c1c554393 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:39.424550 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f49688-c7bc-49a2-a72a-e42c1c554393 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:39.424824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f49688-c7bc-49a2-a72a-e42c1c554393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:39.434978 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fd283-380f-4e93-a613-b783ca27f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:39.435118 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f49688-c7bc-49a2-a72a-e42c1c554393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:39.435600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fd283-380f-4e93-a613-b783ca27f5cb None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:39.435888 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fd283-380f-4e93-a613-b783ca27f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:39.436473 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fd283-380f-4e93-a613-b783ca27f5cb None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:39.436853 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f49688-c7bc-49a2-a72a-e42c1c554393 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:39.437216 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fd283-380f-4e93-a613-b783ca27f5cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:39.437469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fd283-380f-4e93-a613-b783ca27f5cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:39.438939 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fd283-380f-4e93-a613-b783ca27f5cb None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:39.450609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 417/809] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:39.451021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-62f49688-c7bc-49a2-a72a-e42c1c554393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:39.451021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:39.451021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:39.451021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:39.451021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:39.451021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:39.451021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:39.451021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:39.451021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:39.451021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:39.451021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:39.451021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:39.451021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:39.451021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:39.451021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:39.451969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:39.451969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:39.451969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:39.451969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:39.451969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:39.451969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:39.451969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:39.451969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:39.451969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:39.451969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:39.451969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:39.451969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:39.451969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:39.451969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:39.451969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:39.451969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:39.451969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:39.453172 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:39.453172 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:39.453172 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:39.453172 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:39.453401 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fd283-380f-4e93-a613-b783ca27f5cb None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:39.453473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 393/810] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:39.453473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab6c5b-e278-430e-bed0-d43343c484db None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:39.453834 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab6c5b-e278-430e-bed0-d43343c484db None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:39.454598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab6c5b-e278-430e-bed0-d43343c484db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:39.459428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:39.473028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-0dab6c5b-e278-430e-bed0-d43343c484db None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:39.474223 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0dab6c5b-e278-430e-bed0-d43343c484db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:39.488529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:39.545429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 394/811] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:39.546490 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab6c5b-e278-430e-bed0-d43343c484db None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:39.555974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fd283-380f-4e93-a613-b783ca27f5cb None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:39.592106 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf263d3-abac-48a0-b981-d34f9ebea0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:39.592784 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf263d3-abac-48a0-b981-d34f9ebea0ff None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:39.593072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf263d3-abac-48a0-b981-d34f9ebea0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:39.593352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf263d3-abac-48a0-b981-d34f9ebea0ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:39.600574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf263d3-abac-48a0-b981-d34f9ebea0ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:39.602022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf263d3-abac-48a0-b981-d34f9ebea0ff None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:39.613623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-dcf263d3-abac-48a0-b981-d34f9ebea0ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:39.613623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:39.613623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:39.613623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:39.613623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:39.613623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:39.613623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:39.613623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:39.613623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:39.613623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:39.613623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:39.613623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:39.613623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:39.613623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:39.613623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:39.614502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:39.614502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:39.614502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:39.614502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:39.614502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:39.614502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:39.614502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:39.614502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:39.614502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:39.614502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:39.614502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:39.614502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:39.614502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:39.614502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:39.614502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:39.614502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:39.614502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:39.615361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:39.615361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:39.615361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:39.615361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:39.615361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:39.615361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:39.615361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:39.615361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:39.615361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 418/812] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:39.616123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf263d3-abac-48a0-b981-d34f9ebea0ff None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:39.652811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab6c5b-e278-430e-bed0-d43343c484db None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:39.679216 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:39.688062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49425e-99d8-46f8-b791-c14f99e85486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:39.688783 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49425e-99d8-46f8-b791-c14f99e85486 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:39.689068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49425e-99d8-46f8-b791-c14f99e85486 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:39.689374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49425e-99d8-46f8-b791-c14f99e85486 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:39.690056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49425e-99d8-46f8-b791-c14f99e85486 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:39.690364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49425e-99d8-46f8-b791-c14f99e85486 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:39.691739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49425e-99d8-46f8-b791-c14f99e85486 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:39.696306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 395/813] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Aug 4 10:12:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:39.697071 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49425e-99d8-46f8-b791-c14f99e85486 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:39.714063 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:39.719610 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf263d3-abac-48a0-b981-d34f9ebea0ff None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:39.754625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f76f39-21d2-4b11-8e22-253c209e5f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:39.755192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f76f39-21d2-4b11-8e22-253c209e5f4e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:39.755471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f76f39-21d2-4b11-8e22-253c209e5f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:39.755745 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f76f39-21d2-4b11-8e22-253c209e5f4e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:39.763148 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f76f39-21d2-4b11-8e22-253c209e5f4e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:39.764644 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f76f39-21d2-4b11-8e22-253c209e5f4e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:39.776023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-42f76f39-21d2-4b11-8e22-253c209e5f4e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 10:12:39.776023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:39.776023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:39.776023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:39.776023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:39.776023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:39.776023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:39.776023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:39.776023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:39.776023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:39.776023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:39.776023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:39.776023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:39.776023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:39.776023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:39.776023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:39.777107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:39.777107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:39.777107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:39.777107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:39.777107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:39.777107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:39.777107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:39.777107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:39.777107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:39.777107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:39.777107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:39.777107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:39.777107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:39.777107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:39.777107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:39.777107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:39.777107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:39.777107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:39.778031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:39.778031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:39.778031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:39.778031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:39.778031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:39.778031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:39.778031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:39.778031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:39.778031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 10:12:39.778031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:39.778031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 419/814] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:12:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:39.778031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f76f39-21d2-4b11-8e22-253c209e5f4e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:39.806939 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49425e-99d8-46f8-b791-c14f99e85486 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:39.842108 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc90914-e7dc-4289-a0bc-d6c8723e0a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:39.842737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc90914-e7dc-4289-a0bc-d6c8723e0a84 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:39.843023 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc90914-e7dc-4289-a0bc-d6c8723e0a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:39.843306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc90914-e7dc-4289-a0bc-d6c8723e0a84 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:39.844008 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc90914-e7dc-4289-a0bc-d6c8723e0a84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:39.844351 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc90914-e7dc-4289-a0bc-d6c8723e0a84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:39.845910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc90914-e7dc-4289-a0bc-d6c8723e0a84 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:39.857090 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 396/815] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:39.857778 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc90914-e7dc-4289-a0bc-d6c8723e0a84 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:39.881674 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f76f39-21d2-4b11-8e22-253c209e5f4e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:39.904846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:39.916849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bf892-6a35-409c-9f25-f3b1bca85055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:39.917483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bf892-6a35-409c-9f25-f3b1bca85055 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:39.917764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bf892-6a35-409c-9f25-f3b1bca85055 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:39.918040 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bf892-6a35-409c-9f25-f3b1bca85055 None admin] PATH_INFO: `/v3/services/network` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:39.918655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600bf892-6a35-409c-9f25-f3b1bca85055 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:39.920018 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600bf892-6a35-409c-9f25-f3b1bca85055 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:39.928871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-600bf892-6a35-409c-9f25-f3b1bca85055 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 10:12:39.928871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:39.928871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:12:39.928871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:12:39.928871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:12:39.928871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:12:39.928871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:12:39.928871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:39.928871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 10:12:39.928871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:39.928871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:39.928871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:39.928871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:39.928871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:39.928871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:39.928871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:39.928871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:39.929991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:39.929991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:39.929991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:39.929991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:39.929991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:39.929991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:39.929991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:12:39.929991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:12:39.929991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:12:39.929991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:12:39.929991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:39.929991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:39.929991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:39.929991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:39.929991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:39.929991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:39.930821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:39.930821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:39.930821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:39.930821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:39.930821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:39.930821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:39.930821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:39.930821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:39.930821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:39.930821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:39.930821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:12:39.930821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:39.930821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 10:12:39.930821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:39.930821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 420/816] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:39 2022] GET /identity/v3/services/network => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:39.931589 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bf892-6a35-409c-9f25-f3b1bca85055 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:39.932078 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:39.961718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc90914-e7dc-4289-a0bc-d6c8723e0a84 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:39.995437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ee61d-3293-4c52-a666-c9d0665a9161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:39.996057 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ee61d-3293-4c52-a666-c9d0665a9161 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:39.996377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ee61d-3293-4c52-a666-c9d0665a9161 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:39.996660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ee61d-3293-4c52-a666-c9d0665a9161 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:39.997413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ee61d-3293-4c52-a666-c9d0665a9161 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:39.997724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ee61d-3293-4c52-a666-c9d0665a9161 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:39.999152 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ee61d-3293-4c52-a666-c9d0665a9161 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:40.017985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 397/817] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:40.017985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ee61d-3293-4c52-a666-c9d0665a9161 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:40.034807 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bf892-6a35-409c-9f25-f3b1bca85055 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:40.068948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e8794-d745-47eb-8f5a-e619435c24c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:40.069570 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e8794-d745-47eb-8f5a-e619435c24c7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:40.069854 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e8794-d745-47eb-8f5a-e619435c24c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:40.070132 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e8794-d745-47eb-8f5a-e619435c24c7 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:40.070815 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e8794-d745-47eb-8f5a-e619435c24c7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:40.071119 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e8794-d745-47eb-8f5a-e619435c24c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:40.072532 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e8794-d745-47eb-8f5a-e619435c24c7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:40.077226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 421/818] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Aug 4 10:12:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:40.077988 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e8794-d745-47eb-8f5a-e619435c24c7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:40.115906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ee61d-3293-4c52-a666-c9d0665a9161 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:40.132323 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:40.151008 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200b66b-7adc-485c-a024-a3091cf3595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:40.151645 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200b66b-7adc-485c-a024-a3091cf3595e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:40.151939 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200b66b-7adc-485c-a024-a3091cf3595e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:40.152255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200b66b-7adc-485c-a024-a3091cf3595e None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:40.153066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200b66b-7adc-485c-a024-a3091cf3595e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:40.153379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200b66b-7adc-485c-a024-a3091cf3595e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:40.154807 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200b66b-7adc-485c-a024-a3091cf3595e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:40.156477 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:40.178032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 398/819] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Aug 4 10:12:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:40.178032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200b66b-7adc-485c-a024-a3091cf3595e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:40.184813 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e8794-d745-47eb-8f5a-e619435c24c7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:40.219156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113251e-836a-48a1-8374-4f52d409c0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:40.219831 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113251e-836a-48a1-8374-4f52d409c0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:40.220114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113251e-836a-48a1-8374-4f52d409c0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:40.220422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113251e-836a-48a1-8374-4f52d409c0a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:40.227054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113251e-836a-48a1-8374-4f52d409c0a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:40.228541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113251e-836a-48a1-8374-4f52d409c0a8 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:40.240234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-3113251e-836a-48a1-8374-4f52d409c0a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:40.240234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:40.240234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:40.240234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:40.240234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:40.240234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:40.240234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:40.240234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:40.240234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:40.240234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:40.240234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:40.240234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:40.240234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:40.240234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:40.240234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:40.241107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:40.241107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:40.241107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:40.241107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:40.241107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:40.241107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:40.241107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:40.241107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:40.241107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:40.241107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:40.241107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:40.241107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:40.241107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:40.241107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:40.241107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:40.241107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:40.241107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:40.241983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:40.241983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:40.241983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:40.241983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:40.241983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:40.241983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:40.241983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:40.241983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:40.241983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 422/820] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:40.242828 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113251e-836a-48a1-8374-4f52d409c0a8 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:40.277163 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200b66b-7adc-485c-a024-a3091cf3595e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:40.311831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc33c52-b592-45ad-a66f-dfaa58ef01cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:40.312483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc33c52-b592-45ad-a66f-dfaa58ef01cd None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:40.312759 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc33c52-b592-45ad-a66f-dfaa58ef01cd None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:40.313031 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc33c52-b592-45ad-a66f-dfaa58ef01cd None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:40.313833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc33c52-b592-45ad-a66f-dfaa58ef01cd None admin] RBAC: Adding query filter params (name=network) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:40.314138 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc33c52-b592-45ad-a66f-dfaa58ef01cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:40.315498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc33c52-b592-45ad-a66f-dfaa58ef01cd None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:40.320019 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 399/821] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Aug 4 10:12:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:40.320939 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc33c52-b592-45ad-a66f-dfaa58ef01cd None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:40.351400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113251e-836a-48a1-8374-4f52d409c0a8 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:40.363842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:40.377398 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:40.386124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c4767-4468-4e3e-bde3-01250407e7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:40.386797 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c4767-4468-4e3e-bde3-01250407e7e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:40.387086 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c4767-4468-4e3e-bde3-01250407e7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:40.387363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c4767-4468-4e3e-bde3-01250407e7e7 None admin] PATH_INFO: `/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/306a5f4d7e0d44bd9a27145bd35a07fc/roles/88ed5b6546c64ac09d03064e12ca7f10` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:40.401964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c4767-4468-4e3e-bde3-01250407e7e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e37543156ee42a0818bf5cfe747fdc2, user_id=306a5f4d7e0d44bd9a27145bd35a07fc, role_id=88ed5b6546c64ac09d03064e12ca7f10)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:40.403409 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c4767-4468-4e3e-bde3-01250407e7e7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:40.416074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 423/822] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:12:40 2022] PUT /identity/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/306a5f4d7e0d44bd9a27145bd35a07fc/roles/88ed5b6546c64ac09d03064e12ca7f10 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:12:40.416890 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c4767-4468-4e3e-bde3-01250407e7e7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:40.422132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc33c52-b592-45ad-a66f-dfaa58ef01cd None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:40.461278 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de4156-faf9-4bf3-a53e-3824e3527fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:40.461918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de4156-faf9-4bf3-a53e-3824e3527fdd None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:40.462203 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de4156-faf9-4bf3-a53e-3824e3527fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:40.462476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de4156-faf9-4bf3-a53e-3824e3527fdd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:40.463206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de4156-faf9-4bf3-a53e-3824e3527fdd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:40.464672 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de4156-faf9-4bf3-a53e-3824e3527fdd None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:40.496202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 400/823] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:12:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:12:40.496202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de4156-faf9-4bf3-a53e-3824e3527fdd None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:40.553008 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c4767-4468-4e3e-bde3-01250407e7e7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:40.615027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28dbd1-6531-49b9-a38c-a716ef7fe84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:40.615761 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28dbd1-6531-49b9-a38c-a716ef7fe84d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:40.616048 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28dbd1-6531-49b9-a38c-a716ef7fe84d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:40.616391 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28dbd1-6531-49b9-a38c-a716ef7fe84d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:40.630854 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28dbd1-6531-49b9-a38c-a716ef7fe84d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:40.632425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28dbd1-6531-49b9-a38c-a716ef7fe84d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:40.639926 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de4156-faf9-4bf3-a53e-3824e3527fdd None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:40.657404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:40.663639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-3c28dbd1-6531-49b9-a38c-a716ef7fe84d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:40.663639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:40.663639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:40.663639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:40.663639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:40.663639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:40.663639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:40.663639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:40.663639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:40.663639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:40.663639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:40.663639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:40.663639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:40.663639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:40.663639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:40.664706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:40.664706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:40.664706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:40.664706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:40.664706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:40.664706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:40.664706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:40.664706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:40.664706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:40.664706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:40.664706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:40.664706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:40.664706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:40.664706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:40.664706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:40.664706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:40.664706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:40.665566 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:40.665566 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:40.665566 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:40.665566 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:40.666549 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 424/824] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:40.667275 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28dbd1-6531-49b9-a38c-a716ef7fe84d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:40.682583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:40.687136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237c230-b6f1-493d-b598-d65e40b43b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:40.687781 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237c230-b6f1-493d-b598-d65e40b43b1c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:40.688062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237c230-b6f1-493d-b598-d65e40b43b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:40.689016 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237c230-b6f1-493d-b598-d65e40b43b1c None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:40.689794 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237c230-b6f1-493d-b598-d65e40b43b1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:40.690103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237c230-b6f1-493d-b598-d65e40b43b1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:40.691618 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237c230-b6f1-493d-b598-d65e40b43b1c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:40.707613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 401/825] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:40.708506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237c230-b6f1-493d-b598-d65e40b43b1c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:40.801243 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28dbd1-6531-49b9-a38c-a716ef7fe84d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:40.837269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237c230-b6f1-493d-b598-d65e40b43b1c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:40.839213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2f81b-cde6-481c-a129-5723afdf7db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:40.839949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2f81b-cde6-481c-a129-5723afdf7db7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:40.840262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2f81b-cde6-481c-a129-5723afdf7db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:40.840545 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2f81b-cde6-481c-a129-5723afdf7db7 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:40.841226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2f81b-cde6-481c-a129-5723afdf7db7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:40.841532 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2f81b-cde6-481c-a129-5723afdf7db7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:40.842919 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2f81b-cde6-481c-a129-5723afdf7db7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:40.848661 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 425/826] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Aug 4 10:12:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:40.849565 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2f81b-cde6-481c-a129-5723afdf7db7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:40.876930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0587b-50b1-48e0-bafa-2ccbfe817b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:40.877622 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0587b-50b1-48e0-bafa-2ccbfe817b09 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:40.877907 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0587b-50b1-48e0-bafa-2ccbfe817b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:40.878187 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0587b-50b1-48e0-bafa-2ccbfe817b09 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:40.878977 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0587b-50b1-48e0-bafa-2ccbfe817b09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:40.879291 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0587b-50b1-48e0-bafa-2ccbfe817b09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:40.880847 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0587b-50b1-48e0-bafa-2ccbfe817b09 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:40.898358 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 402/827] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:40.899396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0587b-50b1-48e0-bafa-2ccbfe817b09 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:40.932004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:40.943602 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:40.975016 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2f81b-cde6-481c-a129-5723afdf7db7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:41.023322 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0587b-50b1-48e0-bafa-2ccbfe817b09 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:41.024234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c676e-1f29-420a-acef-cfee5f16ba98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:41.025379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c676e-1f29-420a-acef-cfee5f16ba98 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:41.026768 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c676e-1f29-420a-acef-cfee5f16ba98 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:41.027253 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c676e-1f29-420a-acef-cfee5f16ba98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:41.028282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c676e-1f29-420a-acef-cfee5f16ba98 None admin] RBAC: Adding query filter params (role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=592539924feb44ad8ea520d8539b6608) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:41.028806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c676e-1f29-420a-acef-cfee5f16ba98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:41.030462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c676e-1f29-420a-acef-cfee5f16ba98 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:41.041016 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 426/828] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:12:40 2022] GET /identity/v3/role_assignments?user.id=592539924feb44ad8ea520d8539b6608&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:41.042896 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c676e-1f29-420a-acef-cfee5f16ba98 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:41.092530 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49c830-0d56-4c04-a9ec-6897b074956c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:41.093104 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49c830-0d56-4c04-a9ec-6897b074956c None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:41.095232 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49c830-0d56-4c04-a9ec-6897b074956c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:41.095617 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49c830-0d56-4c04-a9ec-6897b074956c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:41.099400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49c830-0d56-4c04-a9ec-6897b074956c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:41.100938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49c830-0d56-4c04-a9ec-6897b074956c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:41.140948 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 403/829] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:12:40 2022] POST /identity/v3/endpoints => generated 337 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:12:41.227212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c676e-1f29-420a-acef-cfee5f16ba98 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:41.280004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b500a-c47b-4a28-99a7-8f6e53b2951d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:41.281100 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b500a-c47b-4a28-99a7-8f6e53b2951d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:41.281586 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b500a-c47b-4a28-99a7-8f6e53b2951d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:41.282689 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b500a-c47b-4a28-99a7-8f6e53b2951d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:41.285376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:41.292855 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b500a-c47b-4a28-99a7-8f6e53b2951d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:41.294699 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b500a-c47b-4a28-99a7-8f6e53b2951d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:41.308155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-5d7b500a-c47b-4a28-99a7-8f6e53b2951d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:41.308155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:41.308155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:41.308155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:41.308155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:41.308155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:41.308155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:41.308155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:41.308155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:41.308155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:41.308155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:41.308155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:41.308155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:41.308155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:41.308155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:41.309199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:41.309199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:41.309199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:41.309199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:41.309199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:41.309199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:41.309199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:41.309199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:41.309199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:41.309199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:41.309199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:41.309199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:41.309199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:41.309199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:41.309199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:41.309199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:41.309199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:41.310084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:41.310084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:41.310084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:41.310084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:41.310084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:41.310084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:41.310084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:41.310084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:41.313024 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 427/830] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:41.319978 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49c830-0d56-4c04-a9ec-6897b074956c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:41.424250 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:41.440781 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49c830-0d56-4c04-a9ec-6897b074956c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:41.479359 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63770e24-d587-461c-b00c-d2fcaa824814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:41.480425 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63770e24-d587-461c-b00c-d2fcaa824814 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:41.480916 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63770e24-d587-461c-b00c-d2fcaa824814 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:41.481412 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63770e24-d587-461c-b00c-d2fcaa824814 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:41.482378 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63770e24-d587-461c-b00c-d2fcaa824814 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:41.482954 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63770e24-d587-461c-b00c-d2fcaa824814 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:41.484620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63770e24-d587-461c-b00c-d2fcaa824814 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:41.497914 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 404/831] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:41.505040 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b500a-c47b-4a28-99a7-8f6e53b2951d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:41.619492 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b500a-c47b-4a28-99a7-8f6e53b2951d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:41.656442 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3394bca-240f-4c30-bc89-3d2f06ae6ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:41.657202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3394bca-240f-4c30-bc89-3d2f06ae6ffb None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:41.657486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3394bca-240f-4c30-bc89-3d2f06ae6ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:41.657766 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3394bca-240f-4c30-bc89-3d2f06ae6ffb None admin] PATH_INFO: `/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/878797620be54b74a3e8582c78ba78d2/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:41.659764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3394bca-240f-4c30-bc89-3d2f06ae6ffb None admin] RBAC: Authorizing `identity:create_grant(project_id=7e37543156ee42a0818bf5cfe747fdc2, user_id=878797620be54b74a3e8582c78ba78d2, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:41.661250 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3394bca-240f-4c30-bc89-3d2f06ae6ffb None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:41.676636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 428/832] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:12:41 2022] PUT /identity/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/878797620be54b74a3e8582c78ba78d2/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:12:42.496443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2805e40-a5bf-457a-866e-8ddc1f0efe98 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:42.496967 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2805e40-a5bf-457a-866e-8ddc1f0efe98 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:42.497258 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2805e40-a5bf-457a-866e-8ddc1f0efe98 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:42.499421 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 405/833] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:42.504861 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdf612-dd11-4727-a163-e66fbb747918 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:42.505333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdf612-dd11-4727-a163-e66fbb747918 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:42.505411 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdf612-dd11-4727-a163-e66fbb747918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:42.524329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1bfdf612-dd11-4727-a163-e66fbb747918 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:42.525510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1bfdf612-dd11-4727-a163-e66fbb747918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:42.574640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:42.600292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 429/834] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 10:12:42.617347 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2805e40-a5bf-457a-866e-8ddc1f0efe98 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:42.729186 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2805e40-a5bf-457a-866e-8ddc1f0efe98 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:42.745867 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828e30e-1345-4a57-962f-860549475c2c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:42.746164 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828e30e-1345-4a57-962f-860549475c2c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:42.746501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828e30e-1345-4a57-962f-860549475c2c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:42.752612 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 430/835] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:42.755561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2c81e-58e1-45d0-8130-4103735652e1 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:42.755873 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2c81e-58e1-45d0-8130-4103735652e1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:42.756116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2c81e-58e1-45d0-8130-4103735652e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:42.772830 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03592f09-dc73-4745-ae52-df1b2d23512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:42.773487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03592f09-dc73-4745-ae52-df1b2d23512e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:42.773773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03592f09-dc73-4745-ae52-df1b2d23512e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:42.774054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03592f09-dc73-4745-ae52-df1b2d23512e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:42.783249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-54c2c81e-58e1-45d0-8130-4103735652e1 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:42.784927 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-54c2c81e-58e1-45d0-8130-4103735652e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:42.785628 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03592f09-dc73-4745-ae52-df1b2d23512e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:42.790589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-03592f09-dc73-4745-ae52-df1b2d23512e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:42.790589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:42.790589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:42.790589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:42.790589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:42.790589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:42.790589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:42.790589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:42.790589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:42.790589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:42.790589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:42.790589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:42.790589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:42.790589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:42.790589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:42.790589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:42.791502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:42.791502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:42.791502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:42.791502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:42.791502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:42.791502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:42.791502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:42.791502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:42.791502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:42.791502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:42.791502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:42.791502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:42.791502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:42.791502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:42.791502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:42.791502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:42.797286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:42.797286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:42.797286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:42.797286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:42.797286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:42.797286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:42.797286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:42.797286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:42.797286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:42.797286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:42.797286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:12:42.797286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:42.797286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 406/836] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:12:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:42.799879 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03592f09-dc73-4745-ae52-df1b2d23512e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:42.812091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:42.875945 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 431/837] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:42.897342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2c81e-58e1-45d0-8130-4103735652e1 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:42.928192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03592f09-dc73-4745-ae52-df1b2d23512e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:42.963051 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf50c77-0085-460a-9bb8-b7f11e757e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:42.963723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf50c77-0085-460a-9bb8-b7f11e757e8d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:42.964014 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf50c77-0085-460a-9bb8-b7f11e757e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:42.964342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf50c77-0085-460a-9bb8-b7f11e757e8d None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:42.965215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf50c77-0085-460a-9bb8-b7f11e757e8d None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:42.965630 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf50c77-0085-460a-9bb8-b7f11e757e8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:42.967001 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf50c77-0085-460a-9bb8-b7f11e757e8d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:42.976774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 407/838] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:12:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:42.982430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf50c77-0085-460a-9bb8-b7f11e757e8d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:43.007043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2c81e-58e1-45d0-8130-4103735652e1 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:43.031215 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:43.075802 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:43.087052 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5c5fa-202d-4052-82df-18898b90b038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:43.090580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5c5fa-202d-4052-82df-18898b90b038 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:43.092009 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5c5fa-202d-4052-82df-18898b90b038 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:43.092844 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5c5fa-202d-4052-82df-18898b90b038 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:43.095762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5c5fa-202d-4052-82df-18898b90b038 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:43.099508 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5c5fa-202d-4052-82df-18898b90b038 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:43.120159 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf50c77-0085-460a-9bb8-b7f11e757e8d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:43.124799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-f1e5c5fa-202d-4052-82df-18898b90b038 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 10:12:43.124799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:43.124799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:12:43.124799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:12:43.124799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:12:43.124799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:12:43.124799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:12:43.124799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:43.124799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 10:12:43.124799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:43.124799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:43.124799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:43.124799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:43.124799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:43.124799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:43.124799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:43.124799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:43.126580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:43.126580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:43.126580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:43.126580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:43.126580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:43.126580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:43.126580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:12:43.126580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:12:43.126580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:12:43.126580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:12:43.126580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:43.126580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:43.126580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:43.126580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:43.126580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:43.126580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:43.129310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:43.129310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:43.129310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:43.129310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:43.129310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:43.129310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:43.129310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:43.129310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:43.129310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:43.129310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:43.129310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:12:43.129310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:43.129310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 10:12:43.129310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:43.134133 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 432/839] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:12:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:43.142475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5c5fa-202d-4052-82df-18898b90b038 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:43.168404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db54650-78c1-426c-a5ab-df7c787644c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:43.168848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db54650-78c1-426c-a5ab-df7c787644c0 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:43.169014 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db54650-78c1-426c-a5ab-df7c787644c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:43.169237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db54650-78c1-426c-a5ab-df7c787644c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:43.182261 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db54650-78c1-426c-a5ab-df7c787644c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:43.183864 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db54650-78c1-426c-a5ab-df7c787644c0 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:43.201217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-7db54650-78c1-426c-a5ab-df7c787644c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:43.201217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:43.201217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:43.201217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:43.201217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:43.201217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:43.201217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:43.201217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:43.201217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:43.201217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:43.201217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:43.201217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:43.201217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:43.201217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:43.201217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:43.202180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:43.202180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:43.202180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:43.202180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:43.202180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:43.202180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:43.202180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:43.202180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:43.202180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:43.202180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:43.202180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:43.202180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:43.202180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:43.202180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:43.202180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:43.202180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:43.202180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:43.204358 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:43.204358 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:43.204358 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:43.204358 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:43.208688 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 408/840] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:43.209032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db54650-78c1-426c-a5ab-df7c787644c0 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:43.297382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5c5fa-202d-4052-82df-18898b90b038 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:43.328467 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db54650-78c1-426c-a5ab-df7c787644c0 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:43.345289 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f221ff5-df25-47f5-bbd9-da48d9218b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:43.346631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f221ff5-df25-47f5-bbd9-da48d9218b6f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:43.347369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f221ff5-df25-47f5-bbd9-da48d9218b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:43.347872 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f221ff5-df25-47f5-bbd9-da48d9218b6f None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:43.348985 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f221ff5-df25-47f5-bbd9-da48d9218b6f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:43.349297 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f221ff5-df25-47f5-bbd9-da48d9218b6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:43.350685 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f221ff5-df25-47f5-bbd9-da48d9218b6f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:43.361656 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 433/841] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:12:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:43.363005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:43.363247 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f221ff5-df25-47f5-bbd9-da48d9218b6f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:43.385241 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c915867-3866-4e99-b59b-745c4fa9dc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:43.385879 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c915867-3866-4e99-b59b-745c4fa9dc4d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:43.386185 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c915867-3866-4e99-b59b-745c4fa9dc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:43.386466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c915867-3866-4e99-b59b-745c4fa9dc4d None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:43.387170 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c915867-3866-4e99-b59b-745c4fa9dc4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:43.387478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c915867-3866-4e99-b59b-745c4fa9dc4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:43.388892 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c915867-3866-4e99-b59b-745c4fa9dc4d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:43.409043 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 409/842] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:43.409043 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e4742-905c-495b-8a8e-24eb128f2750 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:43.409043 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e4742-905c-495b-8a8e-24eb128f2750 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:43.409043 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e4742-905c-495b-8a8e-24eb128f2750 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:43.409043 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 410/843] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:43.410065 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e4742-905c-495b-8a8e-24eb128f2750 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:43.423552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:43.488595 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f221ff5-df25-47f5-bbd9-da48d9218b6f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:43.522205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e4742-905c-495b-8a8e-24eb128f2750 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:43.522727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669538b-ed49-4388-8b59-93e05a3370da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:43.523350 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669538b-ed49-4388-8b59-93e05a3370da None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:43.523622 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669538b-ed49-4388-8b59-93e05a3370da None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:43.523921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669538b-ed49-4388-8b59-93e05a3370da None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:43.524637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669538b-ed49-4388-8b59-93e05a3370da None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:43.524942 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669538b-ed49-4388-8b59-93e05a3370da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:43.526313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669538b-ed49-4388-8b59-93e05a3370da None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:43.530839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 434/844] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:12:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:43.531795 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a628e-239b-4add-a168-985b40bf3d5d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:43.532726 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a628e-239b-4add-a168-985b40bf3d5d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:43.533006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a628e-239b-4add-a168-985b40bf3d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:43.561536 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-742a628e-239b-4add-a168-985b40bf3d5d None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:43.564550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-742a628e-239b-4add-a168-985b40bf3d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:43.575602 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ad596-4ecf-43e3-9f7f-e11adbe27d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:43.576308 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ad596-4ecf-43e3-9f7f-e11adbe27d0f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:43.576701 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ad596-4ecf-43e3-9f7f-e11adbe27d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:43.576980 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ad596-4ecf-43e3-9f7f-e11adbe27d0f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:43.585821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ad596-4ecf-43e3-9f7f-e11adbe27d0f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:43.587357 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ad596-4ecf-43e3-9f7f-e11adbe27d0f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:43.600607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-e92ad596-4ecf-43e3-9f7f-e11adbe27d0f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 10:12:43.600607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:43.600607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:43.600607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:43.600607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:43.600607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:43.600607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:43.600607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:43.600607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:43.600607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:43.600607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:43.600607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:43.600607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:43.600607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:43.600607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:43.600607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:43.601613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:43.601613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:43.601613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:43.601613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:43.601613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:43.601613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:43.601613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:43.601613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:43.601613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:43.601613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:43.601613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:43.601613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:43.601613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:43.601613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:43.601613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:43.601613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:43.601613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:43.601613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:43.602538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:43.602538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:43.602538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:43.602538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:43.602538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:43.602538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:43.602538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:43.602538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:43.602538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 10:12:43.602538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:43.606654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 411/845] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Aug 4 10:12:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:43.607653 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ad596-4ecf-43e3-9f7f-e11adbe27d0f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:43.658432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 435/846] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:43.678120 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:43.681322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a628e-239b-4add-a168-985b40bf3d5d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:43.744198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ad596-4ecf-43e3-9f7f-e11adbe27d0f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:43.750290 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:43.787645 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d37bc-3675-42b1-821e-424c2a8e933a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:43.788415 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d37bc-3675-42b1-821e-424c2a8e933a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:43.788745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d37bc-3675-42b1-821e-424c2a8e933a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:43.789023 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d37bc-3675-42b1-821e-424c2a8e933a None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:43.789838 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d37bc-3675-42b1-821e-424c2a8e933a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:43.790150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d37bc-3675-42b1-821e-424c2a8e933a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:43.791699 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d37bc-3675-42b1-821e-424c2a8e933a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:43.813000 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 412/847] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Aug 4 10:12:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:43.818355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4c8bf-123f-4ac0-a3c1-f9cb9015a9d0 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:43.818728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4c8bf-123f-4ac0-a3c1-f9cb9015a9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:43.819021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4c8bf-123f-4ac0-a3c1-f9cb9015a9d0 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:43.820372 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 413/848] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:12:43.821065 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4c8bf-123f-4ac0-a3c1-f9cb9015a9d0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:43.828001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a628e-239b-4add-a168-985b40bf3d5d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:43.867682 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f14ad-c285-4883-a869-c0073e7186d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:43.868506 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f14ad-c285-4883-a869-c0073e7186d8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:43.868781 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f14ad-c285-4883-a869-c0073e7186d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:43.869062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f14ad-c285-4883-a869-c0073e7186d8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:43.869698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f14ad-c285-4883-a869-c0073e7186d8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:43.871079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f14ad-c285-4883-a869-c0073e7186d8 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:43.880486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-ad9f14ad-c285-4883-a869-c0073e7186d8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 10:12:43.880486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:43.880486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:12:43.880486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:12:43.880486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:12:43.880486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:12:43.880486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:12:43.880486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:43.880486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 10:12:43.880486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:43.880486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:43.880486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:43.880486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:43.880486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:43.880486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:43.880486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:43.881422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:43.881422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:43.881422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:43.881422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:43.881422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:43.881422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:43.881422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:43.881422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:12:43.881422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:12:43.881422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:12:43.881422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:12:43.881422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:43.881422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:43.881422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:43.881422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:43.881422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:43.882238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:43.882238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:43.882238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:43.882238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:43.882238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:43.882238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:43.882238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:43.882238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:43.882238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:43.882238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:43.882238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:43.882238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:12:43.882238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:43.882238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 10:12:43.882238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:43.882238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 436/849] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Aug 4 10:12:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:43.883713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa1cb0-989a-45bd-8c39-fb399d43aff9 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:43.883713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa1cb0-989a-45bd-8c39-fb399d43aff9 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:43.883713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa1cb0-989a-45bd-8c39-fb399d43aff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:43.902530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7ffa1cb0-989a-45bd-8c39-fb399d43aff9 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:43.903727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7ffa1cb0-989a-45bd-8c39-fb399d43aff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:43.932032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:43.937760 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4c8bf-123f-4ac0-a3c1-f9cb9015a9d0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:43.975563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79189033-23bc-41d8-95db-baeea6d6ff96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:43.976509 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79189033-23bc-41d8-95db-baeea6d6ff96 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:43.976622 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 437/850] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:43.977302 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa1cb0-989a-45bd-8c39-fb399d43aff9 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:43.988473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79189033-23bc-41d8-95db-baeea6d6ff96 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:43.989436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79189033-23bc-41d8-95db-baeea6d6ff96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:44.008547 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:44.074519 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79189033-23bc-41d8-95db-baeea6d6ff96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:44.075884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79189033-23bc-41d8-95db-baeea6d6ff96 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:44.083827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa1cb0-989a-45bd-8c39-fb399d43aff9 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:44.121507 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2e82d-3661-4f57-9a37-c5b5b1c3079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:44.122372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2e82d-3661-4f57-9a37-c5b5b1c3079c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:44.122817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2e82d-3661-4f57-9a37-c5b5b1c3079c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:44.123095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2e82d-3661-4f57-9a37-c5b5b1c3079c None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:44.124079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2e82d-3661-4f57-9a37-c5b5b1c3079c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:44.124079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2e82d-3661-4f57-9a37-c5b5b1c3079c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:44.125467 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2e82d-3661-4f57-9a37-c5b5b1c3079c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:44.130757 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 438/851] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Aug 4 10:12:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:44.131353 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2e82d-3661-4f57-9a37-c5b5b1c3079c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:44.182513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:44.191262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 414/852] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:12:43 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:12:44.191262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79189033-23bc-41d8-95db-baeea6d6ff96 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:44.236615 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:44.244609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2e82d-3661-4f57-9a37-c5b5b1c3079c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:44.280667 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bf0a3-2678-499d-b569-0e8b38879a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:44.281426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bf0a3-2678-499d-b569-0e8b38879a54 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:44.281716 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bf0a3-2678-499d-b569-0e8b38879a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:44.282605 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bf0a3-2678-499d-b569-0e8b38879a54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:44.292989 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bf0a3-2678-499d-b569-0e8b38879a54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:44.294618 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79189033-23bc-41d8-95db-baeea6d6ff96 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:44.298393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-b52bf0a3-2678-499d-b569-0e8b38879a54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:12:44.298393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:44.298393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:44.298393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:44.298393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:44.298393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:44.298393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:44.298393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:44.298393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:44.298393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:44.298393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:44.298393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:44.298393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:44.298393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:44.298393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:44.298393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:44.299355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:44.299355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:44.299355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:44.299355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:44.299355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:44.299355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:44.299355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:44.299355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:44.299355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:44.299355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:44.299355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:44.299355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:44.299355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:44.299355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:44.299355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:44.299355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:44.300152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:44.300152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:44.300152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:44.300152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:44.300152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:44.300152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:44.300152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:44.300152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:44.300152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:44.300152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:44.300152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:12:44.300152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:44.300152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 439/853] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:12:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:44.300875 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bf0a3-2678-499d-b569-0e8b38879a54 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:44.336762 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6265f5-9e49-45a9-9f87-a99bae27f063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:44.337619 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6265f5-9e49-45a9-9f87-a99bae27f063 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:44.337902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6265f5-9e49-45a9-9f87-a99bae27f063 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:44.338172 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6265f5-9e49-45a9-9f87-a99bae27f063 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:44.338847 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6265f5-9e49-45a9-9f87-a99bae27f063 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:44.339149 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6265f5-9e49-45a9-9f87-a99bae27f063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:44.340519 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6265f5-9e49-45a9-9f87-a99bae27f063 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:44.356204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 415/854] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Aug 4 10:12:44 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:44.356204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6265f5-9e49-45a9-9f87-a99bae27f063 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:44.430425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bf0a3-2678-499d-b569-0e8b38879a54 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:44.445669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:44.472606 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37f466-2aa7-4dad-8bfb-684b69d555f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:44.473665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f466-2aa7-4dad-8bfb-684b69d555f9 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:44.474035 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f466-2aa7-4dad-8bfb-684b69d555f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:44.474317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37f466-2aa7-4dad-8bfb-684b69d555f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:44.488884 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37f466-2aa7-4dad-8bfb-684b69d555f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:44.491386 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37f466-2aa7-4dad-8bfb-684b69d555f9 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:44.499306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6265f5-9e49-45a9-9f87-a99bae27f063 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:44.508324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-da37f466-2aa7-4dad-8bfb-684b69d555f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:44.508324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:44.508324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:44.508324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:44.508324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:44.508324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:44.508324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:44.508324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:44.508324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:44.508324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:44.508324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:44.508324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:44.508324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:44.508324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:44.508324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:44.509251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:44.509251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:44.509251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:44.509251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:44.509251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:44.509251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:44.509251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:44.509251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:44.509251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:44.509251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:44.509251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:44.509251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:44.509251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:44.509251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:44.509251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:44.509251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:44.509251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:44.510115 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:44.510115 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:44.510115 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:44.510115 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:44.510115 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 440/855] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:44.515325 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37f466-2aa7-4dad-8bfb-684b69d555f9 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:44.528101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:44.550361 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda5813-0c91-4f25-80d7-1932cc9a7011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:44.550995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda5813-0c91-4f25-80d7-1932cc9a7011 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:44.551279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda5813-0c91-4f25-80d7-1932cc9a7011 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:44.551558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda5813-0c91-4f25-80d7-1932cc9a7011 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:44.552328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda5813-0c91-4f25-80d7-1932cc9a7011 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:44.552645 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda5813-0c91-4f25-80d7-1932cc9a7011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:44.554021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda5813-0c91-4f25-80d7-1932cc9a7011 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:44.563969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 416/856] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:12:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:44.569656 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda5813-0c91-4f25-80d7-1932cc9a7011 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:44.644784 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37f466-2aa7-4dad-8bfb-684b69d555f9 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:44.682536 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b3e69-28c6-4082-bde8-6f64c3cd8095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:44.683174 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3e69-28c6-4082-bde8-6f64c3cd8095 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:44.683456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3e69-28c6-4082-bde8-6f64c3cd8095 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:44.683731 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3e69-28c6-4082-bde8-6f64c3cd8095 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:44.684459 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b3e69-28c6-4082-bde8-6f64c3cd8095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:44.684770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b3e69-28c6-4082-bde8-6f64c3cd8095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:44.686480 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b3e69-28c6-4082-bde8-6f64c3cd8095 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:44.689091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda5813-0c91-4f25-80d7-1932cc9a7011 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:44.707194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 441/857] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:44.708195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b3e69-28c6-4082-bde8-6f64c3cd8095 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:44.723882 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:44.738815 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fe8ce-938c-42f1-8aa1-e22fcd68e14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:44.740153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fe8ce-938c-42f1-8aa1-e22fcd68e14c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:44.740911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fe8ce-938c-42f1-8aa1-e22fcd68e14c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:44.741412 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fe8ce-938c-42f1-8aa1-e22fcd68e14c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:44.757869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fe8ce-938c-42f1-8aa1-e22fcd68e14c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:44.760143 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fe8ce-938c-42f1-8aa1-e22fcd68e14c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:44.780702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-168fe8ce-938c-42f1-8aa1-e22fcd68e14c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:44.780702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:44.780702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:44.780702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:44.780702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:44.780702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:44.780702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:44.780702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:44.780702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:44.780702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:44.780702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:44.780702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:44.780702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:44.780702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:44.780702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:44.781669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:44.781669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:44.781669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:44.781669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:44.781669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:44.781669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:44.781669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:44.781669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:44.781669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:44.781669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:44.781669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:44.781669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:44.781669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:44.781669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:44.781669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:44.781669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:44.781669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:44.782646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:44.782646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:44.782646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:44.782646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:44.785495 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 417/858] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:44.788716 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:44.791665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fe8ce-938c-42f1-8aa1-e22fcd68e14c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:44.830424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b3e69-28c6-4082-bde8-6f64c3cd8095 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:44.874747 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84164c20-9725-4cc0-bfcf-dc0a0776cd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:44.875322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84164c20-9725-4cc0-bfcf-dc0a0776cd9f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:44.875659 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84164c20-9725-4cc0-bfcf-dc0a0776cd9f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:44.876514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84164c20-9725-4cc0-bfcf-dc0a0776cd9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:44.886395 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84164c20-9725-4cc0-bfcf-dc0a0776cd9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:44.888159 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84164c20-9725-4cc0-bfcf-dc0a0776cd9f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:44.903763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-84164c20-9725-4cc0-bfcf-dc0a0776cd9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:44.903763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:44.903763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:44.903763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:44.903763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:44.903763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:44.903763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:44.903763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:44.903763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:44.903763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:44.903763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:44.903763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:44.903763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:44.903763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:44.903763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:44.904707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:44.904707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:44.904707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:44.904707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:44.904707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:44.904707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:44.904707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:44.904707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:44.904707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:44.904707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:44.904707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:44.904707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:44.904707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:44.904707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:44.904707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:44.904707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:44.904707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:44.905574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:44.905574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:44.905574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:44.905574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:44.905574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:44.905574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:44.905574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:44.905574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:44.908301 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 442/859] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:44.910799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84164c20-9725-4cc0-bfcf-dc0a0776cd9f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:44.930022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fe8ce-938c-42f1-8aa1-e22fcd68e14c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:44.966145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368dab8-4ed2-4c77-be5b-4c295f0cc173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:44.966852 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368dab8-4ed2-4c77-be5b-4c295f0cc173 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:44.967138 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368dab8-4ed2-4c77-be5b-4c295f0cc173 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:44.967416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368dab8-4ed2-4c77-be5b-4c295f0cc173 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:44.968182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368dab8-4ed2-4c77-be5b-4c295f0cc173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:44.968498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368dab8-4ed2-4c77-be5b-4c295f0cc173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:44.970769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368dab8-4ed2-4c77-be5b-4c295f0cc173 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:44.987466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 418/860] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:44.988510 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368dab8-4ed2-4c77-be5b-4c295f0cc173 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:45.030173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:45.051540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84164c20-9725-4cc0-bfcf-dc0a0776cd9f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:45.081805 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:45.094278 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3109d0-ecd2-4a83-8e70-203ba3ca1e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:45.095186 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3109d0-ecd2-4a83-8e70-203ba3ca1e3f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:45.095564 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3109d0-ecd2-4a83-8e70-203ba3ca1e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:45.095938 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3109d0-ecd2-4a83-8e70-203ba3ca1e3f None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:45.096986 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3109d0-ecd2-4a83-8e70-203ba3ca1e3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:45.097550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3109d0-ecd2-4a83-8e70-203ba3ca1e3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:45.099095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3109d0-ecd2-4a83-8e70-203ba3ca1e3f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:45.118095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 443/861] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:45.119177 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3109d0-ecd2-4a83-8e70-203ba3ca1e3f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:45.121570 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368dab8-4ed2-4c77-be5b-4c295f0cc173 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:45.159774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1162a8-7775-4243-b37b-3629ddeb0487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:45.160192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1162a8-7775-4243-b37b-3629ddeb0487 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:45.160582 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1162a8-7775-4243-b37b-3629ddeb0487 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:45.160952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1162a8-7775-4243-b37b-3629ddeb0487 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:45.168909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1162a8-7775-4243-b37b-3629ddeb0487 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:45.170701 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1162a8-7775-4243-b37b-3629ddeb0487 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:45.182772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-ba1162a8-7775-4243-b37b-3629ddeb0487 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 10:12:45.182772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:45.182772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:45.182772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:45.182772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:45.182772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:45.182772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:45.182772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:45.182772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:45.182772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:45.182772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:45.182772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:45.182772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:45.182772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:45.182772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:45.182772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:45.183894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:45.183894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:45.183894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:45.183894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:45.183894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:45.183894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:45.183894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:45.183894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:45.183894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:45.183894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:45.183894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:45.183894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:45.183894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:45.183894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:45.183894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:45.183894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:45.183894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:45.183894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:45.185064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:45.185064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:45.185064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:45.185064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:45.185064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:45.185064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:45.185064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:45.185064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:45.185064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 10:12:45.185064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:45.191965 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 419/862] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:12:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:45.193298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1162a8-7775-4243-b37b-3629ddeb0487 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:45.238425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3109d0-ecd2-4a83-8e70-203ba3ca1e3f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:45.275989 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1c90d-c5bc-49d2-a8fb-7037d7f66acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:45.276924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1c90d-c5bc-49d2-a8fb-7037d7f66acb None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:45.277393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1c90d-c5bc-49d2-a8fb-7037d7f66acb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:45.277805 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1c90d-c5bc-49d2-a8fb-7037d7f66acb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:45.278756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1c90d-c5bc-49d2-a8fb-7037d7f66acb None admin] RBAC: Adding query filter params (role.id=88ed5b6546c64ac09d03064e12ca7f10, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=306a5f4d7e0d44bd9a27145bd35a07fc) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:45.279213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1c90d-c5bc-49d2-a8fb-7037d7f66acb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:45.280896 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1c90d-c5bc-49d2-a8fb-7037d7f66acb None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:45.293230 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 444/863] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:12:45 2022] GET /identity/v3/role_assignments?user.id=306a5f4d7e0d44bd9a27145bd35a07fc&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=88ed5b6546c64ac09d03064e12ca7f10 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:45.296134 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:45.301840 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1162a8-7775-4243-b37b-3629ddeb0487 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:45.341516 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bc72f-28bf-437e-b62f-8b057652f183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:45.342376 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bc72f-28bf-437e-b62f-8b057652f183 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:45.342756 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bc72f-28bf-437e-b62f-8b057652f183 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:45.343148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bc72f-28bf-437e-b62f-8b057652f183 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:45.344077 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bc72f-28bf-437e-b62f-8b057652f183 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:45.344567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bc72f-28bf-437e-b62f-8b057652f183 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:45.346354 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bc72f-28bf-437e-b62f-8b057652f183 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:45.367646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 420/864] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Aug 4 10:12:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:45.373628 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1c90d-c5bc-49d2-a8fb-7037d7f66acb None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:45.434224 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:45.496424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1c90d-c5bc-49d2-a8fb-7037d7f66acb None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:45.539505 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ad161-4b82-4640-89d0-6b211184a82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:45.540297 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ad161-4b82-4640-89d0-6b211184a82f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:45.540560 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ad161-4b82-4640-89d0-6b211184a82f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:45.540836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ad161-4b82-4640-89d0-6b211184a82f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:45.620632 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ad161-4b82-4640-89d0-6b211184a82f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:45.620980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ad161-4b82-4640-89d0-6b211184a82f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:45.622762 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fdb90-6d03-44a4-843b-e3191e900d7a None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:45.623214 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fdb90-6d03-44a4-843b-e3191e900d7a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:45.623751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fdb90-6d03-44a4-843b-e3191e900d7a None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:45.624724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 421/865] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:45.631760 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab4c37-7d26-426c-9b78-47fc78041af7 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:45.632065 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab4c37-7d26-426c-9b78-47fc78041af7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:45.632347 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab4c37-7d26-426c-9b78-47fc78041af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:45.654959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-09ab4c37-7d26-426c-9b78-47fc78041af7 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:45.656639 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-09ab4c37-7d26-426c-9b78-47fc78041af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:45.698482 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:45.744474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 422/866] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:45.761754 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 445/867] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:12:45 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:12:45.765406 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab4c37-7d26-426c-9b78-47fc78041af7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:45.766944 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ad161-4b82-4640-89d0-6b211184a82f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:45.863364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:45.884865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab4c37-7d26-426c-9b78-47fc78041af7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:45.898875 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ad161-4b82-4640-89d0-6b211184a82f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:45.925150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1d098-c04f-4759-b74f-67bd4a9e6d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:45.926296 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1d098-c04f-4759-b74f-67bd4a9e6d55 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:45.926784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1d098-c04f-4759-b74f-67bd4a9e6d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:45.927259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1d098-c04f-4759-b74f-67bd4a9e6d55 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:45.928196 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1d098-c04f-4759-b74f-67bd4a9e6d55 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:45.929933 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1d098-c04f-4759-b74f-67bd4a9e6d55 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:45.943014 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de84121-cebe-40d6-8092-2ba0d11ac5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:45.943812 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de84121-cebe-40d6-8092-2ba0d11ac5ef None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:45.943991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de84121-cebe-40d6-8092-2ba0d11ac5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:45.944397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de84121-cebe-40d6-8092-2ba0d11ac5ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:45.956911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 423/868] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Aug 4 10:12:45 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:12:45.961135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de84121-cebe-40d6-8092-2ba0d11ac5ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:45.962820 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de84121-cebe-40d6-8092-2ba0d11ac5ef None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:45.980764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-1de84121-cebe-40d6-8092-2ba0d11ac5ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:45.980764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:45.980764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:45.980764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:45.980764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:45.980764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:45.980764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:45.980764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:45.980764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:45.980764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:45.980764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:45.980764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:45.980764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:45.980764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:45.980764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:45.981698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:45.981698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:45.981698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:45.981698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:45.981698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:45.981698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:45.981698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:45.981698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:45.981698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:45.981698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:45.981698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:45.981698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:45.981698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:45.981698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:45.981698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:45.981698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:45.981698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:45.983022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:45.983022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:45.983022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:45.983022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:45.983022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 446/869] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:45.988933 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1d098-c04f-4759-b74f-67bd4a9e6d55 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:46.136337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1d098-c04f-4759-b74f-67bd4a9e6d55 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:46.175167 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b5fd6-27c1-4ef4-a185-579722a79155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:46.176158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b5fd6-27c1-4ef4-a185-579722a79155 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:46.176715 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b5fd6-27c1-4ef4-a185-579722a79155 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:46.177191 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b5fd6-27c1-4ef4-a185-579722a79155 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:46.178078 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b5fd6-27c1-4ef4-a185-579722a79155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:46.178388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b5fd6-27c1-4ef4-a185-579722a79155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:46.179759 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b5fd6-27c1-4ef4-a185-579722a79155 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:46.192753 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 424/870] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:46.198601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de84121-cebe-40d6-8092-2ba0d11ac5ef None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:46.203358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:46.311812 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de84121-cebe-40d6-8092-2ba0d11ac5ef None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:46.350575 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c6d22-3d93-471d-bde1-bd0b16e01e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:46.351231 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c6d22-3d93-471d-bde1-bd0b16e01e92 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:46.351511 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c6d22-3d93-471d-bde1-bd0b16e01e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:46.351843 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c6d22-3d93-471d-bde1-bd0b16e01e92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:46.359555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c6d22-3d93-471d-bde1-bd0b16e01e92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:46.361922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c6d22-3d93-471d-bde1-bd0b16e01e92 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:46.374333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-6e4c6d22-3d93-471d-bde1-bd0b16e01e92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:46.374333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:46.374333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:46.374333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:46.374333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:46.374333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:46.374333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:46.374333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:46.374333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:46.374333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:46.374333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:46.374333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:46.374333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:46.374333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:46.374333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:46.375262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:46.375262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:46.375262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:46.375262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:46.375262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:46.375262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:46.375262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:46.375262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:46.375262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:46.375262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:46.375262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:46.375262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:46.375262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:46.375262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:46.375262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:46.375262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:46.375262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:46.376762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:46.376762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:46.376762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:46.376762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:46.376762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:46.376762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:46.376762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:46.376762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:46.376762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 447/871] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:46.383578 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b5fd6-27c1-4ef4-a185-579722a79155 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:46.387102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:46.483741 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e59d6-4008-4c17-8eaf-4f60e7bcce79 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:46.484079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e59d6-4008-4c17-8eaf-4f60e7bcce79 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:46.484352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e59d6-4008-4c17-8eaf-4f60e7bcce79 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:46.488053 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 448/872] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:12:46.492677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbed518-29a0-44d7-8efd-c282f63cbbfb None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:46.493038 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbed518-29a0-44d7-8efd-c282f63cbbfb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:46.493237 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbed518-29a0-44d7-8efd-c282f63cbbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:46.502250 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b5fd6-27c1-4ef4-a185-579722a79155 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:46.515032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1bbed518-29a0-44d7-8efd-c282f63cbbfb None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:46.516599 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1bbed518-29a0-44d7-8efd-c282f63cbbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:46.546449 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5f0e6-b9e4-4570-8dea-0bb100972a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:46.547089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5f0e6-b9e4-4570-8dea-0bb100972a10 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:46.547482 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5f0e6-b9e4-4570-8dea-0bb100972a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:46.548484 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5f0e6-b9e4-4570-8dea-0bb100972a10 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:46.549263 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5f0e6-b9e4-4570-8dea-0bb100972a10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:46.549573 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5f0e6-b9e4-4570-8dea-0bb100972a10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:46.551121 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5f0e6-b9e4-4570-8dea-0bb100972a10 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:46.565375 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 425/873] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:46.572522 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5f0e6-b9e4-4570-8dea-0bb100972a10 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:46.586803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:46.606563 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 449/874] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 10:12:46.630408 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbed518-29a0-44d7-8efd-c282f63cbbfb None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:46.663800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:46.720062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5f0e6-b9e4-4570-8dea-0bb100972a10 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:46.743852 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbed518-29a0-44d7-8efd-c282f63cbbfb None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:46.769221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6533c-0339-4e08-b879-4efc2af5d1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:46.770916 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6533c-0339-4e08-b879-4efc2af5d1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:46.771410 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6533c-0339-4e08-b879-4efc2af5d1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:46.772151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6533c-0339-4e08-b879-4efc2af5d1b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:46.773446 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6533c-0339-4e08-b879-4efc2af5d1b0 None admin] RBAC: Adding query filter params (role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=878797620be54b74a3e8582c78ba78d2) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:46.774350 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6533c-0339-4e08-b879-4efc2af5d1b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:46.776549 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6533c-0339-4e08-b879-4efc2af5d1b0 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:46.782800 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba68d5-23d9-42fb-a435-18e8a59b0857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:46.783594 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba68d5-23d9-42fb-a435-18e8a59b0857 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:46.783883 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba68d5-23d9-42fb-a435-18e8a59b0857 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:46.784178 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba68d5-23d9-42fb-a435-18e8a59b0857 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:46.784916 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba68d5-23d9-42fb-a435-18e8a59b0857 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:46.786297 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba68d5-23d9-42fb-a435-18e8a59b0857 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:46.786795 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 426/875] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:12:46 2022] GET /identity/v3/role_assignments?user.id=878797620be54b74a3e8582c78ba78d2&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:46.812519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 450/876] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Aug 4 10:12:46 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:12:47.524786 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d7eef-bcaa-41f6-ba84-1d9514982291 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:47.525190 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d7eef-bcaa-41f6-ba84-1d9514982291 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:47.525366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d7eef-bcaa-41f6-ba84-1d9514982291 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:47.526988 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 427/877] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:47.538230 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5953d-97ce-4780-8dc8-65575fecb20b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:47.538523 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5953d-97ce-4780-8dc8-65575fecb20b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:47.538806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5953d-97ce-4780-8dc8-65575fecb20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:47.568971 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e4b5953d-97ce-4780-8dc8-65575fecb20b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:47.570201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e4b5953d-97ce-4780-8dc8-65575fecb20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:47.628013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:47.656122 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 451/878] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:47.680126 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d7eef-bcaa-41f6-ba84-1d9514982291 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:47.795306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d7eef-bcaa-41f6-ba84-1d9514982291 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:47.823137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:47.833396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f194b6-b912-44b0-82b0-2b8fb09287dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:47.834296 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f194b6-b912-44b0-82b0-2b8fb09287dd None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:47.834789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f194b6-b912-44b0-82b0-2b8fb09287dd None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:47.835243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f194b6-b912-44b0-82b0-2b8fb09287dd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:47.847167 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f194b6-b912-44b0-82b0-2b8fb09287dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:47.852395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-79f194b6-b912-44b0-82b0-2b8fb09287dd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 10:12:47.852395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:47.852395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:47.852395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:47.852395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:47.852395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:47.852395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:47.852395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:47.852395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:47.852395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:47.852395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:47.852395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:47.852395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:47.852395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:47.852395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:47.852395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:47.853280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:47.853280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:47.853280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:47.853280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:47.853280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:47.853280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:47.853280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:47.853280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:47.853280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:47.853280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:47.853280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:47.853280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:47.853280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:47.853280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:47.853280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:47.853280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:47.854092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:47.854092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:47.854092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:47.854092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:47.854092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:47.854092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:47.854092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:47.854092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:47.854092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:47.854092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:47.854092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 10:12:47.854092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:47.856397 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 428/879] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Aug 4 10:12:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:47.862715 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5953d-97ce-4780-8dc8-65575fecb20b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:47.967923 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5953d-97ce-4780-8dc8-65575fecb20b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:48.005179 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b3596-198b-4664-84f8-fc28cfe96a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:48.005830 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b3596-198b-4664-84f8-fc28cfe96a46 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:48.006116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b3596-198b-4664-84f8-fc28cfe96a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:48.006395 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b3596-198b-4664-84f8-fc28cfe96a46 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:48.007193 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b3596-198b-4664-84f8-fc28cfe96a46 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:48.007508 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b3596-198b-4664-84f8-fc28cfe96a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:48.008981 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b3596-198b-4664-84f8-fc28cfe96a46 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:48.020273 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 452/880] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Aug 4 10:12:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:48.026282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f194b6-b912-44b0-82b0-2b8fb09287dd None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:48.107408 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbffb58-1441-406b-80f0-6e50525e5bdf None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:48.107729 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbffb58-1441-406b-80f0-6e50525e5bdf None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:48.107982 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbffb58-1441-406b-80f0-6e50525e5bdf None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:48.109638 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 453/881] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:48.114976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861ad84-4d6c-4669-a9f4-e135b4608179 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:48.115265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861ad84-4d6c-4669-a9f4-e135b4608179 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:48.115550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861ad84-4d6c-4669-a9f4-e135b4608179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:48.134195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7861ad84-4d6c-4669-a9f4-e135b4608179 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:48.135393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7861ad84-4d6c-4669-a9f4-e135b4608179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:48.136433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f194b6-b912-44b0-82b0-2b8fb09287dd None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:48.176664 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:48.187387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4fb8f-730c-47d1-8262-07258089abe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:48.188096 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4fb8f-730c-47d1-8262-07258089abe7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:48.188429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4fb8f-730c-47d1-8262-07258089abe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:48.189329 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4fb8f-730c-47d1-8262-07258089abe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:48.203304 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4fb8f-730c-47d1-8262-07258089abe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:48.205011 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4fb8f-730c-47d1-8262-07258089abe7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:48.221727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-f7e4fb8f-730c-47d1-8262-07258089abe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:48.221727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:48.221727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:48.221727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:48.221727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:48.221727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:48.221727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:48.221727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:48.221727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:48.221727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:48.221727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:48.221727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:48.221727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:48.221727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:48.221727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:48.222758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:48.222758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:48.222758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:48.222758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:48.222758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:48.222758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:48.222758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:48.222758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:48.222758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:48.222758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:48.222758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:48.222758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:48.222758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:48.222758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:48.222758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:48.222758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:48.222758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:48.223625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:48.223625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:48.223625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:48.223625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:48.223625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 429/882] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:48.227779 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 454/883] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 10:12:48.228678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4fb8f-730c-47d1-8262-07258089abe7 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:48.253710 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861ad84-4d6c-4669-a9f4-e135b4608179 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:48.279313 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:48.354716 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4fb8f-730c-47d1-8262-07258089abe7 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:48.375339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861ad84-4d6c-4669-a9f4-e135b4608179 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:48.408205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007886d-1587-4a41-b0d6-b1fb12eb4629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:48.409450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007886d-1587-4a41-b0d6-b1fb12eb4629 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:48.409886 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007886d-1587-4a41-b0d6-b1fb12eb4629 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:48.410310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007886d-1587-4a41-b0d6-b1fb12eb4629 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:48.411183 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007886d-1587-4a41-b0d6-b1fb12eb4629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:48.411835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007886d-1587-4a41-b0d6-b1fb12eb4629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:48.413072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0032a85-5b62-4938-ab95-71fb481698d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:48.413633 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007886d-1587-4a41-b0d6-b1fb12eb4629 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:48.413925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0032a85-5b62-4938-ab95-71fb481698d2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:48.414306 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0032a85-5b62-4938-ab95-71fb481698d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:48.414699 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0032a85-5b62-4938-ab95-71fb481698d2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:48.415424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0032a85-5b62-4938-ab95-71fb481698d2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:48.416937 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0032a85-5b62-4938-ab95-71fb481698d2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:48.427166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-e0032a85-5b62-4938-ab95-71fb481698d2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 10:12:48.427166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:48.427166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:12:48.427166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:12:48.427166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:12:48.427166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:12:48.427166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:12:48.427166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:48.427166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 10:12:48.427166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:48.427166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:48.427166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:48.427166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:48.427166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:48.427166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:48.427166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:48.427166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:48.428435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:48.428435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:48.428435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:48.428435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:48.428435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:48.428435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:48.428435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:12:48.428435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:12:48.428435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:12:48.428435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:12:48.428435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:48.428435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:48.428435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:48.428435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:48.428435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:48.428435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:48.429476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:48.429476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:48.429476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:48.429476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:48.429476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:48.429476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:48.429476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:48.429476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:48.429476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:48.429476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:48.429476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:12:48.429476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:48.429476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 10:12:48.429476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:48.431512 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 455/884] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:12:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:48.432516 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 430/885] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:48.437327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0032a85-5b62-4938-ab95-71fb481698d2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:48.438509 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007886d-1587-4a41-b0d6-b1fb12eb4629 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:48.487707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:48.558182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:48.564195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007886d-1587-4a41-b0d6-b1fb12eb4629 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:48.585416 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0032a85-5b62-4938-ab95-71fb481698d2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:48.601442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2e17c-3b0c-4571-abef-27180a89ee78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:48.602463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2e17c-3b0c-4571-abef-27180a89ee78 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:48.602992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2e17c-3b0c-4571-abef-27180a89ee78 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:48.603469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2e17c-3b0c-4571-abef-27180a89ee78 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:48.612228 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2e17c-3b0c-4571-abef-27180a89ee78 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:48.613940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2e17c-3b0c-4571-abef-27180a89ee78 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:48.630753 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4a11f-4942-4196-90e0-f404a99cd215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:48.631888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-e5d2e17c-3b0c-4571-abef-27180a89ee78 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 10:12:48.631888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:48.631888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:48.631888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:48.631888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:48.631888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:48.631888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:48.631888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:48.631888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:48.631888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:48.631888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:48.631888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:48.631888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:48.631888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:48.631888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:48.631888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:48.632846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:48.632846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:48.632846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:48.632846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:48.632846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:48.632846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:48.632846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:48.632846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:48.632846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:48.632846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:48.632846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:48.632846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:48.632846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:48.632846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:48.632846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:48.632846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:48.632846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:48.632846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:48.633761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:48.633761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:48.633761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:48.633761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:48.633761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:48.633761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:48.633761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:48.633761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:48.633761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 10:12:48.633761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:48.634979 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4a11f-4942-4196-90e0-f404a99cd215 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:48.635477 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4a11f-4942-4196-90e0-f404a99cd215 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:48.635948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4a11f-4942-4196-90e0-f404a99cd215 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:48.636505 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 431/886] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Aug 4 10:12:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:48.637127 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4a11f-4942-4196-90e0-f404a99cd215 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:48.637630 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4a11f-4942-4196-90e0-f404a99cd215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:48.639020 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2e17c-3b0c-4571-abef-27180a89ee78 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:48.640063 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4a11f-4942-4196-90e0-f404a99cd215 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:48.646730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 456/887] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:12:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:48.652515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4a11f-4942-4196-90e0-f404a99cd215 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:48.767641 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:48.771893 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2e17c-3b0c-4571-abef-27180a89ee78 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:48.773160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4a11f-4942-4196-90e0-f404a99cd215 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:48.814028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dc6fa-273d-4fa4-a61d-0b787f863a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:48.815779 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dc6fa-273d-4fa4-a61d-0b787f863a33 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:48.816331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dc6fa-273d-4fa4-a61d-0b787f863a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:48.816807 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dc6fa-273d-4fa4-a61d-0b787f863a33 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:48.817781 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718dc6fa-273d-4fa4-a61d-0b787f863a33 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:48.818359 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718dc6fa-273d-4fa4-a61d-0b787f863a33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:48.819747 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9c930-0156-435e-920a-bb50db11b106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:48.820290 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718dc6fa-273d-4fa4-a61d-0b787f863a33 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:48.820424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9c930-0156-435e-920a-bb50db11b106 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:48.820683 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9c930-0156-435e-920a-bb50db11b106 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:48.820964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9c930-0156-435e-920a-bb50db11b106 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:48.821648 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9c930-0156-435e-920a-bb50db11b106 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:48.821960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9c930-0156-435e-920a-bb50db11b106 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:48.823644 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9c930-0156-435e-920a-bb50db11b106 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:48.835820 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 457/888] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:12:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:48.837425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9c930-0156-435e-920a-bb50db11b106 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:48.850450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 432/889] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Aug 4 10:12:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:48.851408 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dc6fa-273d-4fa4-a61d-0b787f863a33 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:48.871074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:48.956108 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9c930-0156-435e-920a-bb50db11b106 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:48.964004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dc6fa-273d-4fa4-a61d-0b787f863a33 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:48.992662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56332b38-8c34-4835-bcf8-e05e95e45eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:48.993290 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56332b38-8c34-4835-bcf8-e05e95e45eca None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:48.993570 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56332b38-8c34-4835-bcf8-e05e95e45eca None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:48.993844 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56332b38-8c34-4835-bcf8-e05e95e45eca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:48.994599 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56332b38-8c34-4835-bcf8-e05e95e45eca None admin] RBAC: Adding query filter params (interface=public, service_id=4935532f3a4147acadf1b8f0fbb1b434, region_id=RegionOne) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:48.994909 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56332b38-8c34-4835-bcf8-e05e95e45eca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:48.996316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56332b38-8c34-4835-bcf8-e05e95e45eca None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:49.002461 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 458/890] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Aug 4 10:12:48 2022] GET /identity/v3/endpoints?service_id=4935532f3a4147acadf1b8f0fbb1b434&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:49.003678 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345f415-d2d7-4dab-9638-3d5cf3984e6b None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:49.003960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345f415-d2d7-4dab-9638-3d5cf3984e6b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:49.004274 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345f415-d2d7-4dab-9638-3d5cf3984e6b None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:49.005478 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 459/891] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:49.006477 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a985c-3a00-4166-a3d7-65327d9a9f24 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:49.007003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a985c-3a00-4166-a3d7-65327d9a9f24 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:49.007287 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a985c-3a00-4166-a3d7-65327d9a9f24 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:49.008490 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 460/892] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:49.008887 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b3705-7aae-43fd-b554-e0c217613183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:49.009163 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a985c-3a00-4166-a3d7-65327d9a9f24 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:49.010092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b3705-7aae-43fd-b554-e0c217613183 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:49.010380 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b3705-7aae-43fd-b554-e0c217613183 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:49.010657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b3705-7aae-43fd-b554-e0c217613183 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:49.041202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:49.083068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b3705-7aae-43fd-b554-e0c217613183 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:49.084556 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b3705-7aae-43fd-b554-e0c217613183 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:49.101774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:49.121741 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a985c-3a00-4166-a3d7-65327d9a9f24 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:49.157363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210443bd-84e9-4ff4-972c-90d6b8060c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:49.158079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210443bd-84e9-4ff4-972c-90d6b8060c42 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:49.158364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210443bd-84e9-4ff4-972c-90d6b8060c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:49.158642 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210443bd-84e9-4ff4-972c-90d6b8060c42 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:49.159301 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210443bd-84e9-4ff4-972c-90d6b8060c42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:49.160725 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210443bd-84e9-4ff4-972c-90d6b8060c42 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:49.166671 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 461/893] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Aug 4 10:12:49 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:12:49.167760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc34fd-51a2-4fde-a0dc-149b3f443375 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:49.168050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc34fd-51a2-4fde-a0dc-149b3f443375 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:49.168357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc34fd-51a2-4fde-a0dc-149b3f443375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:49.193317 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 433/894] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:12:48 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 10:12:49.193317 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94370ddc-1111-4833-87b2-2887b0cfa6ef None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:49.193317 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94370ddc-1111-4833-87b2-2887b0cfa6ef None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:49.193317 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94370ddc-1111-4833-87b2-2887b0cfa6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:49.200245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d8dc34fd-51a2-4fde-a0dc-149b3f443375 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:49.201510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d8dc34fd-51a2-4fde-a0dc-149b3f443375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:49.209489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-94370ddc-1111-4833-87b2-2887b0cfa6ef None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:49.210665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-94370ddc-1111-4833-87b2-2887b0cfa6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:49.287507 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 462/895] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:49.287507 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc34fd-51a2-4fde-a0dc-149b3f443375 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:49.297264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 434/896] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:49.307798 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94370ddc-1111-4833-87b2-2887b0cfa6ef None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:49.313975 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:49.370079 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:49.407847 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc34fd-51a2-4fde-a0dc-149b3f443375 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:49.429695 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94370ddc-1111-4833-87b2-2887b0cfa6ef None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:49.457879 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d249066-c9f0-4c6d-8e40-119cba5ffce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:49.458923 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d249066-c9f0-4c6d-8e40-119cba5ffce5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:49.459388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d249066-c9f0-4c6d-8e40-119cba5ffce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:49.460084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d249066-c9f0-4c6d-8e40-119cba5ffce5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:49.467356 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7b1d4-70e4-4d1c-bbc3-19dbb873e66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:49.468011 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7b1d4-70e4-4d1c-bbc3-19dbb873e66c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:49.468326 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7b1d4-70e4-4d1c-bbc3-19dbb873e66c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:49.468604 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7b1d4-70e4-4d1c-bbc3-19dbb873e66c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:49.469362 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7b1d4-70e4-4d1c-bbc3-19dbb873e66c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:49.470978 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7b1d4-70e4-4d1c-bbc3-19dbb873e66c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:49.473092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d249066-c9f0-4c6d-8e40-119cba5ffce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:49.474971 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d249066-c9f0-4c6d-8e40-119cba5ffce5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:49.480591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-73a7b1d4-70e4-4d1c-bbc3-19dbb873e66c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 10:12:49.480591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:49.480591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:12:49.480591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:12:49.480591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:12:49.480591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:12:49.480591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:12:49.480591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:49.480591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 10:12:49.480591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:49.480591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:49.480591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:49.480591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:49.480591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:49.480591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:49.480591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:49.480591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:49.481777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:49.481777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:49.481777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:49.481777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:49.481777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:49.481777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:49.481777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:12:49.481777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:12:49.481777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:12:49.481777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:12:49.481777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:49.481777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:49.481777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:49.481777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:49.481777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:49.481777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:49.482844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:49.482844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:49.482844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:49.482844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:49.482844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:49.482844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:49.482844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:49.482844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:49.482844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:49.482844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:49.482844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:12:49.482844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:49.482844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 10:12:49.482844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:49.482844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 435/897] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Aug 4 10:12:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:49.483637 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7b1d4-70e4-4d1c-bbc3-19dbb873e66c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:49.495706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-1d249066-c9f0-4c6d-8e40-119cba5ffce5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:49.495706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:49.495706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:49.495706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:49.495706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:49.495706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:49.495706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:49.495706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:49.495706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:49.495706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:49.495706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:49.495706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:49.495706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:49.495706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:49.495706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:49.496922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:49.496922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:49.496922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:49.496922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:49.496922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:49.496922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:49.496922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:49.496922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:49.496922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:49.496922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:49.496922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:49.496922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:49.496922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:49.496922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:49.496922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:49.496922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:49.496922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:49.498004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:49.498004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:49.498004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:49.498004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:49.504799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 463/898] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:49.504799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d249066-c9f0-4c6d-8e40-119cba5ffce5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:49.585463 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:49.613553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7b1d4-70e4-4d1c-bbc3-19dbb873e66c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:49.619736 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d249066-c9f0-4c6d-8e40-119cba5ffce5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:49.626341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:49.657562 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbc32d-c9bf-47d0-82b1-9e547481d777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:49.658225 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbc32d-c9bf-47d0-82b1-9e547481d777 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:49.658506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbc32d-c9bf-47d0-82b1-9e547481d777 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:49.658788 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbc32d-c9bf-47d0-82b1-9e547481d777 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:49.659425 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbc32d-c9bf-47d0-82b1-9e547481d777 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:49.660222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df8388-9dea-4306-93bc-5f7284508f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:49.660854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbc32d-c9bf-47d0-82b1-9e547481d777 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:49.661565 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df8388-9dea-4306-93bc-5f7284508f2a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:49.662016 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df8388-9dea-4306-93bc-5f7284508f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:49.662461 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df8388-9dea-4306-93bc-5f7284508f2a None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:49.663307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df8388-9dea-4306-93bc-5f7284508f2a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:49.663796 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df8388-9dea-4306-93bc-5f7284508f2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:49.665374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df8388-9dea-4306-93bc-5f7284508f2a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:49.670488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-49fbc32d-c9bf-47d0-82b1-9e547481d777 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 10:12:49.670488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:49.670488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:12:49.670488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:12:49.670488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:12:49.670488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:12:49.670488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:12:49.670488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:49.670488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 10:12:49.670488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:49.670488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:49.670488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:49.670488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:49.670488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:49.670488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:49.670488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:49.671612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:49.671612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:49.671612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:49.671612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:49.671612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:49.671612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:49.671612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:49.671612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:12:49.671612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:12:49.671612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:12:49.671612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:12:49.671612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:49.671612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:49.671612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:49.671612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:49.671612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:49.673541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:49.673541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:49.673541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:49.673541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:49.673541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:49.673541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:49.673541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:49.673541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:49.673541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:49.673541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:49.673541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:49.673541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:12:49.673541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:49.673541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 10:12:49.673541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:49.673541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 436/899] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Aug 4 10:12:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:49.674377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbc32d-c9bf-47d0-82b1-9e547481d777 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:49.674713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 464/900] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Aug 4 10:12:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:49.678027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df8388-9dea-4306-93bc-5f7284508f2a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:49.789893 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df8388-9dea-4306-93bc-5f7284508f2a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:49.796996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbc32d-c9bf-47d0-82b1-9e547481d777 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:49.827602 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f82cbf-7def-4104-b45d-080ae19fc56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:49.828342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f82cbf-7def-4104-b45d-080ae19fc56d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:49.828931 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f82cbf-7def-4104-b45d-080ae19fc56d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:49.828931 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f82cbf-7def-4104-b45d-080ae19fc56d None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:49.829616 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f82cbf-7def-4104-b45d-080ae19fc56d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:49.829927 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f82cbf-7def-4104-b45d-080ae19fc56d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:49.831318 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f82cbf-7def-4104-b45d-080ae19fc56d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:49.833889 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:49.837680 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 465/901] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Aug 4 10:12:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:49.842381 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630ec61-f89b-4d7d-96a7-2397cb2ac4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:49.842381 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630ec61-f89b-4d7d-96a7-2397cb2ac4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:49.842381 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630ec61-f89b-4d7d-96a7-2397cb2ac4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:49.842381 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630ec61-f89b-4d7d-96a7-2397cb2ac4d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:49.842674 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630ec61-f89b-4d7d-96a7-2397cb2ac4d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:49.842674 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630ec61-f89b-4d7d-96a7-2397cb2ac4d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:49.843994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630ec61-f89b-4d7d-96a7-2397cb2ac4d0 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:49.844155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f82cbf-7def-4104-b45d-080ae19fc56d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:49.857437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 437/902] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:49.863400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630ec61-f89b-4d7d-96a7-2397cb2ac4d0 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:49.901877 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:49.958361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f82cbf-7def-4104-b45d-080ae19fc56d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:49.978725 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630ec61-f89b-4d7d-96a7-2397cb2ac4d0 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:49.994658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa4372-3a15-4110-9059-c815e2f2d47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:49.995295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa4372-3a15-4110-9059-c815e2f2d47b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:49.995582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa4372-3a15-4110-9059-c815e2f2d47b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:49.995860 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa4372-3a15-4110-9059-c815e2f2d47b None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:49.996582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa4372-3a15-4110-9059-c815e2f2d47b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:49.996894 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa4372-3a15-4110-9059-c815e2f2d47b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:49.998282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa4372-3a15-4110-9059-c815e2f2d47b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:50.003374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 466/903] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Aug 4 10:12:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:50.004004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa4372-3a15-4110-9059-c815e2f2d47b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:50.039236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38860f-8994-4a0b-bdb0-0841e44fcd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:50.040863 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38860f-8994-4a0b-bdb0-0841e44fcd3c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:50.041261 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38860f-8994-4a0b-bdb0-0841e44fcd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:50.041735 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38860f-8994-4a0b-bdb0-0841e44fcd3c None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:50.042930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38860f-8994-4a0b-bdb0-0841e44fcd3c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:50.043450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38860f-8994-4a0b-bdb0-0841e44fcd3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:50.046041 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38860f-8994-4a0b-bdb0-0841e44fcd3c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:50.055260 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 438/904] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Aug 4 10:12:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:50.063328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38860f-8994-4a0b-bdb0-0841e44fcd3c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:50.128510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:50.205357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa4372-3a15-4110-9059-c815e2f2d47b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:50.251481 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:50.254650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de016dcb-4af8-48c9-9378-3e904ff1b567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:50.255415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de016dcb-4af8-48c9-9378-3e904ff1b567 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:50.255708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de016dcb-4af8-48c9-9378-3e904ff1b567 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:50.255992 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de016dcb-4af8-48c9-9378-3e904ff1b567 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:50.256106 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38860f-8994-4a0b-bdb0-0841e44fcd3c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:50.270264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de016dcb-4af8-48c9-9378-3e904ff1b567 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:50.272577 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de016dcb-4af8-48c9-9378-3e904ff1b567 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:50.290665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-de016dcb-4af8-48c9-9378-3e904ff1b567 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:50.290665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:50.290665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:50.290665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:50.290665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:50.290665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:50.290665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:50.290665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:50.290665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:50.290665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:50.290665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:50.290665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:50.290665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:50.290665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:50.290665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:50.291723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:50.291723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:50.291723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:50.291723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:50.291723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:50.291723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:50.291723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:50.291723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:50.291723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:50.291723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:50.291723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:50.291723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:50.291723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:50.291723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:50.291723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:50.291723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:50.291723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:50.292722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:50.292722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:50.292722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:50.292722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:50.292722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:50.292722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:50.292722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:50.292722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:50.292722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 467/905] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:50.299582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de016dcb-4af8-48c9-9378-3e904ff1b567 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:50.303410 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbde92-25d9-46df-b221-d723000dd26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:50.304051 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbde92-25d9-46df-b221-d723000dd26b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:50.305303 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbde92-25d9-46df-b221-d723000dd26b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:50.305582 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbde92-25d9-46df-b221-d723000dd26b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:50.306365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbde92-25d9-46df-b221-d723000dd26b None admin] RBAC: Adding query filter params (interface=public, service_id=5834c09f05114f0f956cf9569dbd2556, region_id=RegionOne) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:50.306675 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbde92-25d9-46df-b221-d723000dd26b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:50.308203 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbde92-25d9-46df-b221-d723000dd26b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:50.320126 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 439/906] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Aug 4 10:12:50 2022] GET /identity/v3/endpoints?service_id=5834c09f05114f0f956cf9569dbd2556&interface=public®ion_id=RegionOne => generated 194 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:50.326649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbde92-25d9-46df-b221-d723000dd26b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:50.441789 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de016dcb-4af8-48c9-9378-3e904ff1b567 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:50.459825 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbde92-25d9-46df-b221-d723000dd26b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:50.473983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:50.489159 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9c06a-ea5b-40b0-aa76-91bc45f8f5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:50.490816 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9c06a-ea5b-40b0-aa76-91bc45f8f5ac None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:50.491308 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9c06a-ea5b-40b0-aa76-91bc45f8f5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:50.491781 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9c06a-ea5b-40b0-aa76-91bc45f8f5ac None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:50.493430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9c06a-ea5b-40b0-aa76-91bc45f8f5ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:50.494213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9c06a-ea5b-40b0-aa76-91bc45f8f5ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:50.496518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9c06a-ea5b-40b0-aa76-91bc45f8f5ac None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:50.504811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d33fbf-f52d-4a44-b238-5f4ad4a6330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:50.505837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d33fbf-f52d-4a44-b238-5f4ad4a6330b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:50.506328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d33fbf-f52d-4a44-b238-5f4ad4a6330b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:50.506836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d33fbf-f52d-4a44-b238-5f4ad4a6330b None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:50.507818 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d33fbf-f52d-4a44-b238-5f4ad4a6330b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:50.509438 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d33fbf-f52d-4a44-b238-5f4ad4a6330b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:50.515018 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 468/907] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:50.517423 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 440/908] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Aug 4 10:12:50 2022] GET /identity/v3/services => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:12:50.518773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9c06a-ea5b-40b0-aa76-91bc45f8f5ac None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:50.644577 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9c06a-ea5b-40b0-aa76-91bc45f8f5ac None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:50.686438 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53efe8-df19-404f-a07c-03c3959f15d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:50.687082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53efe8-df19-404f-a07c-03c3959f15d6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:50.687336 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53efe8-df19-404f-a07c-03c3959f15d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:50.687609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53efe8-df19-404f-a07c-03c3959f15d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:50.688660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53efe8-df19-404f-a07c-03c3959f15d6 None admin] RBAC: Adding query filter params (role.id=15b22a1f53864b52a7b212d5adf916db, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=306a5f4d7e0d44bd9a27145bd35a07fc) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:50.688971 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53efe8-df19-404f-a07c-03c3959f15d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:50.690641 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a53efe8-df19-404f-a07c-03c3959f15d6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:50.697342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 469/909] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:12:50 2022] GET /identity/v3/role_assignments?user.id=306a5f4d7e0d44bd9a27145bd35a07fc&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=15b22a1f53864b52a7b212d5adf916db => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:51.251841 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a34aa-8007-49b6-8284-a880a313c128 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:51.252427 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a34aa-8007-49b6-8284-a880a313c128 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:51.252427 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a34aa-8007-49b6-8284-a880a313c128 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:51.253923 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 441/910] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:51.259422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51db7e-c7ca-43c5-ad06-595ee88067ce None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:51.259706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51db7e-c7ca-43c5-ad06-595ee88067ce None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:51.259989 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51db7e-c7ca-43c5-ad06-595ee88067ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:51.279056 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6c51db7e-c7ca-43c5-ad06-595ee88067ce None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:51.280362 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6c51db7e-c7ca-43c5-ad06-595ee88067ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:51.331216 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:51.358119 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 470/911] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:51.380577 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a34aa-8007-49b6-8284-a880a313c128 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:51.412597 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:51.496940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a34aa-8007-49b6-8284-a880a313c128 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:51.534453 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103e1c0-1570-4932-b4cd-9bb59e558885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:51.535441 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103e1c0-1570-4932-b4cd-9bb59e558885 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:51.535940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103e1c0-1570-4932-b4cd-9bb59e558885 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:51.536462 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103e1c0-1570-4932-b4cd-9bb59e558885 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:51.537313 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103e1c0-1570-4932-b4cd-9bb59e558885 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:51.538897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103e1c0-1570-4932-b4cd-9bb59e558885 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:51.549165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-b103e1c0-1570-4932-b4cd-9bb59e558885 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 10:12:51.549165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:51.549165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:12:51.549165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:12:51.549165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:12:51.549165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:12:51.549165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:12:51.549165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:51.549165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 10:12:51.549165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:51.549165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:51.549165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:51.549165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:51.549165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:51.549165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:51.549165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:51.549165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:51.550264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:51.550264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:51.550264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:51.550264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:51.550264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:51.550264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:51.550264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:12:51.550264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:12:51.550264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:12:51.550264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:12:51.550264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:51.550264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:51.550264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:51.550264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:51.550264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:51.550264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:51.551125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:51.551125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:51.551125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:51.551125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:51.551125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:51.551125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:51.551125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:51.551125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:51.551125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:51.551125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:51.551125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:12:51.551125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:51.551125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 10:12:51.551125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:51.553635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 442/912] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:12:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:51.560266 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51db7e-c7ca-43c5-ad06-595ee88067ce None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:51.669682 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51db7e-c7ca-43c5-ad06-595ee88067ce None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:51.707147 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2131269-d767-4c4c-8f56-4cae27ab69da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:51.708601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2131269-d767-4c4c-8f56-4cae27ab69da None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:51.709139 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2131269-d767-4c4c-8f56-4cae27ab69da None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:51.709644 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2131269-d767-4c4c-8f56-4cae27ab69da None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:51.710541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2131269-d767-4c4c-8f56-4cae27ab69da None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:51.711059 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2131269-d767-4c4c-8f56-4cae27ab69da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:51.712751 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2131269-d767-4c4c-8f56-4cae27ab69da None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:51.718397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 471/913] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:12:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:51.725258 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103e1c0-1570-4932-b4cd-9bb59e558885 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:51.834960 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:51.846459 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103e1c0-1570-4932-b4cd-9bb59e558885 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:51.884069 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d6cd1-e4f2-4385-b84f-ffc69768c4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:51.884740 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d6cd1-e4f2-4385-b84f-ffc69768c4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:51.885026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d6cd1-e4f2-4385-b84f-ffc69768c4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:51.885305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d6cd1-e4f2-4385-b84f-ffc69768c4c7 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:51.885996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d6cd1-e4f2-4385-b84f-ffc69768c4c7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:51.886309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d6cd1-e4f2-4385-b84f-ffc69768c4c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:51.887691 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d6cd1-e4f2-4385-b84f-ffc69768c4c7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:51.894333 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 443/914] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Aug 4 10:12:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:51.899835 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2131269-d767-4c4c-8f56-4cae27ab69da None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:51.952549 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:52.011026 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2131269-d767-4c4c-8f56-4cae27ab69da None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:52.045854 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74161be-b85e-4e4f-9175-14c6f6387469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:52.046482 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74161be-b85e-4e4f-9175-14c6f6387469 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:52.046764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74161be-b85e-4e4f-9175-14c6f6387469 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:52.047039 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74161be-b85e-4e4f-9175-14c6f6387469 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:52.048374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74161be-b85e-4e4f-9175-14c6f6387469 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:52.049754 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74161be-b85e-4e4f-9175-14c6f6387469 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:52.072221 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 472/915] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:12:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:12:52.184726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253e5f7-2770-4f9d-b645-eb8c726ed553 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:52.184927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253e5f7-2770-4f9d-b645-eb8c726ed553 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:52.185192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253e5f7-2770-4f9d-b645-eb8c726ed553 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:52.187151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 444/916] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:52.193082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2db66-f396-4cb5-ba48-6f81b0ada373 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:52.193370 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2db66-f396-4cb5-ba48-6f81b0ada373 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:52.193640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2db66-f396-4cb5-ba48-6f81b0ada373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:52.213635 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2ce2db66-f396-4cb5-ba48-6f81b0ada373 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:52.214850 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2ce2db66-f396-4cb5-ba48-6f81b0ada373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:52.293882 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 473/917] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:52.316862 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253e5f7-2770-4f9d-b645-eb8c726ed553 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:52.431908 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253e5f7-2770-4f9d-b645-eb8c726ed553 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:52.471609 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c8f7a-253d-4889-adb4-9b476d7f022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:52.472188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c8f7a-253d-4889-adb4-9b476d7f022d None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:52.472474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c8f7a-253d-4889-adb4-9b476d7f022d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:52.472752 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c8f7a-253d-4889-adb4-9b476d7f022d None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:52.473470 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c8f7a-253d-4889-adb4-9b476d7f022d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:52.474858 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c8f7a-253d-4889-adb4-9b476d7f022d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:52.492127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 445/918] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Aug 4 10:12:52 2022] POST /identity/v3/services => generated 241 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:12:52.714856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2756ce-edca-4998-9851-df981fa6e795 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:52.715813 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2756ce-edca-4998-9851-df981fa6e795 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:52.716368 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2756ce-edca-4998-9851-df981fa6e795 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:52.718192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 474/919] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:52.724101 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad84bc0-d101-463d-93fa-931c3f0dd330 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:52.724724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad84bc0-d101-463d-93fa-931c3f0dd330 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:52.725213 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad84bc0-d101-463d-93fa-931c3f0dd330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:52.743698 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-dad84bc0-d101-463d-93fa-931c3f0dd330 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:52.745238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-dad84bc0-d101-463d-93fa-931c3f0dd330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:52.757625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:52.824264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 446/920] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:52.837280 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d5d9e-90bd-4645-87e8-7b13e9e9e00c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:52.837587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d5d9e-90bd-4645-87e8-7b13e9e9e00c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:52.837841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d5d9e-90bd-4645-87e8-7b13e9e9e00c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:52.839528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 475/921] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:12:52.844945 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcad6a-9f65-45b3-b102-90868c5a84c6 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:52.845415 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcad6a-9f65-45b3-b102-90868c5a84c6 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:52.845702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcad6a-9f65-45b3-b102-90868c5a84c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:52.850737 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d5d9e-90bd-4645-87e8-7b13e9e9e00c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:52.865396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-84fcad6a-9f65-45b3-b102-90868c5a84c6 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:52.866622 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-84fcad6a-9f65-45b3-b102-90868c5a84c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:52.881669 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:52.945685 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 447/922] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:52.968455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcad6a-9f65-45b3-b102-90868c5a84c6 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:52.985357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d5d9e-90bd-4645-87e8-7b13e9e9e00c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:53.028925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263b3ac-70cc-4933-b708-368935703ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:53.029589 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263b3ac-70cc-4933-b708-368935703ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:53.030037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263b3ac-70cc-4933-b708-368935703ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:53.030173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263b3ac-70cc-4933-b708-368935703ce1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:53.030758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263b3ac-70cc-4933-b708-368935703ce1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:53.032276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263b3ac-70cc-4933-b708-368935703ce1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:53.041785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-5263b3ac-70cc-4933-b708-368935703ce1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 10:12:53.041785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:53.041785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:12:53.041785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:12:53.041785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:12:53.041785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:12:53.041785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:12:53.041785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:53.041785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 10:12:53.041785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:53.041785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:53.041785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:53.041785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:53.041785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:53.041785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:53.041785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:53.042787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:53.042787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:53.042787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:53.042787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:53.042787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:53.042787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:53.042787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:53.042787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:12:53.042787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:12:53.042787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:12:53.042787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:12:53.042787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:53.042787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:53.042787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:53.042787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:53.042787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:53.043770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:53.043770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:53.043770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:53.043770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:53.043770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:53.043770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:53.043770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:53.043770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:53.043770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:53.043770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:53.043770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:53.043770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:12:53.043770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:53.043770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 10:12:53.043770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:53.043770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 476/923] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Aug 4 10:12:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:53.050138 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263b3ac-70cc-4933-b708-368935703ce1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:53.081623 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcad6a-9f65-45b3-b102-90868c5a84c6 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:53.084477 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:53.122171 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01f9bd-c46e-4125-bdb5-b78e6dbdc711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:53.123227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01f9bd-c46e-4125-bdb5-b78e6dbdc711 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:53.123843 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01f9bd-c46e-4125-bdb5-b78e6dbdc711 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:53.124395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01f9bd-c46e-4125-bdb5-b78e6dbdc711 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:53.136398 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01f9bd-c46e-4125-bdb5-b78e6dbdc711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:53.142341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-cc01f9bd-c46e-4125-bdb5-b78e6dbdc711 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 10:12:53.142341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:53.142341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:53.142341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:53.142341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:53.142341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:53.142341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:53.142341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:53.142341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:53.142341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:53.142341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:53.142341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:53.142341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:53.142341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:53.142341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:53.142341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:53.143276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:53.143276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:53.143276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:53.143276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:53.143276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:53.143276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:53.143276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:53.143276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:53.143276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:53.143276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:53.143276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:53.143276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:53.143276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:53.143276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:53.143276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:53.143276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:53.144084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:53.144084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:53.144084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:53.144084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:53.144084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:53.144084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:53.144084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:53.144084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:53.144084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:53.144084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:53.144084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 10:12:53.144084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:53.146864 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 448/924] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Aug 4 10:12:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:53.156361 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01f9bd-c46e-4125-bdb5-b78e6dbdc711 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:53.165075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:53.180764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263b3ac-70cc-4933-b708-368935703ce1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:53.224409 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73df42-0030-4941-9f26-8918a07143f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:53.225056 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73df42-0030-4941-9f26-8918a07143f2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:53.225341 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73df42-0030-4941-9f26-8918a07143f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:53.225621 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73df42-0030-4941-9f26-8918a07143f2 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:53.226307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73df42-0030-4941-9f26-8918a07143f2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:53.226781 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73df42-0030-4941-9f26-8918a07143f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:53.228644 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73df42-0030-4941-9f26-8918a07143f2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:53.240221 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 477/925] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Aug 4 10:12:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:53.241557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73df42-0030-4941-9f26-8918a07143f2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:53.291478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01f9bd-c46e-4125-bdb5-b78e6dbdc711 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:53.324669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:53.332502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da45c55-f1da-4d59-9982-67f68cb87be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:53.333417 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da45c55-f1da-4d59-9982-67f68cb87be6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:53.333905 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da45c55-f1da-4d59-9982-67f68cb87be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:53.334387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da45c55-f1da-4d59-9982-67f68cb87be6 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:53.335348 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da45c55-f1da-4d59-9982-67f68cb87be6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:53.335870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da45c55-f1da-4d59-9982-67f68cb87be6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:53.337563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da45c55-f1da-4d59-9982-67f68cb87be6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:53.352251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 449/926] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Aug 4 10:12:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:53.353448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da45c55-f1da-4d59-9982-67f68cb87be6 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:53.382467 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73df42-0030-4941-9f26-8918a07143f2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:53.419728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e9956-2562-4d00-a416-7fc4bef4d601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:53.420718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e9956-2562-4d00-a416-7fc4bef4d601 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:53.421207 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e9956-2562-4d00-a416-7fc4bef4d601 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:53.421731 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e9956-2562-4d00-a416-7fc4bef4d601 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:53.423312 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e9956-2562-4d00-a416-7fc4bef4d601 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:53.423857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e9956-2562-4d00-a416-7fc4bef4d601 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:53.425478 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e9956-2562-4d00-a416-7fc4bef4d601 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:53.435616 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 478/927] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Aug 4 10:12:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:53.436960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e9956-2562-4d00-a416-7fc4bef4d601 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:53.456556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:53.482468 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da45c55-f1da-4d59-9982-67f68cb87be6 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:53.519422 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48afee8-e637-45f9-8710-17785cbeb1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:53.520457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48afee8-e637-45f9-8710-17785cbeb1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:53.520968 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48afee8-e637-45f9-8710-17785cbeb1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:53.521467 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48afee8-e637-45f9-8710-17785cbeb1c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:53.534604 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48afee8-e637-45f9-8710-17785cbeb1c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:53.536420 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48afee8-e637-45f9-8710-17785cbeb1c3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:53.552870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-d48afee8-e637-45f9-8710-17785cbeb1c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:53.552870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:53.552870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:53.552870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:53.552870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:53.552870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:53.552870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:53.552870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:53.552870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:53.552870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:53.552870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:53.552870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:53.552870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:53.552870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:53.552870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:53.553816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:53.553816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:53.553816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:53.553816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:53.553816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:53.553816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:53.553816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:53.553816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:53.553816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:53.553816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:53.553816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:53.553816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:53.553816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:53.553816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:53.553816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:53.553816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:53.553816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:53.554691 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:53.554691 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:53.554691 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:53.554691 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:53.561833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 450/928] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:53.562998 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48afee8-e637-45f9-8710-17785cbeb1c3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:53.565678 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e9956-2562-4d00-a416-7fc4bef4d601 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:53.612832 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d451a76-1187-41be-8631-fe117f1853fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:53.613738 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d451a76-1187-41be-8631-fe117f1853fa None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:53.614065 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d451a76-1187-41be-8631-fe117f1853fa None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:53.614361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d451a76-1187-41be-8631-fe117f1853fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:53.615084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d451a76-1187-41be-8631-fe117f1853fa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:53.616075 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:53.617494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d451a76-1187-41be-8631-fe117f1853fa None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:53.661539 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 479/929] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:12:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:12:53.702246 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48afee8-e637-45f9-8710-17785cbeb1c3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:53.755048 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd818b-5297-4a49-8d75-ce969104ac4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:53.755683 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd818b-5297-4a49-8d75-ce969104ac4a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:53.755962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd818b-5297-4a49-8d75-ce969104ac4a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:53.756263 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd818b-5297-4a49-8d75-ce969104ac4a None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:53.756968 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd818b-5297-4a49-8d75-ce969104ac4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:53.757332 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd818b-5297-4a49-8d75-ce969104ac4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:53.758742 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd818b-5297-4a49-8d75-ce969104ac4a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:53.774452 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 451/930] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:53.779731 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d451a76-1187-41be-8631-fe117f1853fa None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:53.864931 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:53.900074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d451a76-1187-41be-8631-fe117f1853fa None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:53.937554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359429c-d509-462d-ac80-5d2ee8a686e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:53.938956 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359429c-d509-462d-ac80-5d2ee8a686e6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:53.939479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359429c-d509-462d-ac80-5d2ee8a686e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:53.939761 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359429c-d509-462d-ac80-5d2ee8a686e6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:53.947643 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359429c-d509-462d-ac80-5d2ee8a686e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:53.949121 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359429c-d509-462d-ac80-5d2ee8a686e6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:53.960775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-f359429c-d509-462d-ac80-5d2ee8a686e6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 10:12:53.960775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:53.960775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:53.960775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:53.960775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:53.960775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:53.960775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:53.960775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:53.960775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:53.960775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:53.960775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:53.960775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:53.960775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:53.960775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:53.960775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:53.960775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:53.961806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:53.961806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:53.961806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:53.961806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:53.961806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:53.961806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:53.961806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:53.961806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:53.961806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:53.961806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:53.961806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:53.961806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:53.961806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:53.961806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:53.961806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:53.961806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:53.961806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:53.961806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:53.962760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:53.962760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:53.962760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:53.962760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:53.962760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:53.962760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:53.962760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:53.962760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:53.962760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 10:12:53.962760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:53.962760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 480/931] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Aug 4 10:12:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:53.969294 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd818b-5297-4a49-8d75-ce969104ac4a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:54.079482 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:54.083747 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd818b-5297-4a49-8d75-ce969104ac4a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:54.125474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50187974-e433-4da8-b489-a108c8bfdad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:54.126445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50187974-e433-4da8-b489-a108c8bfdad6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:54.126730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50187974-e433-4da8-b489-a108c8bfdad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:54.127007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50187974-e433-4da8-b489-a108c8bfdad6 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:54.128005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50187974-e433-4da8-b489-a108c8bfdad6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:54.128350 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50187974-e433-4da8-b489-a108c8bfdad6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:54.129791 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50187974-e433-4da8-b489-a108c8bfdad6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:54.154179 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 452/932] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Aug 4 10:12:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:54.161343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359429c-d509-462d-ac80-5d2ee8a686e6 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:54.212850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a5f3a-cc7d-4f9b-a7a5-caa2fb48067a None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:54.213224 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a5f3a-cc7d-4f9b-a7a5-caa2fb48067a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:54.213414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a5f3a-cc7d-4f9b-a7a5-caa2fb48067a None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:54.215024 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 453/933] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:12:54.220768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6aa9c-aff7-43ac-a3ce-215fb4f33e42 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:54.221053 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6aa9c-aff7-43ac-a3ce-215fb4f33e42 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:54.221327 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6aa9c-aff7-43ac-a3ce-215fb4f33e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:54.243725 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-02f6aa9c-aff7-43ac-a3ce-215fb4f33e42 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:54.245249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-02f6aa9c-aff7-43ac-a3ce-215fb4f33e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:54.284037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359429c-d509-462d-ac80-5d2ee8a686e6 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:54.330163 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:54.338013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406e860-1b16-4bea-a9d9-6523cad13bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:54.339783 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406e860-1b16-4bea-a9d9-6523cad13bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:54.340319 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406e860-1b16-4bea-a9d9-6523cad13bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:54.341232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406e860-1b16-4bea-a9d9-6523cad13bb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:54.355718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 454/934] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 10:12:54.370818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406e860-1b16-4bea-a9d9-6523cad13bb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:54.372688 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406e860-1b16-4bea-a9d9-6523cad13bb9 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:54.379188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6aa9c-aff7-43ac-a3ce-215fb4f33e42 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:54.393320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-f406e860-1b16-4bea-a9d9-6523cad13bb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:54.393320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:54.393320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:54.393320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:54.393320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:54.393320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:54.393320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:54.393320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:54.393320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:54.393320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:54.393320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:54.393320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:54.393320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:54.393320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:54.393320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:54.394537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:54.394537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:54.394537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:54.394537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:54.394537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:54.394537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:54.394537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:54.394537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:54.394537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:54.394537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:54.394537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:54.394537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:54.394537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:54.394537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:54.394537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:54.394537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:54.394537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:54.395387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:54.395387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:54.395387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:54.395387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:54.397993 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 481/935] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:54.405135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406e860-1b16-4bea-a9d9-6523cad13bb9 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:54.502896 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:54.520252 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6aa9c-aff7-43ac-a3ce-215fb4f33e42 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:54.548700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406e860-1b16-4bea-a9d9-6523cad13bb9 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:54.573154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf5cd8-3070-4fb5-976f-1cea296d4946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:54.574720 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf5cd8-3070-4fb5-976f-1cea296d4946 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:54.575498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf5cd8-3070-4fb5-976f-1cea296d4946 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:54.575974 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf5cd8-3070-4fb5-976f-1cea296d4946 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:54.577009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf5cd8-3070-4fb5-976f-1cea296d4946 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:54.579233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf5cd8-3070-4fb5-976f-1cea296d4946 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:54.584342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: WARNING keystone.server.flask.common [None req-bdaf5cd8-3070-4fb5-976f-1cea296d4946 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 04 10:12:54.592424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197f30d-44b8-4b68-b297-8c077771eb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:54.593074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197f30d-44b8-4b68-b297-8c077771eb6f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:54.593355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197f30d-44b8-4b68-b297-8c077771eb6f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:54.593634 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197f30d-44b8-4b68-b297-8c077771eb6f None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:54.595106 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197f30d-44b8-4b68-b297-8c077771eb6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:54.595662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197f30d-44b8-4b68-b297-8c077771eb6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:54.597758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197f30d-44b8-4b68-b297-8c077771eb6f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:54.608660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.sql.core [None req-bdaf5cd8-3070-4fb5-976f-1cea296d4946 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 10:12:54.608660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 10:12:54.608660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [parameters: {'id': '9fd01e0294074c359024c5d7fb9a8297', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 10:12:54.608660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80116) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 10:12:54.618357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 482/936] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:54.619364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197f30d-44b8-4b68-b297-8c077771eb6f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:54.626625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-bdaf5cd8-3070-4fb5-976f-1cea296d4946 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9fd01e0294074c359024c5d7fb9a8297.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9fd01e0294074c359024c5d7fb9a8297. Aug 04 10:12:54.626625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:54.626625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 10:12:54.626625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 10:12:54.626625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 10:12:54.626625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 10:12:54.626625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 10:12:54.626625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 10:12:54.626625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 10:12:54.626625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application conn.query(q) Aug 04 10:12:54.626625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 10:12:54.626625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 10:12:54.626625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 10:12:54.627430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result.read() Aug 04 10:12:54.627430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 10:12:54.627430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 10:12:54.627430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 10:12:54.627430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 10:12:54.627430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 10:12:54.627430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 10:12:54.627430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 10:12:54.627430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 10:12:54.627430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 10:12:54.627430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:54.627430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 10:12:54.627430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:54.627430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:54.627430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 10:12:54.627430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 10:12:54.627430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 04 10:12:54.627430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 04 10:12:54.628821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 10:12:54.628821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application next(self.gen) Aug 04 10:12:54.628821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 10:12:54.628821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application yield resource Aug 04 10:12:54.628821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 10:12:54.628821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application next(self.gen) Aug 04 10:12:54.628821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 10:12:54.628821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 10:12:54.628821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 10:12:54.628821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 10:12:54.628821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 10:12:54.628821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise self.value Aug 04 10:12:54.628821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 10:12:54.628821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 10:12:54.628821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 10:12:54.628821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application session.commit() Aug 04 10:12:54.628821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 10:12:54.629727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 10:12:54.629727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 10:12:54.629727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 10:12:54.629727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 10:12:54.629727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.session.flush() Aug 04 10:12:54.629727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 10:12:54.629727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 10:12:54.629727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 10:12:54.629727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 10:12:54.629727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 10:12:54.629727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application compat.raise_( Aug 04 10:12:54.629727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 10:12:54.629727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception Aug 04 10:12:54.629727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 10:12:54.629727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 10:12:54.629727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 10:12:54.629727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 10:12:54.630594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 10:12:54.630594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 10:12:54.630594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 10:12:54.630594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 10:12:54.630594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 10:12:54.630594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 10:12:54.630594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 10:12:54.630594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 10:12:54.630594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 10:12:54.630594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 10:12:54.630594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 10:12:54.630594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 10:12:54.630594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 10:12:54.630594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 10:12:54.630594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 10:12:54.631388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 10:12:54.631388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 10:12:54.631388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception Aug 04 10:12:54.631388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 10:12:54.631388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 10:12:54.631388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 10:12:54.631388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 10:12:54.631388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 10:12:54.631388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 10:12:54.631388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 10:12:54.631388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application conn.query(q) Aug 04 10:12:54.631388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 10:12:54.631388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 10:12:54.631388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 10:12:54.631388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result.read() Aug 04 10:12:54.631388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 10:12:54.631388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 10:12:54.633154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 10:12:54.633154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 10:12:54.633154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 10:12:54.633154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 10:12:54.633154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 10:12:54.633154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 10:12:54.633154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 10:12:54.633154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 10:12:54.633154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [parameters: {'id': '9fd01e0294074c359024c5d7fb9a8297', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 10:12:54.633154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 10:12:54.633154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:54.633154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:54.633154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:54.633154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:54.633154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 04 10:12:54.640772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 04 10:12:54.640772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 10:12:54.640772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 10:12:54.640772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 04 10:12:54.640772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:54.640772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:54.640772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:54.640772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:54.640772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:54.640772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:54.640772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:54.640772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:54.640772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:54.640772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:54.640772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:54.640772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:54.640772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:54.642985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:54.642985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 04 10:12:54.642985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 04 10:12:54.642985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:54.642985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:54.642985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 04 10:12:54.642985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 04 10:12:54.642985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9fd01e0294074c359024c5d7fb9a8297. Aug 04 10:12:54.642985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:54.642985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 455/937] 10.222.0.48 () {60 vars in 1140 bytes} [Thu Aug 4 10:12:54 2022] POST /identity/v3/projects => generated 262 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:54.648906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf5cd8-3070-4fb5-976f-1cea296d4946 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:54.680565 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:54.744423 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197f30d-44b8-4b68-b297-8c077771eb6f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:54.772559 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf5cd8-3070-4fb5-976f-1cea296d4946 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:54.790650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f5e25-977f-488c-bf22-43dc24ed5bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:54.791306 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f5e25-977f-488c-bf22-43dc24ed5bbc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:54.791586 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f5e25-977f-488c-bf22-43dc24ed5bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:54.791863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f5e25-977f-488c-bf22-43dc24ed5bbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:54.800223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f5e25-977f-488c-bf22-43dc24ed5bbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:54.801698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f5e25-977f-488c-bf22-43dc24ed5bbc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:54.812761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a9a6d-f820-43ed-a365-00bd622615b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:54.813914 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a9a6d-f820-43ed-a365-00bd622615b7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:54.814201 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a9a6d-f820-43ed-a365-00bd622615b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:54.814478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a9a6d-f820-43ed-a365-00bd622615b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:54.814733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-e67f5e25-977f-488c-bf22-43dc24ed5bbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:54.814733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:54.814733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:54.814733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:54.814733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:54.814733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:54.814733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:54.814733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:54.814733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:54.814733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:54.814733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:54.814733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:54.814733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:54.814733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:54.814733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:54.815652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:54.815652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:54.815652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:54.815652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:54.815652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:54.815652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:54.815652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:54.815652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:54.815652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:54.815652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:54.815652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:54.815652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:54.815652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:54.815652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:54.815652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:54.815652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:54.815652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:54.817021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:54.817021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:54.817021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:54.817021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:54.817021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:54.817021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:54.817021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:54.817021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:54.817021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 483/938] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:54.817748 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aa74e-7dc6-4aec-a71d-a9b9fad6d024 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:54.817847 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aa74e-7dc6-4aec-a71d-a9b9fad6d024 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:54.818120 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aa74e-7dc6-4aec-a71d-a9b9fad6d024 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:54.824212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 484/939] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:54.824212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942aa74e-7dc6-4aec-a71d-a9b9fad6d024 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:54.832386 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a9a6d-f820-43ed-a365-00bd622615b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:54.834075 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a9a6d-f820-43ed-a365-00bd622615b7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:54.848553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-708a9a6d-f820-43ed-a365-00bd622615b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:54.848553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:54.848553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:54.848553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:54.848553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:54.848553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:54.848553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:54.848553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:54.848553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:54.848553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:54.848553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:54.848553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:54.848553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:54.848553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:54.848553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:54.849469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:54.849469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:54.849469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:54.849469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:54.849469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:54.849469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:54.849469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:54.849469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:54.849469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:54.849469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:54.849469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:54.849469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:54.849469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:54.849469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:54.849469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:54.849469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:54.849469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:54.850321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:54.850321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:54.850321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:54.850321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:54.850321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:54.850321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:54.850321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:54.850321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:54.850321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 456/940] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:54.851285 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546691c-1d9e-42df-af6e-81938beeb91f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:54.851285 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546691c-1d9e-42df-af6e-81938beeb91f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:54.851544 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546691c-1d9e-42df-af6e-81938beeb91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:54.861486 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:54.876757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-e546691c-1d9e-42df-af6e-81938beeb91f None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:54.878353 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e546691c-1d9e-42df-af6e-81938beeb91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:54.958272 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 457/941] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:54.959224 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546691c-1d9e-42df-af6e-81938beeb91f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:54.972051 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942aa74e-7dc6-4aec-a71d-a9b9fad6d024 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:54.976509 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:55.017338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc64c0-04df-46ab-bc46-b15996828beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:55.017974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc64c0-04df-46ab-bc46-b15996828beb None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:55.018303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc64c0-04df-46ab-bc46-b15996828beb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:55.018638 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc64c0-04df-46ab-bc46-b15996828beb None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:55.019403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc64c0-04df-46ab-bc46-b15996828beb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:55.019719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc64c0-04df-46ab-bc46-b15996828beb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:55.022005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc64c0-04df-46ab-bc46-b15996828beb None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:55.042930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 485/942] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:55.045256 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc64c0-04df-46ab-bc46-b15996828beb None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:55.099242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546691c-1d9e-42df-af6e-81938beeb91f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:55.144592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a71671-f3ad-4f09-bdfd-f91ecedc9f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:55.145226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a71671-f3ad-4f09-bdfd-f91ecedc9f22 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:55.145950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a71671-f3ad-4f09-bdfd-f91ecedc9f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:55.145950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a71671-f3ad-4f09-bdfd-f91ecedc9f22 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:55.146490 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a71671-f3ad-4f09-bdfd-f91ecedc9f22 None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:55.146793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a71671-f3ad-4f09-bdfd-f91ecedc9f22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:55.148480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a71671-f3ad-4f09-bdfd-f91ecedc9f22 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:55.150477 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:55.184200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 458/943] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Aug 4 10:12:54 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:55.184200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a71671-f3ad-4f09-bdfd-f91ecedc9f22 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:55.196643 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc64c0-04df-46ab-bc46-b15996828beb None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:55.246731 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96085fd3-be4b-4083-924e-458ec672089f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:55.247705 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96085fd3-be4b-4083-924e-458ec672089f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:55.248229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96085fd3-be4b-4083-924e-458ec672089f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:55.248644 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96085fd3-be4b-4083-924e-458ec672089f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:55.249470 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96085fd3-be4b-4083-924e-458ec672089f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:55.251517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96085fd3-be4b-4083-924e-458ec672089f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:55.262279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-96085fd3-be4b-4083-924e-458ec672089f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 10:12:55.262279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:55.262279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:12:55.262279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:12:55.262279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:12:55.262279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:12:55.262279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:12:55.262279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:55.262279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 10:12:55.262279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:55.262279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:55.262279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:55.262279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:55.262279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:55.262279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:55.262279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:55.262279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:55.263556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:55.263556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:55.263556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:55.263556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:55.263556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:55.263556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:55.263556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:12:55.263556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:12:55.263556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:12:55.263556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:12:55.263556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:55.263556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:55.263556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:55.263556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:55.263556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:55.263556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:55.264581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:55.264581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:55.264581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:55.264581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:55.264581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:55.264581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:55.264581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:55.264581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:55.264581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:55.264581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:55.264581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:12:55.264581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:55.264581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 10:12:55.264581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:55.267382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 486/944] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Aug 4 10:12:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:55.273965 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96085fd3-be4b-4083-924e-458ec672089f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:55.293440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a71671-f3ad-4f09-bdfd-f91ecedc9f22 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:55.308767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:55.333656 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584fb49-cf5b-4e82-92a0-39974a8ca11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:55.334883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584fb49-cf5b-4e82-92a0-39974a8ca11b None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:55.335167 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584fb49-cf5b-4e82-92a0-39974a8ca11b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:55.335451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584fb49-cf5b-4e82-92a0-39974a8ca11b None admin] PATH_INFO: `/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/306a5f4d7e0d44bd9a27145bd35a07fc/roles/15b22a1f53864b52a7b212d5adf916db` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:55.337998 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584fb49-cf5b-4e82-92a0-39974a8ca11b None admin] RBAC: Authorizing `identity:create_grant(project_id=7e37543156ee42a0818bf5cfe747fdc2, user_id=306a5f4d7e0d44bd9a27145bd35a07fc, role_id=15b22a1f53864b52a7b212d5adf916db)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:55.339472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584fb49-cf5b-4e82-92a0-39974a8ca11b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:55.358148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 459/945] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:12:55 2022] PUT /identity/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/306a5f4d7e0d44bd9a27145bd35a07fc/roles/15b22a1f53864b52a7b212d5adf916db => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:12:55.411747 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96085fd3-be4b-4083-924e-458ec672089f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:55.458663 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b05261-1a86-4647-a42f-dc67e1375574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:55.459601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b05261-1a86-4647-a42f-dc67e1375574 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:55.459882 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b05261-1a86-4647-a42f-dc67e1375574 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:55.460159 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b05261-1a86-4647-a42f-dc67e1375574 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:55.460887 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b05261-1a86-4647-a42f-dc67e1375574 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:55.461194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b05261-1a86-4647-a42f-dc67e1375574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:55.462606 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b05261-1a86-4647-a42f-dc67e1375574 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:55.470963 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 487/946] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Aug 4 10:12:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:55.477451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584fb49-cf5b-4e82-92a0-39974a8ca11b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:55.548839 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:55.602407 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584fb49-cf5b-4e82-92a0-39974a8ca11b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:55.642807 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f18d83-c44c-4990-8767-d3b58db7756c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:55.643450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f18d83-c44c-4990-8767-d3b58db7756c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:55.643748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f18d83-c44c-4990-8767-d3b58db7756c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:55.644011 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f18d83-c44c-4990-8767-d3b58db7756c None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:55.644745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f18d83-c44c-4990-8767-d3b58db7756c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:55.645050 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f18d83-c44c-4990-8767-d3b58db7756c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:55.646432 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f18d83-c44c-4990-8767-d3b58db7756c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:55.656392 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 460/947] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Aug 4 10:12:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:55.658510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b05261-1a86-4647-a42f-dc67e1375574 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:55.758439 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:55.768934 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b05261-1a86-4647-a42f-dc67e1375574 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:55.806604 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a0b94-2c7b-4350-b214-980c6fd1d31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:55.807267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a0b94-2c7b-4350-b214-980c6fd1d31a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:55.807519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a0b94-2c7b-4350-b214-980c6fd1d31a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:55.807775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a0b94-2c7b-4350-b214-980c6fd1d31a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:55.808575 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a0b94-2c7b-4350-b214-980c6fd1d31a None admin] RBAC: Adding query filter params (interface=public, service_id=e48ace9ce8c4439381076d3a1ba496cf, region_id=RegionOne) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:55.808885 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a0b94-2c7b-4350-b214-980c6fd1d31a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:55.810266 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a0b94-2c7b-4350-b214-980c6fd1d31a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:55.820281 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 488/948] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Aug 4 10:12:55 2022] GET /identity/v3/endpoints?service_id=e48ace9ce8c4439381076d3a1ba496cf&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:55.822538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f18d83-c44c-4990-8767-d3b58db7756c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:55.932771 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f18d83-c44c-4990-8767-d3b58db7756c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:55.953033 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:55.973914 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ea4fd-9e25-4205-8fb5-9adebd2a4300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:55.974842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ea4fd-9e25-4205-8fb5-9adebd2a4300 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:55.975304 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ea4fd-9e25-4205-8fb5-9adebd2a4300 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:55.975757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ea4fd-9e25-4205-8fb5-9adebd2a4300 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:55.976657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ea4fd-9e25-4205-8fb5-9adebd2a4300 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:55.978218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ea4fd-9e25-4205-8fb5-9adebd2a4300 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:55.985612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 461/949] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Aug 4 10:12:55 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:12:56.024050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906eebb-7631-48b8-9b02-b27db59c68e4 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:56.024412 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906eebb-7631-48b8-9b02-b27db59c68e4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:56.024696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906eebb-7631-48b8-9b02-b27db59c68e4 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:56.026055 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 489/950] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:56.032058 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf1fa5-0e47-4034-9cfe-3ba49b1a8b3b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:56.032426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf1fa5-0e47-4034-9cfe-3ba49b1a8b3b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:56.032654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf1fa5-0e47-4034-9cfe-3ba49b1a8b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:56.053518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d3cf1fa5-0e47-4034-9cfe-3ba49b1a8b3b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:56.054749 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d3cf1fa5-0e47-4034-9cfe-3ba49b1a8b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:56.139631 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 462/951] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:56.163024 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906eebb-7631-48b8-9b02-b27db59c68e4 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:56.280288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906eebb-7631-48b8-9b02-b27db59c68e4 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:56.317433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74738935-8a68-4fea-bbdc-5fc874c9bb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:56.318500 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74738935-8a68-4fea-bbdc-5fc874c9bb33 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:56.319056 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74738935-8a68-4fea-bbdc-5fc874c9bb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:56.319545 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74738935-8a68-4fea-bbdc-5fc874c9bb33 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:56.320415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74738935-8a68-4fea-bbdc-5fc874c9bb33 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:56.321998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74738935-8a68-4fea-bbdc-5fc874c9bb33 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:56.332295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-74738935-8a68-4fea-bbdc-5fc874c9bb33 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 10:12:56.332295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:56.332295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:12:56.332295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:12:56.332295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:12:56.332295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:12:56.332295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:12:56.332295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:56.332295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 10:12:56.332295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:56.332295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:56.332295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:56.332295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:56.332295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:56.332295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:56.332295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:56.332295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:56.333285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:56.333285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:56.333285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:56.333285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:56.333285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:56.333285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:56.333285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:12:56.333285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:12:56.333285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:12:56.333285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:12:56.333285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:56.333285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:56.333285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:56.333285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:56.333285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:56.333285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:56.334087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:56.334087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:56.334087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:56.334087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:56.334087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:56.334087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:56.334087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:56.334087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:56.334087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:56.334087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:56.334087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:12:56.334087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:56.334087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 10:12:56.334087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:56.340284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 490/952] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:56.343235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf1fa5-0e47-4034-9cfe-3ba49b1a8b3b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:56.450570 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf1fa5-0e47-4034-9cfe-3ba49b1a8b3b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:56.466218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:56.493994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29027475-76a6-47d0-8017-3a2258620b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:56.494624 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29027475-76a6-47d0-8017-3a2258620b9f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:56.494943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29027475-76a6-47d0-8017-3a2258620b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:56.495174 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29027475-76a6-47d0-8017-3a2258620b9f None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:56.495857 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29027475-76a6-47d0-8017-3a2258620b9f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:56.496161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29027475-76a6-47d0-8017-3a2258620b9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:56.497544 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29027475-76a6-47d0-8017-3a2258620b9f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:56.503395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 463/953] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Aug 4 10:12:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:56.509233 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74738935-8a68-4fea-bbdc-5fc874c9bb33 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:56.537051 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:56.623076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74738935-8a68-4fea-bbdc-5fc874c9bb33 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:56.661211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0886c0-1c11-459f-a7a2-3f1050926ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:56.662123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0886c0-1c11-459f-a7a2-3f1050926ccb None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:56.662564 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0886c0-1c11-459f-a7a2-3f1050926ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:56.662998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0886c0-1c11-459f-a7a2-3f1050926ccb None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:56.663857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0886c0-1c11-459f-a7a2-3f1050926ccb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:56.664368 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0886c0-1c11-459f-a7a2-3f1050926ccb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:56.665931 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0886c0-1c11-459f-a7a2-3f1050926ccb None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:56.676381 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 491/954] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Aug 4 10:12:56 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:57.464462 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b129c-ea40-4ee8-bf70-b712de1169d2 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:57.465027 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b129c-ea40-4ee8-bf70-b712de1169d2 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:57.465297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b129c-ea40-4ee8-bf70-b712de1169d2 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:57.467051 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 464/955] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:57.472572 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568c1d-dcec-41ca-8ef3-3f2d677213f5 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:57.473020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568c1d-dcec-41ca-8ef3-3f2d677213f5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:57.473115 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568c1d-dcec-41ca-8ef3-3f2d677213f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:57.493021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-59568c1d-dcec-41ca-8ef3-3f2d677213f5 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:57.494457 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-59568c1d-dcec-41ca-8ef3-3f2d677213f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:57.570433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 492/956] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 10:12:57.596594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b129c-ea40-4ee8-bf70-b712de1169d2 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:57.624298 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321a9d1-ef34-4c26-9842-f84e0ff9e793 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:57.624593 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321a9d1-ef34-4c26-9842-f84e0ff9e793 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:57.624873 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321a9d1-ef34-4c26-9842-f84e0ff9e793 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:57.628026 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 493/957] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:12:57.634862 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c4296-7196-4551-b51f-e8e3e3c3c82c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:57.635218 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c4296-7196-4551-b51f-e8e3e3c3c82c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:57.635504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c4296-7196-4551-b51f-e8e3e3c3c82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:57.655038 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-0d7c4296-7196-4551-b51f-e8e3e3c3c82c None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:57.656432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0d7c4296-7196-4551-b51f-e8e3e3c3c82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:57.673055 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:57.722884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b129c-ea40-4ee8-bf70-b712de1169d2 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:57.756372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 494/958] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 10:12:57.767589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c97416-4efe-48de-a3f5-026c8da5d23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:57.768607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c97416-4efe-48de-a3f5-026c8da5d23c None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:57.769093 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c97416-4efe-48de-a3f5-026c8da5d23c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:57.769579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c97416-4efe-48de-a3f5-026c8da5d23c None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:57.770459 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c97416-4efe-48de-a3f5-026c8da5d23c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:57.772090 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c97416-4efe-48de-a3f5-026c8da5d23c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:57.776518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c4296-7196-4551-b51f-e8e3e3c3c82c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:57.788478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.sql.core [None req-e0c97416-4efe-48de-a3f5-026c8da5d23c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 10:12:57.788478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 10:12:57.788478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [parameters: {'user_id': '060a2f1b6f514a6185183c0ae7aba7df', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 10:12:57.788478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80116) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 10:12:57.796761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-e0c97416-4efe-48de-a3f5-026c8da5d23c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 10:12:57.796761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:57.796761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 10:12:57.796761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 10:12:57.796761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 10:12:57.796761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 10:12:57.796761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 10:12:57.796761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 10:12:57.796761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 10:12:57.796761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application conn.query(q) Aug 04 10:12:57.796761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 10:12:57.796761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 10:12:57.796761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 10:12:57.796761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result.read() Aug 04 10:12:57.796761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 10:12:57.798249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 10:12:57.798249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 10:12:57.798249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 10:12:57.798249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 10:12:57.798249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 10:12:57.798249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 10:12:57.798249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 10:12:57.798249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 10:12:57.798249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:57.798249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 10:12:57.798249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:57.798249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:57.798249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 10:12:57.798249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 10:12:57.798249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 04 10:12:57.798249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 04 10:12:57.798249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 10:12:57.798249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application next(self.gen) Aug 04 10:12:57.799391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 10:12:57.799391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application yield resource Aug 04 10:12:57.799391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 10:12:57.799391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application next(self.gen) Aug 04 10:12:57.799391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 10:12:57.799391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 10:12:57.799391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 10:12:57.799391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 10:12:57.799391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 10:12:57.799391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise self.value Aug 04 10:12:57.799391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 10:12:57.799391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 10:12:57.799391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 10:12:57.799391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application session.commit() Aug 04 10:12:57.799391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 10:12:57.799391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 10:12:57.799391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 10:12:57.800855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 10:12:57.800855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 10:12:57.800855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.session.flush() Aug 04 10:12:57.800855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 10:12:57.800855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 10:12:57.800855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 10:12:57.800855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 10:12:57.800855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 10:12:57.800855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application compat.raise_( Aug 04 10:12:57.800855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 10:12:57.800855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception Aug 04 10:12:57.800855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 10:12:57.800855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 10:12:57.800855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 10:12:57.800855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 10:12:57.800855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 10:12:57.800855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 10:12:57.801824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 10:12:57.801824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 10:12:57.801824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 10:12:57.801824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 04 10:12:57.801824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 10:12:57.801824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 10:12:57.801824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 10:12:57.801824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 10:12:57.801824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 10:12:57.801824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 10:12:57.801824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 10:12:57.801824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 10:12:57.801824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 10:12:57.801824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 10:12:57.801824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 10:12:57.801824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception Aug 04 10:12:57.803461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 10:12:57.803461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 10:12:57.803461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 10:12:57.803461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 10:12:57.803461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 10:12:57.803461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 10:12:57.803461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 10:12:57.803461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application conn.query(q) Aug 04 10:12:57.803461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 10:12:57.803461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 10:12:57.803461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 10:12:57.803461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result.read() Aug 04 10:12:57.803461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 10:12:57.803461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 10:12:57.803461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 10:12:57.803461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 10:12:57.805558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 10:12:57.805558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 10:12:57.805558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 10:12:57.805558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 10:12:57.805558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 10:12:57.805558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 10:12:57.805558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [parameters: {'user_id': '060a2f1b6f514a6185183c0ae7aba7df', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 10:12:57.805558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 10:12:57.805558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:57.805558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:57.805558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:57.805558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:57.805558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:57.805558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:57.805558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:57.807531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:57.807531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:57.807531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:57.807531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:57.807531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:57.807531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:57.807531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:57.807531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 04 10:12:57.807531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 04 10:12:57.807531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:57.807531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:57.807531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:57.807531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:57.807531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:57.807531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:57.807531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 04 10:12:57.807531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 04 10:12:57.810153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 04 10:12:57.810153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 04 10:12:57.810153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 10:12:57.810153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 10:12:57.810153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 10:12:57.810153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:57.812831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 465/959] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Aug 4 10:12:57 2022] POST /identity/v3/users => generated 160 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:57.818771 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c97416-4efe-48de-a3f5-026c8da5d23c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:57.870019 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:57.899123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c4296-7196-4551-b51f-e8e3e3c3c82c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:57.938688 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d321d-a3b9-4fc2-bd5c-c40f73ceaf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:57.939524 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d321d-a3b9-4fc2-bd5c-c40f73ceaf92 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:57.939862 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d321d-a3b9-4fc2-bd5c-c40f73ceaf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:57.940144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d321d-a3b9-4fc2-bd5c-c40f73ceaf92 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:57.942411 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c97416-4efe-48de-a3f5-026c8da5d23c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:57.951929 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d321d-a3b9-4fc2-bd5c-c40f73ceaf92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:12:57.958172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-610d321d-a3b9-4fc2-bd5c-c40f73ceaf92 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 10:12:57.958172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:57.958172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:57.958172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:57.958172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:57.958172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:57.958172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:57.958172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:57.958172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:57.958172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:57.958172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:57.958172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:57.958172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:12:57.958172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:12:57.958172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:12:57.958172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:12:57.959130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:12:57.959130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:12:57.959130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:12:57.959130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:12:57.959130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:57.959130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:57.959130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:57.959130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:57.959130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:57.959130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:57.959130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:57.959130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:57.959130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:57.959130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:57.959130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:57.959130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:57.960004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:57.960004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:57.960004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:57.960004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:57.960004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:12:57.960004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:12:57.960004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:12:57.960004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:12:57.960004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:12:57.960004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:12:57.960004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 10:12:57.960004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:57.964719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 495/960] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Aug 4 10:12:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:57.965745 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d321d-a3b9-4fc2-bd5c-c40f73ceaf92 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:57.970725 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:57.988850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8eda8-039e-49f2-abd5-024a05af6939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:57.989863 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8eda8-039e-49f2-abd5-024a05af6939 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:57.990359 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8eda8-039e-49f2-abd5-024a05af6939 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:57.990946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8eda8-039e-49f2-abd5-024a05af6939 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:57.999525 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8eda8-039e-49f2-abd5-024a05af6939 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:58.002412 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8eda8-039e-49f2-abd5-024a05af6939 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:58.016413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-43a8eda8-039e-49f2-abd5-024a05af6939 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 10:12:58.016413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:58.016413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:58.016413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:58.016413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:58.016413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:58.016413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:58.016413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:58.016413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:58.016413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:58.016413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:58.016413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:58.016413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:58.016413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:58.016413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:58.016413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:58.017768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:58.017768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:58.017768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:58.017768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:58.017768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:58.017768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:58.017768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:58.017768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:58.017768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:58.017768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:58.017768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:58.017768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:58.017768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:58.017768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:58.017768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:58.017768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:58.017768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:58.017768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:58.019169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:58.019169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:58.019169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:58.019169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:58.019169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:58.019169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:58.019169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:58.019169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:58.019169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 10:12:58.019169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:58.021733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 466/961] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:12:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:58.027082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8eda8-039e-49f2-abd5-024a05af6939 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:58.092085 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d321d-a3b9-4fc2-bd5c-c40f73ceaf92 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:58.133122 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afc249-1e59-467d-85dc-77a2ff7f8099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:58.133756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afc249-1e59-467d-85dc-77a2ff7f8099 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:58.134034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afc249-1e59-467d-85dc-77a2ff7f8099 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:58.134304 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afc249-1e59-467d-85dc-77a2ff7f8099 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:58.135012 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afc249-1e59-467d-85dc-77a2ff7f8099 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:58.135308 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afc249-1e59-467d-85dc-77a2ff7f8099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:58.136718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afc249-1e59-467d-85dc-77a2ff7f8099 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:58.140960 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:58.145211 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8eda8-039e-49f2-abd5-024a05af6939 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:58.150735 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 496/962] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Aug 4 10:12:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:58.151964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e799b-7d13-42c7-b78b-32324e6efb47 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:58.152241 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e799b-7d13-42c7-b78b-32324e6efb47 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:58.152522 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e799b-7d13-42c7-b78b-32324e6efb47 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:58.153798 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 497/963] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:58.154512 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e799b-7d13-42c7-b78b-32324e6efb47 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:58.190685 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da60d2-a78d-4ba4-90cd-4ba8ff915087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:58.191325 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da60d2-a78d-4ba4-90cd-4ba8ff915087 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:58.191609 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da60d2-a78d-4ba4-90cd-4ba8ff915087 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:58.191882 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da60d2-a78d-4ba4-90cd-4ba8ff915087 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:58.192706 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da60d2-a78d-4ba4-90cd-4ba8ff915087 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:58.193012 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da60d2-a78d-4ba4-90cd-4ba8ff915087 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:58.194491 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da60d2-a78d-4ba4-90cd-4ba8ff915087 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:58.231201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:58.244316 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 467/964] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Aug 4 10:12:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:12:58.244316 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eab85-73fa-4b95-b382-8441a634d6b1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:58.244316 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eab85-73fa-4b95-b382-8441a634d6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:58.244316 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eab85-73fa-4b95-b382-8441a634d6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:58.261825 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-8e9eab85-73fa-4b95-b382-8441a634d6b1 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:58.263407 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8e9eab85-73fa-4b95-b382-8441a634d6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:58.297263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e799b-7d13-42c7-b78b-32324e6efb47 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:58.347460 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 468/965] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:58.353746 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d83025-ce17-411f-be16-2bd67f238418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:58.354943 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d83025-ce17-411f-be16-2bd67f238418 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:58.355594 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d83025-ce17-411f-be16-2bd67f238418 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:58.356275 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d83025-ce17-411f-be16-2bd67f238418 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:58.369254 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d83025-ce17-411f-be16-2bd67f238418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:58.369900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9eab85-73fa-4b95-b382-8441a634d6b1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:58.370736 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d83025-ce17-411f-be16-2bd67f238418 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:58.393091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-54d83025-ce17-411f-be16-2bd67f238418 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:58.393091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:58.393091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:58.393091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:58.393091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:58.393091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:58.393091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:58.393091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:58.393091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:58.393091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:58.393091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:58.393091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:58.393091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:58.393091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:58.393091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:58.394049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:58.394049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:58.394049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:58.394049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:58.394049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:58.394049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:58.394049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:58.394049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:58.394049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:58.394049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:58.394049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:58.394049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:58.394049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:58.394049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:58.394049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:58.394049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:58.394049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:58.395000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:58.395000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:58.395000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:58.395000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:58.397492 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 498/966] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:58.405674 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d83025-ce17-411f-be16-2bd67f238418 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:58.493421 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:58.513283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9eab85-73fa-4b95-b382-8441a634d6b1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:58.554943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b2625-0506-4978-ac1a-82e9198d6773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:58.555819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b2625-0506-4978-ac1a-82e9198d6773 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:58.556103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b2625-0506-4978-ac1a-82e9198d6773 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:58.556431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b2625-0506-4978-ac1a-82e9198d6773 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:58.557073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b2625-0506-4978-ac1a-82e9198d6773 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:58.557663 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d83025-ce17-411f-be16-2bd67f238418 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:58.558513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b2625-0506-4978-ac1a-82e9198d6773 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:58.569793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-790b2625-0506-4978-ac1a-82e9198d6773 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 10:12:58.569793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:58.569793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:12:58.569793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:12:58.569793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:12:58.569793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:12:58.569793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:12:58.569793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:58.569793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 10:12:58.569793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:58.569793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:12:58.569793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:58.569793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:58.569793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:58.569793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:58.569793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:58.569793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:58.570910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:58.570910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:58.570910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:58.570910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:58.570910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:58.570910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:58.570910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:12:58.570910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:12:58.570910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:12:58.570910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:12:58.570910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:58.570910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:58.570910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:58.570910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:58.570910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:58.570910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:58.571775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:58.571775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:58.571775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:58.571775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:58.571775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:58.571775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:58.571775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:58.571775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:58.571775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:58.571775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:58.571775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:12:58.571775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:12:58.571775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 10:12:58.571775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:12:58.571775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 469/967] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Aug 4 10:12:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:58.577617 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b2625-0506-4978-ac1a-82e9198d6773 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:58.581125 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:58.600420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f696d-d939-4f12-ac2c-57cf5d6593ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:58.601053 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f696d-d939-4f12-ac2c-57cf5d6593ba None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:58.601341 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f696d-d939-4f12-ac2c-57cf5d6593ba None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:58.601619 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f696d-d939-4f12-ac2c-57cf5d6593ba None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:58.602447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f696d-d939-4f12-ac2c-57cf5d6593ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:58.602960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f696d-d939-4f12-ac2c-57cf5d6593ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:58.604288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f696d-d939-4f12-ac2c-57cf5d6593ba None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:58.620780 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 499/968] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:58.625651 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f696d-d939-4f12-ac2c-57cf5d6593ba None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:58.692516 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b2625-0506-4978-ac1a-82e9198d6773 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:58.729624 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf212979-e043-44fe-b7f6-9469de6bfda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:58.730256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf212979-e043-44fe-b7f6-9469de6bfda5 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:58.730544 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf212979-e043-44fe-b7f6-9469de6bfda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:58.730825 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf212979-e043-44fe-b7f6-9469de6bfda5 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:58.731512 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf212979-e043-44fe-b7f6-9469de6bfda5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:58.731821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf212979-e043-44fe-b7f6-9469de6bfda5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:58.733223 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf212979-e043-44fe-b7f6-9469de6bfda5 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:58.738340 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 470/969] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Aug 4 10:12:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:58.743839 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf212979-e043-44fe-b7f6-9469de6bfda5 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:58.745194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f696d-d939-4f12-ac2c-57cf5d6593ba None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:58.768731 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:58.799224 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65524539-c66f-4e64-b397-d8525dafdf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:58.799868 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65524539-c66f-4e64-b397-d8525dafdf5b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:58.800187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65524539-c66f-4e64-b397-d8525dafdf5b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:58.800508 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65524539-c66f-4e64-b397-d8525dafdf5b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:58.809608 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65524539-c66f-4e64-b397-d8525dafdf5b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:58.811068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65524539-c66f-4e64-b397-d8525dafdf5b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:58.823666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-65524539-c66f-4e64-b397-d8525dafdf5b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 10:12:58.823666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:58.823666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:58.823666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:58.823666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:58.823666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:58.823666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:58.823666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:58.823666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:58.823666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:58.823666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:58.823666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:58.823666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:12:58.823666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:12:58.823666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:12:58.823666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:12:58.824697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:58.824697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:58.824697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:12:58.824697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:58.824697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:12:58.824697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:12:58.824697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:58.824697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:58.824697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:58.824697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:58.824697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:58.824697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:58.824697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:58.824697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:58.824697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:58.824697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:58.824697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:58.824697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:58.825623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:58.825623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:58.825623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:12:58.825623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:12:58.825623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:12:58.825623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:12:58.825623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:12:58.825623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:12:58.825623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 10:12:58.825623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:58.829884 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 500/970] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Aug 4 10:12:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:58.832347 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f1c7d-fd5e-49b5-bf3e-5aa80590039e None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:58.832347 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f1c7d-fd5e-49b5-bf3e-5aa80590039e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:58.832347 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f1c7d-fd5e-49b5-bf3e-5aa80590039e None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:58.836568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 501/971] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:12:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:12:58.837357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f1c7d-fd5e-49b5-bf3e-5aa80590039e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:58.872114 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf212979-e043-44fe-b7f6-9469de6bfda5 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:58.891559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:58.909077 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e88907-ee7c-4bc5-af2d-ea5c0f1f0515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:58.909707 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e88907-ee7c-4bc5-af2d-ea5c0f1f0515 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:58.909989 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e88907-ee7c-4bc5-af2d-ea5c0f1f0515 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:58.910257 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e88907-ee7c-4bc5-af2d-ea5c0f1f0515 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:58.910939 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e88907-ee7c-4bc5-af2d-ea5c0f1f0515 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:58.911246 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e88907-ee7c-4bc5-af2d-ea5c0f1f0515 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:58.912646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e88907-ee7c-4bc5-af2d-ea5c0f1f0515 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:58.919608 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 471/972] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Aug 4 10:12:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:58.921519 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf91371-f353-4dfe-96e2-fcbfd972f5da None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:58.921811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf91371-f353-4dfe-96e2-fcbfd972f5da None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:58.922662 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf91371-f353-4dfe-96e2-fcbfd972f5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:58.941684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-baf91371-f353-4dfe-96e2-fcbfd972f5da None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:12:58.942869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-baf91371-f353-4dfe-96e2-fcbfd972f5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:12:58.963618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f1c7d-fd5e-49b5-bf3e-5aa80590039e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:59.001161 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06af8b4-637e-4252-a348-982ece878a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:59.001901 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af8b4-637e-4252-a348-982ece878a31 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:59.002262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af8b4-637e-4252-a348-982ece878a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:59.002636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af8b4-637e-4252-a348-982ece878a31 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:59.003507 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06af8b4-637e-4252-a348-982ece878a31 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:59.003891 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06af8b4-637e-4252-a348-982ece878a31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:59.005450 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06af8b4-637e-4252-a348-982ece878a31 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:59.022580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 472/973] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:12:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:12:59.025475 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf91371-f353-4dfe-96e2-fcbfd972f5da None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:59.025592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 502/974] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Aug 4 10:12:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:59.032114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06af8b4-637e-4252-a348-982ece878a31 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:59.039926 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:59.132886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:59.133426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf91371-f353-4dfe-96e2-fcbfd972f5da None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:59.138943 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06af8b4-637e-4252-a348-982ece878a31 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:59.169147 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bfd15-acc8-46bc-95de-18b775d31a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:59.169774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bfd15-acc8-46bc-95de-18b775d31a61 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:59.170055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bfd15-acc8-46bc-95de-18b775d31a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:59.170330 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bfd15-acc8-46bc-95de-18b775d31a61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:59.171034 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bfd15-acc8-46bc-95de-18b775d31a61 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:59.172576 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bfd15-acc8-46bc-95de-18b775d31a61 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:59.174092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd577fd-990d-4930-9358-db1bc613cfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:59.174720 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd577fd-990d-4930-9358-db1bc613cfac None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:59.174995 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd577fd-990d-4930-9358-db1bc613cfac None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:59.175268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd577fd-990d-4930-9358-db1bc613cfac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:59.193434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 473/975] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:12:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:12:59.194233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bfd15-acc8-46bc-95de-18b775d31a61 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:59.254386 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd577fd-990d-4930-9358-db1bc613cfac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:59.256058 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd577fd-990d-4930-9358-db1bc613cfac None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:59.272143 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:59.328894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bfd15-acc8-46bc-95de-18b775d31a61 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:59.364330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:59.371078 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c800e54-a13e-46e2-a161-fba19af0558d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:59.371707 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c800e54-a13e-46e2-a161-fba19af0558d None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:59.372045 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c800e54-a13e-46e2-a161-fba19af0558d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:59.372370 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c800e54-a13e-46e2-a161-fba19af0558d None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:59.372544 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 503/976] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:12:59 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:12:59.373074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c800e54-a13e-46e2-a161-fba19af0558d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:59.374458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c800e54-a13e-46e2-a161-fba19af0558d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:59.378398 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd577fd-990d-4930-9358-db1bc613cfac None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:59.392241 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 474/977] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Aug 4 10:12:59 2022] POST /identity/v3/services => generated 242 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:12:59.494732 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd577fd-990d-4930-9358-db1bc613cfac None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:59.546018 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37a0ed-925f-41ea-be64-60aa32126780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:59.546682 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37a0ed-925f-41ea-be64-60aa32126780 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:59.547008 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37a0ed-925f-41ea-be64-60aa32126780 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:59.547288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37a0ed-925f-41ea-be64-60aa32126780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:59.558787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37a0ed-925f-41ea-be64-60aa32126780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:59.561663 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37a0ed-925f-41ea-be64-60aa32126780 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:59.578092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-4a37a0ed-925f-41ea-be64-60aa32126780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:59.578092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:59.578092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:59.578092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:59.578092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:59.578092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:59.578092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:59.578092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:59.578092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:59.578092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:59.578092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:59.578092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:59.578092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:12:59.578092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:12:59.578092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:12:59.579899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:12:59.579899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:59.579899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:59.579899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:59.579899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:59.579899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:59.579899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:59.579899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:59.579899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:59.579899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:59.579899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:59.579899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:59.579899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:59.579899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:59.579899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:59.579899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:59.579899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:59.580866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:12:59.580866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:12:59.580866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:12:59.580866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:59.580866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 504/978] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:12:59.585728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c800e54-a13e-46e2-a161-fba19af0558d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:59.703609 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c800e54-a13e-46e2-a161-fba19af0558d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:59.724831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:59.741746 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d9586-1c6a-4734-88a0-c35d9d514981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:59.742368 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d9586-1c6a-4734-88a0-c35d9d514981 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:59.742654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d9586-1c6a-4734-88a0-c35d9d514981 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:59.742931 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d9586-1c6a-4734-88a0-c35d9d514981 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:59.743636 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d9586-1c6a-4734-88a0-c35d9d514981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:12:59.743943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d9586-1c6a-4734-88a0-c35d9d514981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:59.745342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d9586-1c6a-4734-88a0-c35d9d514981 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:59.763484 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 475/979] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:12:59.764935 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37a0ed-925f-41ea-be64-60aa32126780 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:12:59.812077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:12:59.869192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37a0ed-925f-41ea-be64-60aa32126780 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:12:59.904816 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf1d77-62e0-4ec9-89ad-89ff85bd05a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:12:59.905463 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf1d77-62e0-4ec9-89ad-89ff85bd05a3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:12:59.905744 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf1d77-62e0-4ec9-89ad-89ff85bd05a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:12:59.906018 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf1d77-62e0-4ec9-89ad-89ff85bd05a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:12:59.912951 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf1d77-62e0-4ec9-89ad-89ff85bd05a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:12:59.914411 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf1d77-62e0-4ec9-89ad-89ff85bd05a3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:12:59.926653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-fedf1d77-62e0-4ec9-89ad-89ff85bd05a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:59.926653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:12:59.926653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:12:59.926653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:12:59.926653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:12:59.926653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:12:59.926653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:12:59.926653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:12:59.926653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:12:59.926653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:12:59.926653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:12:59.926653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:12:59.926653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:12:59.926653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:12:59.926653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:12:59.927700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:12:59.927700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:12:59.927700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:12:59.927700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:12:59.927700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:12:59.927700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:12:59.927700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:12:59.927700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:12:59.927700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:12:59.927700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:12:59.927700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:12:59.927700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:12:59.927700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:12:59.927700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:12:59.927700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:12:59.927700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:12:59.927700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:12:59.928596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:12:59.928596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:12:59.928596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:12:59.928596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:12:59.928596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:12:59.928596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:12:59.928596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:12:59.928596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:12:59.932482 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 505/980] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:12:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:12:59.933716 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d9586-1c6a-4734-88a0-c35d9d514981 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:00.037609 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d9586-1c6a-4734-88a0-c35d9d514981 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:00.072036 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72a2cc-485e-4e19-97da-e2c6983d2ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:00.072701 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72a2cc-485e-4e19-97da-e2c6983d2ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:00.072982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72a2cc-485e-4e19-97da-e2c6983d2ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:00.073254 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72a2cc-485e-4e19-97da-e2c6983d2ba0 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:00.073998 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72a2cc-485e-4e19-97da-e2c6983d2ba0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:00.074303 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72a2cc-485e-4e19-97da-e2c6983d2ba0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:00.075718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72a2cc-485e-4e19-97da-e2c6983d2ba0 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:00.093081 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 476/981] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:12:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:00.094250 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf1d77-62e0-4ec9-89ad-89ff85bd05a3 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:00.195373 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf1d77-62e0-4ec9-89ad-89ff85bd05a3 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:00.197645 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:00.231038 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cc2fe-39a1-4e19-b763-8c7546152661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:00.231653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cc2fe-39a1-4e19-b763-8c7546152661 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:00.231933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cc2fe-39a1-4e19-b763-8c7546152661 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:00.232226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cc2fe-39a1-4e19-b763-8c7546152661 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:00.233038 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063cc2fe-39a1-4e19-b763-8c7546152661 None admin] RBAC: Adding query filter params (role.id=15b22a1f53864b52a7b212d5adf916db, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=306a5f4d7e0d44bd9a27145bd35a07fc) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:00.233330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063cc2fe-39a1-4e19-b763-8c7546152661 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:00.234985 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063cc2fe-39a1-4e19-b763-8c7546152661 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:00.248284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 506/982] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:13:00 2022] GET /identity/v3/role_assignments?user.id=306a5f4d7e0d44bd9a27145bd35a07fc&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=15b22a1f53864b52a7b212d5adf916db => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:01.279833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443bfb3-23be-4d4e-bcfe-0d8c0616b9dd None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:01.280406 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443bfb3-23be-4d4e-bcfe-0d8c0616b9dd None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:01.280406 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443bfb3-23be-4d4e-bcfe-0d8c0616b9dd None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:01.282396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 477/983] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:01.288088 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6af4aa-60b7-4875-a313-8dd4ca028abd None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:01.288585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6af4aa-60b7-4875-a313-8dd4ca028abd None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:01.288766 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6af4aa-60b7-4875-a313-8dd4ca028abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:01.306927 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5e6af4aa-60b7-4875-a313-8dd4ca028abd None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:01.308123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5e6af4aa-60b7-4875-a313-8dd4ca028abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:01.380263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 507/984] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:01.400915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443bfb3-23be-4d4e-bcfe-0d8c0616b9dd None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:01.436106 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bc771-befa-45f4-95cc-14230829d076 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:01.436718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bc771-befa-45f4-95cc-14230829d076 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:01.436963 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bc771-befa-45f4-95cc-14230829d076 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:01.439013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 508/985] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:01.444088 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81431e19-5502-4cdb-833a-a1242bde6e9b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:01.444422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81431e19-5502-4cdb-833a-a1242bde6e9b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:01.444711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81431e19-5502-4cdb-833a-a1242bde6e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:01.452483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:01.462713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-81431e19-5502-4cdb-833a-a1242bde6e9b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:01.463911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-81431e19-5502-4cdb-833a-a1242bde6e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:01.518981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443bfb3-23be-4d4e-bcfe-0d8c0616b9dd None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:01.533038 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 509/986] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 10:13:01.555633 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81431e19-5502-4cdb-833a-a1242bde6e9b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:01.565938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026e64a-729f-4c33-b0f7-ef5b70c5ab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:01.566605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026e64a-729f-4c33-b0f7-ef5b70c5ab40 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:01.566892 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026e64a-729f-4c33-b0f7-ef5b70c5ab40 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:01.567168 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026e64a-729f-4c33-b0f7-ef5b70c5ab40 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:01.567808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026e64a-729f-4c33-b0f7-ef5b70c5ab40 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:01.569228 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026e64a-729f-4c33-b0f7-ef5b70c5ab40 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:01.578580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-b026e64a-729f-4c33-b0f7-ef5b70c5ab40 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 10:13:01.578580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:01.578580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:13:01.578580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:13:01.578580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:13:01.578580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:13:01.578580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:13:01.578580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:13:01.578580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 10:13:01.578580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:01.578580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:13:01.578580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:01.578580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:01.578580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:01.578580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:01.578580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:01.578580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:01.579567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:01.579567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:01.579567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:01.579567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:01.579567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:01.579567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:01.579567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:13:01.579567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:13:01.579567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:13:01.579567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:13:01.579567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:01.579567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:01.579567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:01.579567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:01.579567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:01.579567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:01.580447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:01.580447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:01.580447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:01.580447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:01.580447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:01.580447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:01.580447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:01.580447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:01.580447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:01.580447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:01.580447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:13:01.580447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:13:01.580447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 10:13:01.580447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:01.586926 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 478/987] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Aug 4 10:13:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:01.587715 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:01.588917 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026e64a-729f-4c33-b0f7-ef5b70c5ab40 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:01.670782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81431e19-5502-4cdb-833a-a1242bde6e9b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:01.708028 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce57a8c-7aae-473e-8cd8-84da808b661b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:01.708717 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce57a8c-7aae-473e-8cd8-84da808b661b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:01.709003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce57a8c-7aae-473e-8cd8-84da808b661b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:01.709282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce57a8c-7aae-473e-8cd8-84da808b661b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:01.709914 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce57a8c-7aae-473e-8cd8-84da808b661b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:01.711295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce57a8c-7aae-473e-8cd8-84da808b661b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:01.713258 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026e64a-729f-4c33-b0f7-ef5b70c5ab40 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:01.717357 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:01.721329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-0ce57a8c-7aae-473e-8cd8-84da808b661b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 10:13:01.721329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:01.721329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:13:01.721329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:13:01.721329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:13:01.721329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:13:01.721329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:13:01.721329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:13:01.721329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 10:13:01.721329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:01.721329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:13:01.721329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:01.721329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:01.721329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:01.721329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:01.721329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:01.721329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:01.722357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:01.722357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:01.722357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:01.722357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:01.722357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:01.722357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:01.722357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:13:01.722357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:13:01.722357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:13:01.722357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:13:01.722357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:01.722357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:01.722357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:01.722357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:01.722357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:01.722357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:01.723182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:01.723182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:01.723182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:01.723182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:01.723182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:01.723182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:01.723182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:01.723182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:01.723182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:01.723182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:01.723182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:13:01.723182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:13:01.723182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 10:13:01.723182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:01.723182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 510/988] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:13:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:13:01.728669 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce57a8c-7aae-473e-8cd8-84da808b661b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:01.760339 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11759153-59e2-4da5-a6f4-419a874492a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:01.761001 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759153-59e2-4da5-a6f4-419a874492a1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:01.761267 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759153-59e2-4da5-a6f4-419a874492a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:01.761526 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759153-59e2-4da5-a6f4-419a874492a1 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:01.762214 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11759153-59e2-4da5-a6f4-419a874492a1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:01.762531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11759153-59e2-4da5-a6f4-419a874492a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:01.763912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11759153-59e2-4da5-a6f4-419a874492a1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:01.773959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 479/989] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Aug 4 10:13:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:01.774856 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11759153-59e2-4da5-a6f4-419a874492a1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:01.834261 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:01.845824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce57a8c-7aae-473e-8cd8-84da808b661b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:01.880902 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c402d-32c1-4317-a7e1-093fe2a8b76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:01.881539 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c402d-32c1-4317-a7e1-093fe2a8b76b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:01.881826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c402d-32c1-4317-a7e1-093fe2a8b76b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:01.882105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c402d-32c1-4317-a7e1-093fe2a8b76b None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:01.882787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c402d-32c1-4317-a7e1-093fe2a8b76b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:01.883093 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c402d-32c1-4317-a7e1-093fe2a8b76b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:01.883736 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11759153-59e2-4da5-a6f4-419a874492a1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:01.884495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c402d-32c1-4317-a7e1-093fe2a8b76b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:01.889412 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 511/990] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Aug 4 10:13:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:01.895053 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c402d-32c1-4317-a7e1-093fe2a8b76b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:01.925837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f501b-e885-46ee-acbb-72ecfc2a1df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:01.926495 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f501b-e885-46ee-acbb-72ecfc2a1df6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:01.926784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f501b-e885-46ee-acbb-72ecfc2a1df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:01.927066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f501b-e885-46ee-acbb-72ecfc2a1df6 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:01.927944 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f501b-e885-46ee-acbb-72ecfc2a1df6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:01.928081 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f501b-e885-46ee-acbb-72ecfc2a1df6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:01.929459 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f501b-e885-46ee-acbb-72ecfc2a1df6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:01.939903 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 480/991] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Aug 4 10:13:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:01.941038 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f501b-e885-46ee-acbb-72ecfc2a1df6 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:01.975909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:02.010377 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c402d-32c1-4317-a7e1-093fe2a8b76b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:02.046601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4dc66-c9e6-4d8b-974b-0e0c02ba7cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:02.047327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4dc66-c9e6-4d8b-974b-0e0c02ba7cda None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:02.047551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4dc66-c9e6-4d8b-974b-0e0c02ba7cda None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:02.047812 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4dc66-c9e6-4d8b-974b-0e0c02ba7cda None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:02.048525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4dc66-c9e6-4d8b-974b-0e0c02ba7cda None admin] RBAC: Adding query filter params (type=compute) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:02.048832 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4dc66-c9e6-4d8b-974b-0e0c02ba7cda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:02.050183 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f501b-e885-46ee-acbb-72ecfc2a1df6 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:02.050287 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4dc66-c9e6-4d8b-974b-0e0c02ba7cda None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:02.056121 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 512/992] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Aug 4 10:13:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:02.061912 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4dc66-c9e6-4d8b-974b-0e0c02ba7cda None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:02.084667 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:02.090149 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7470d-f76b-415a-aadc-f5f127b7086e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:02.090797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7470d-f76b-415a-aadc-f5f127b7086e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:02.091080 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7470d-f76b-415a-aadc-f5f127b7086e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:02.091358 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7470d-f76b-415a-aadc-f5f127b7086e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:02.092132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7470d-f76b-415a-aadc-f5f127b7086e None admin] RBAC: Adding query filter params (interface=admin, service_id=e48ace9ce8c4439381076d3a1ba496cf, region_id=RegionOne) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:02.092586 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7470d-f76b-415a-aadc-f5f127b7086e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:02.094543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7470d-f76b-415a-aadc-f5f127b7086e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:02.104267 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 481/993] 10.222.0.48 () {56 vars in 1249 bytes} [Thu Aug 4 10:13:01 2022] GET /identity/v3/endpoints?service_id=e48ace9ce8c4439381076d3a1ba496cf&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:02.105250 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7470d-f76b-415a-aadc-f5f127b7086e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:02.173473 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4dc66-c9e6-4d8b-974b-0e0c02ba7cda None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:02.209225 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:02.210205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061a73a-0502-4084-a8a8-e48432e11324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:02.210913 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061a73a-0502-4084-a8a8-e48432e11324 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:02.211244 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061a73a-0502-4084-a8a8-e48432e11324 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:02.211625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061a73a-0502-4084-a8a8-e48432e11324 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:02.212457 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061a73a-0502-4084-a8a8-e48432e11324 None admin] RBAC: Adding query filter params (interface=public, service_id=bd757f202b9d48b78f62efff3185e8c0, region_id=RegionOne) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:02.212773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061a73a-0502-4084-a8a8-e48432e11324 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:02.214162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061a73a-0502-4084-a8a8-e48432e11324 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:02.217860 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7470d-f76b-415a-aadc-f5f127b7086e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:02.224813 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 513/994] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Aug 4 10:13:02 2022] GET /identity/v3/endpoints?service_id=bd757f202b9d48b78f62efff3185e8c0&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:02.225936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061a73a-0502-4084-a8a8-e48432e11324 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:02.259835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef419e-68c6-4079-bb1d-35ef4ce0a921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:02.260498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef419e-68c6-4079-bb1d-35ef4ce0a921 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:02.260780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef419e-68c6-4079-bb1d-35ef4ce0a921 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:02.261059 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef419e-68c6-4079-bb1d-35ef4ce0a921 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:02.261718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef419e-68c6-4079-bb1d-35ef4ce0a921 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:02.263090 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef419e-68c6-4079-bb1d-35ef4ce0a921 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:02.280211 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 482/995] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Aug 4 10:13:02 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:13:02.326863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:02.330980 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c3301-51d9-42a6-a18c-1ee1b64b8898 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:02.331315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c3301-51d9-42a6-a18c-1ee1b64b8898 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:02.331514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c3301-51d9-42a6-a18c-1ee1b64b8898 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:02.333285 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 483/996] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:13:02.338614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21dd5e-2918-44de-bbc3-5ea0bf2197ad None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:02.339017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21dd5e-2918-44de-bbc3-5ea0bf2197ad None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:02.339279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21dd5e-2918-44de-bbc3-5ea0bf2197ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:02.350905 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061a73a-0502-4084-a8a8-e48432e11324 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:02.359036 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-cc21dd5e-2918-44de-bbc3-5ea0bf2197ad None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:02.360699 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cc21dd5e-2918-44de-bbc3-5ea0bf2197ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:02.388796 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80f905-9066-4366-9c3e-d54b9442d72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:02.389450 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80f905-9066-4366-9c3e-d54b9442d72d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:02.389733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80f905-9066-4366-9c3e-d54b9442d72d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:02.390012 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80f905-9066-4366-9c3e-d54b9442d72d None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:02.390751 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80f905-9066-4366-9c3e-d54b9442d72d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:02.392912 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80f905-9066-4366-9c3e-d54b9442d72d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:02.400049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 514/997] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Aug 4 10:13:02 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:13:02.443478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 484/998] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 10:13:02.466147 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80f905-9066-4366-9c3e-d54b9442d72d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:02.581334 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80f905-9066-4366-9c3e-d54b9442d72d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:02.617134 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b23f62-1f21-4114-af63-2f8d5e664a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:02.618040 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b23f62-1f21-4114-af63-2f8d5e664a21 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:02.618455 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b23f62-1f21-4114-af63-2f8d5e664a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:02.618858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b23f62-1f21-4114-af63-2f8d5e664a21 None admin] PATH_INFO: `/v3/services/image` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:02.619620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b23f62-1f21-4114-af63-2f8d5e664a21 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:02.621714 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b23f62-1f21-4114-af63-2f8d5e664a21 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:02.632307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-a1b23f62-1f21-4114-af63-2f8d5e664a21 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 10:13:02.632307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:02.632307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:13:02.632307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:13:02.632307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:13:02.632307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:13:02.632307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:13:02.632307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:13:02.632307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 10:13:02.632307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:02.632307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:13:02.632307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:02.632307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:02.632307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:02.632307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:02.632307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:02.632307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:02.633366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:02.633366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:02.633366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:02.633366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:02.633366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:02.633366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:02.633366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:13:02.633366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:13:02.633366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:13:02.633366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:13:02.633366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:02.633366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:02.633366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:02.633366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:02.633366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:02.633366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:02.634701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:02.634701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:02.634701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:02.634701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:02.634701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:02.634701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:02.634701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:02.634701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:02.634701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:02.634701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:02.634701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:13:02.634701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:13:02.634701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 10:13:02.634701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:02.634701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 515/999] 10.222.0.48 () {56 vars in 1105 bytes} [Thu Aug 4 10:13:02 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:02.639433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21dd5e-2918-44de-bbc3-5ea0bf2197ad None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:02.736117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:02.758229 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21dd5e-2918-44de-bbc3-5ea0bf2197ad None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:02.796408 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89fcaa-576d-4e89-ae88-20406bde3282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:02.797543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89fcaa-576d-4e89-ae88-20406bde3282 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:02.798181 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89fcaa-576d-4e89-ae88-20406bde3282 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:02.798181 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89fcaa-576d-4e89-ae88-20406bde3282 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:02.798872 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89fcaa-576d-4e89-ae88-20406bde3282 None admin] RBAC: Adding query filter params (name=image) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:02.799176 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89fcaa-576d-4e89-ae88-20406bde3282 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:02.800553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89fcaa-576d-4e89-ae88-20406bde3282 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:02.805558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 485/1000] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:13:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:02.811623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b23f62-1f21-4114-af63-2f8d5e664a21 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:02.827948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:02.919613 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b23f62-1f21-4114-af63-2f8d5e664a21 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:02.956718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17993355-123c-4d9b-98e8-bbdb6e23be6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:02.957347 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17993355-123c-4d9b-98e8-bbdb6e23be6c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:02.957625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17993355-123c-4d9b-98e8-bbdb6e23be6c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:02.957893 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17993355-123c-4d9b-98e8-bbdb6e23be6c None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:02.958559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17993355-123c-4d9b-98e8-bbdb6e23be6c None admin] RBAC: Adding query filter params (type=image) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:02.958861 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17993355-123c-4d9b-98e8-bbdb6e23be6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:02.960245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17993355-123c-4d9b-98e8-bbdb6e23be6c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:02.972204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 516/1001] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:13:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:04.358418 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50b6ac-35aa-46b3-b5c2-422e1db51434 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:04.358939 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50b6ac-35aa-46b3-b5c2-422e1db51434 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:04.359049 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50b6ac-35aa-46b3-b5c2-422e1db51434 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:04.361202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 486/1002] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:04.366394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a48be1-3d5b-4c8e-b92c-e0d435acfc98 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:04.366793 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a48be1-3d5b-4c8e-b92c-e0d435acfc98 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:04.366956 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a48be1-3d5b-4c8e-b92c-e0d435acfc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:04.385659 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a3a48be1-3d5b-4c8e-b92c-e0d435acfc98 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:04.386860 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a3a48be1-3d5b-4c8e-b92c-e0d435acfc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:04.446049 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d308d-54e2-4de4-afec-680efce60094 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:04.446360 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d308d-54e2-4de4-afec-680efce60094 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:04.446617 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d308d-54e2-4de4-afec-680efce60094 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:04.447983 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 487/1003] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:13:04.453001 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e7334-49d0-4c80-a8f8-fcf6932f1702 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:04.453343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e7334-49d0-4c80-a8f8-fcf6932f1702 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:04.453763 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e7334-49d0-4c80-a8f8-fcf6932f1702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:04.463783 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 517/1004] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:04.472276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-238e7334-49d0-4c80-a8f8-fcf6932f1702 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:04.473477 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-238e7334-49d0-4c80-a8f8-fcf6932f1702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:04.487161 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a48be1-3d5b-4c8e-b92c-e0d435acfc98 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:04.495257 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:04.552311 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 488/1005] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 10:13:04.575313 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e7334-49d0-4c80-a8f8-fcf6932f1702 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:04.603385 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a48be1-3d5b-4c8e-b92c-e0d435acfc98 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:04.645345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f33aa-1b1d-4194-8560-418f5e3b56b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:04.646006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f33aa-1b1d-4194-8560-418f5e3b56b0 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:04.646271 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f33aa-1b1d-4194-8560-418f5e3b56b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:04.646544 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f33aa-1b1d-4194-8560-418f5e3b56b0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:04.647168 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f33aa-1b1d-4194-8560-418f5e3b56b0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:04.648568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f33aa-1b1d-4194-8560-418f5e3b56b0 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:04.658300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-703f33aa-1b1d-4194-8560-418f5e3b56b0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 10:13:04.658300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:04.658300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:13:04.658300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:13:04.658300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:13:04.658300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:13:04.658300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:13:04.658300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:13:04.658300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 10:13:04.658300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:04.658300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:13:04.658300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:04.658300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:04.658300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:04.658300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:04.658300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:04.658300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:04.659316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:04.659316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:04.659316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:04.659316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:04.659316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:04.659316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:04.659316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:13:04.659316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:13:04.659316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:13:04.659316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:13:04.659316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:04.659316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:04.659316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:04.659316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:04.659316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:04.659316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:04.661021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:04.661021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:04.661021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:04.661021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:04.661021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:04.661021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:04.661021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:04.661021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:04.661021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:04.661021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:04.661021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:13:04.661021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:13:04.661021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 10:13:04.661021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:04.661021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 518/1006] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Aug 4 10:13:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:13:04.665358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f33aa-1b1d-4194-8560-418f5e3b56b0 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:04.674215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:04.693321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e7334-49d0-4c80-a8f8-fcf6932f1702 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:04.730700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9867e6f-4332-4d17-aa91-f5ff927cfb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:04.731343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9867e6f-4332-4d17-aa91-f5ff927cfb2f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:04.731662 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9867e6f-4332-4d17-aa91-f5ff927cfb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:04.731898 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9867e6f-4332-4d17-aa91-f5ff927cfb2f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:04.732565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9867e6f-4332-4d17-aa91-f5ff927cfb2f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:04.733939 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9867e6f-4332-4d17-aa91-f5ff927cfb2f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:04.740793 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:04.743780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-a9867e6f-4332-4d17-aa91-f5ff927cfb2f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 10:13:04.743780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:04.743780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:13:04.743780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:13:04.743780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:13:04.743780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:13:04.743780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:13:04.743780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:13:04.743780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 10:13:04.743780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:04.743780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:13:04.743780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:04.743780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:04.743780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:04.743780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:04.743780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:04.743780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:04.745026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:04.745026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:04.745026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:04.745026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:04.745026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:04.745026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:04.745026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:13:04.745026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:13:04.745026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:13:04.745026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:13:04.745026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:04.745026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:04.745026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:04.745026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:04.745026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:04.745026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:04.751128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:04.751128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:04.751128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:04.751128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:04.751128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:04.751128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:04.751128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:04.751128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:04.751128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:04.751128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:04.751128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:13:04.751128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:13:04.751128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 10:13:04.751128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:04.751128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 489/1007] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:13:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:13:04.754578 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9867e6f-4332-4d17-aa91-f5ff927cfb2f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:04.778923 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f33aa-1b1d-4194-8560-418f5e3b56b0 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:04.815955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479a35d-d7eb-4288-a98c-e0a27493be8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:04.816622 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479a35d-d7eb-4288-a98c-e0a27493be8c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:04.816906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479a35d-d7eb-4288-a98c-e0a27493be8c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:04.817184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479a35d-d7eb-4288-a98c-e0a27493be8c None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:04.817862 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479a35d-d7eb-4288-a98c-e0a27493be8c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:04.818173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479a35d-d7eb-4288-a98c-e0a27493be8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:04.819558 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479a35d-d7eb-4288-a98c-e0a27493be8c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:04.825190 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 519/1008] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Aug 4 10:13:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:04.830756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479a35d-d7eb-4288-a98c-e0a27493be8c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:04.867360 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9867e6f-4332-4d17-aa91-f5ff927cfb2f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:04.903157 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446e0cc-a71f-40cd-add6-f2681f995708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:04.903712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446e0cc-a71f-40cd-add6-f2681f995708 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:04.903995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446e0cc-a71f-40cd-add6-f2681f995708 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:04.904308 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446e0cc-a71f-40cd-add6-f2681f995708 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:04.904996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446e0cc-a71f-40cd-add6-f2681f995708 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:04.905307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446e0cc-a71f-40cd-add6-f2681f995708 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:04.906819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446e0cc-a71f-40cd-add6-f2681f995708 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:04.911907 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 490/1009] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Aug 4 10:13:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:04.917594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446e0cc-a71f-40cd-add6-f2681f995708 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:04.935638 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:04.942326 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479a35d-d7eb-4288-a98c-e0a27493be8c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:04.982795 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4c1df-988c-4056-9010-c1b14b4788a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:04.983423 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4c1df-988c-4056-9010-c1b14b4788a2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:04.983713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4c1df-988c-4056-9010-c1b14b4788a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:04.985000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4c1df-988c-4056-9010-c1b14b4788a2 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:04.985749 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4c1df-988c-4056-9010-c1b14b4788a2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:04.985998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4c1df-988c-4056-9010-c1b14b4788a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:04.987305 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4c1df-988c-4056-9010-c1b14b4788a2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:04.988829 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:04.996504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 520/1010] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Aug 4 10:13:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:04.997818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ca3d3-33c6-4d5f-9070-e7af6a4c3a67 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:04.998110 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ca3d3-33c6-4d5f-9070-e7af6a4c3a67 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:04.998389 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ca3d3-33c6-4d5f-9070-e7af6a4c3a67 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:04.999638 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 521/1011] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:05.001217 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ca3d3-33c6-4d5f-9070-e7af6a4c3a67 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:05.035651 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446e0cc-a71f-40cd-add6-f2681f995708 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:05.070554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a7717-65c4-46e1-a5e8-e340c451ba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:05.071176 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a7717-65c4-46e1-a5e8-e340c451ba72 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:05.071462 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a7717-65c4-46e1-a5e8-e340c451ba72 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:05.071743 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a7717-65c4-46e1-a5e8-e340c451ba72 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:05.072466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a7717-65c4-46e1-a5e8-e340c451ba72 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:05.072780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a7717-65c4-46e1-a5e8-e340c451ba72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:05.074148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a7717-65c4-46e1-a5e8-e340c451ba72 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:05.078928 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 491/1012] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Aug 4 10:13:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:05.080252 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba9395-4f35-4bd0-a8ef-d0685eb5cb50 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:05.080542 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba9395-4f35-4bd0-a8ef-d0685eb5cb50 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:05.080819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba9395-4f35-4bd0-a8ef-d0685eb5cb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:05.098624 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-68ba9395-4f35-4bd0-a8ef-d0685eb5cb50 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:05.099842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-68ba9395-4f35-4bd0-a8ef-d0685eb5cb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:05.106409 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ca3d3-33c6-4d5f-9070-e7af6a4c3a67 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:05.141614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9f551-af35-4304-87bf-7c0b07acb455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:05.142242 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9f551-af35-4304-87bf-7c0b07acb455 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:05.142570 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9f551-af35-4304-87bf-7c0b07acb455 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:05.142846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9f551-af35-4304-87bf-7c0b07acb455 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:05.143540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9f551-af35-4304-87bf-7c0b07acb455 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:05.144958 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9f551-af35-4304-87bf-7c0b07acb455 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:05.161607 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 522/1013] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:13:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:13:05.165087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9f551-af35-4304-87bf-7c0b07acb455 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:05.177614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 492/1014] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:05 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:05.203178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba9395-4f35-4bd0-a8ef-d0685eb5cb50 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:05.205833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:05.247331 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:05.303322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9f551-af35-4304-87bf-7c0b07acb455 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:05.326674 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba9395-4f35-4bd0-a8ef-d0685eb5cb50 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:05.344424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dee2e7-dbb1-48bf-96a8-821b3ede9169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:05.345233 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dee2e7-dbb1-48bf-96a8-821b3ede9169 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:05.345540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dee2e7-dbb1-48bf-96a8-821b3ede9169 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:05.346995 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dee2e7-dbb1-48bf-96a8-821b3ede9169 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:05.348532 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dee2e7-dbb1-48bf-96a8-821b3ede9169 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:05.349146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dee2e7-dbb1-48bf-96a8-821b3ede9169 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:05.372957 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 523/1015] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:13:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:13:05.386828 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687c7b8-18b2-4504-a932-768b136d2cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:05.387560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687c7b8-18b2-4504-a932-768b136d2cb4 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:05.387760 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687c7b8-18b2-4504-a932-768b136d2cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:05.388016 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687c7b8-18b2-4504-a932-768b136d2cb4 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:05.388774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687c7b8-18b2-4504-a932-768b136d2cb4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:05.390199 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687c7b8-18b2-4504-a932-768b136d2cb4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:05.416299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 493/1016] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Aug 4 10:13:05 2022] POST /identity/v3/services => generated 242 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:13:07.245600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bf6d7-a301-492a-a3f7-f1f7a14e27f1 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:07.246166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bf6d7-a301-492a-a3f7-f1f7a14e27f1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:07.246166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bf6d7-a301-492a-a3f7-f1f7a14e27f1 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:07.247653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 524/1017] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:07.253186 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff097204-9b2b-43de-ac13-d3a3889d5006 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:07.253631 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff097204-9b2b-43de-ac13-d3a3889d5006 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:07.253828 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff097204-9b2b-43de-ac13-d3a3889d5006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:07.273091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ff097204-9b2b-43de-ac13-d3a3889d5006 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:07.274349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ff097204-9b2b-43de-ac13-d3a3889d5006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:07.331580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:07.355056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 494/1018] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:07.378763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bf6d7-a301-492a-a3f7-f1f7a14e27f1 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:07.486993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd8118-36d9-4194-bcd2-101c37c6fd5e None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:07.487326 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd8118-36d9-4194-bcd2-101c37c6fd5e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:07.487572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd8118-36d9-4194-bcd2-101c37c6fd5e None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:07.487772 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bf6d7-a301-492a-a3f7-f1f7a14e27f1 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:07.489117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 495/1019] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:13:07.494023 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad77e0-3e38-4ce2-903d-b1ccdf384756 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:07.494312 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad77e0-3e38-4ce2-903d-b1ccdf384756 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:07.494592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad77e0-3e38-4ce2-903d-b1ccdf384756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:07.505221 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:07.513483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7bad77e0-3e38-4ce2-903d-b1ccdf384756 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:07.514872 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7bad77e0-3e38-4ce2-903d-b1ccdf384756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:07.528595 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a2669-f954-4633-b36f-d5a4e8bfac67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:07.529270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a2669-f954-4633-b36f-d5a4e8bfac67 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:07.529555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a2669-f954-4633-b36f-d5a4e8bfac67 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:07.529829 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a2669-f954-4633-b36f-d5a4e8bfac67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:07.531065 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a2669-f954-4633-b36f-d5a4e8bfac67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:07.533554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a2669-f954-4633-b36f-d5a4e8bfac67 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:07.539991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 525/1020] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:13:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:07.539991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321a783-ec8e-4439-8f0c-ff94b8dc012c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:07.539991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321a783-ec8e-4439-8f0c-ff94b8dc012c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:07.539991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321a783-ec8e-4439-8f0c-ff94b8dc012c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:07.539991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 526/1021] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:07.540955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321a783-ec8e-4439-8f0c-ff94b8dc012c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:07.588992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 496/1022] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:07.592409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7807c-0d05-4e05-8d24-0d8a4545f141 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:07.592409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7807c-0d05-4e05-8d24-0d8a4545f141 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:07.592409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7807c-0d05-4e05-8d24-0d8a4545f141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:07.613580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-35c7807c-0d05-4e05-8d24-0d8a4545f141 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:07.614784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-35c7807c-0d05-4e05-8d24-0d8a4545f141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:07.646774 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321a783-ec8e-4439-8f0c-ff94b8dc012c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:07.680799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f636aa0-ca2e-4fc9-a53e-bd72c499c254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:07.681430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f636aa0-ca2e-4fc9-a53e-bd72c499c254 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:07.681718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f636aa0-ca2e-4fc9-a53e-bd72c499c254 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:07.682001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f636aa0-ca2e-4fc9-a53e-bd72c499c254 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:07.682687 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f636aa0-ca2e-4fc9-a53e-bd72c499c254 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:07.682972 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 497/1023] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:07.683813 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7807c-0d05-4e05-8d24-0d8a4545f141 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:07.684311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f636aa0-ca2e-4fc9-a53e-bd72c499c254 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:07.715081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 527/1024] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Aug 4 10:13:07 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:13:07.715917 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f636aa0-ca2e-4fc9-a53e-bd72c499c254 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:07.736908 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:07.757566 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:07.809232 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7807c-0d05-4e05-8d24-0d8a4545f141 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:07.842995 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f636aa0-ca2e-4fc9-a53e-bd72c499c254 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:07.849599 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ad636-baa3-4671-96b1-d060349ff5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:07.850277 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ad636-baa3-4671-96b1-d060349ff5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:07.850563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ad636-baa3-4671-96b1-d060349ff5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:07.850868 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ad636-baa3-4671-96b1-d060349ff5d5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:07.851510 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ad636-baa3-4671-96b1-d060349ff5d5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:07.853590 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ad636-baa3-4671-96b1-d060349ff5d5 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:07.864492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-c52ad636-baa3-4671-96b1-d060349ff5d5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 10:13:07.864492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:07.864492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:13:07.864492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:13:07.864492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:13:07.864492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:13:07.864492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:13:07.864492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:13:07.864492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 10:13:07.864492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:07.864492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:13:07.864492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:07.864492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:07.864492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:07.864492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:07.864492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:07.864492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:07.865552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:07.865552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:07.865552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:07.865552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:07.865552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:07.865552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:07.865552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:13:07.865552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:13:07.865552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:13:07.865552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:13:07.865552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:07.865552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:07.865552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:07.865552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:07.865552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:07.865552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:07.869665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:07.869665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:07.869665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:07.869665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:07.869665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:07.869665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:07.869665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:07.869665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:07.869665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:07.869665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:07.869665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:13:07.869665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:13:07.869665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 10:13:07.869665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:07.869665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 498/1025] 10.222.0.48 () {56 vars in 1105 bytes} [Thu Aug 4 10:13:07 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:07.871603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ad636-baa3-4671-96b1-d060349ff5d5 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:07.889266 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9559cad-cc02-4072-a914-68b5715f13eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:07.889997 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9559cad-cc02-4072-a914-68b5715f13eb None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:07.890285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9559cad-cc02-4072-a914-68b5715f13eb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:07.891221 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9559cad-cc02-4072-a914-68b5715f13eb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:07.902077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9559cad-cc02-4072-a914-68b5715f13eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:13:07.908124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-e9559cad-cc02-4072-a914-68b5715f13eb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 10:13:07.908124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:07.908124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:07.908124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:07.908124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:07.908124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:07.908124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:07.908124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:07.908124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:07.908124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:07.908124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:07.908124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:07.908124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:13:07.908124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:13:07.908124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:13:07.908124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:13:07.909162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:13:07.909162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:13:07.909162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:13:07.909162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:13:07.909162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:07.909162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:07.909162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:07.909162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:07.909162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:07.909162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:07.909162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:07.909162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:07.909162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:07.909162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:07.909162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:07.909162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:07.909970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:07.909970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:07.909970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:07.909970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:07.909970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:13:07.909970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:13:07.909970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:13:07.909970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:13:07.909970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:13:07.909970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:13:07.909970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 10:13:07.909970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:07.910586 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 528/1026] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Aug 4 10:13:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:07.916815 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9559cad-cc02-4072-a914-68b5715f13eb None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:07.990158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ad636-baa3-4671-96b1-d060349ff5d5 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:08.001879 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:08.021637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:08.029799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9559cad-cc02-4072-a914-68b5715f13eb None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:08.031915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397258a-1e80-449e-b969-7ac977f490e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:08.032929 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397258a-1e80-449e-b969-7ac977f490e1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:08.033216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397258a-1e80-449e-b969-7ac977f490e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:08.033492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397258a-1e80-449e-b969-7ac977f490e1 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:08.034368 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397258a-1e80-449e-b969-7ac977f490e1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:08.034682 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397258a-1e80-449e-b969-7ac977f490e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:08.036060 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397258a-1e80-449e-b969-7ac977f490e1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:08.046001 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 499/1027] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:13:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:08.047255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397258a-1e80-449e-b969-7ac977f490e1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:08.071441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87c912-3fef-47e0-804d-4187e251f293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:08.072575 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87c912-3fef-47e0-804d-4187e251f293 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:08.072865 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87c912-3fef-47e0-804d-4187e251f293 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:08.073308 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87c912-3fef-47e0-804d-4187e251f293 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:08.074066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87c912-3fef-47e0-804d-4187e251f293 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:08.074378 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87c912-3fef-47e0-804d-4187e251f293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:08.075777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87c912-3fef-47e0-804d-4187e251f293 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:08.085225 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 529/1028] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Aug 4 10:13:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:08.090655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87c912-3fef-47e0-804d-4187e251f293 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:08.163941 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397258a-1e80-449e-b969-7ac977f490e1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:08.194343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87c912-3fef-47e0-804d-4187e251f293 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:08.201129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a114e19-05ea-460b-8dfe-0807b2ac3e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:08.202108 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a114e19-05ea-460b-8dfe-0807b2ac3e70 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:08.202567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a114e19-05ea-460b-8dfe-0807b2ac3e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:08.203685 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a114e19-05ea-460b-8dfe-0807b2ac3e70 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:08.205005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a114e19-05ea-460b-8dfe-0807b2ac3e70 None admin] RBAC: Adding query filter params (type=image) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:08.205609 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a114e19-05ea-460b-8dfe-0807b2ac3e70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:08.206985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a114e19-05ea-460b-8dfe-0807b2ac3e70 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:08.216247 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 500/1029] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:13:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:08.219933 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a114e19-05ea-460b-8dfe-0807b2ac3e70 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:08.231941 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52c5bf-14d3-409d-8bb4-dc7852179ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:08.232627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52c5bf-14d3-409d-8bb4-dc7852179ecc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:08.232921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52c5bf-14d3-409d-8bb4-dc7852179ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:08.233200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52c5bf-14d3-409d-8bb4-dc7852179ecc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:08.244468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52c5bf-14d3-409d-8bb4-dc7852179ecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:08.245940 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52c5bf-14d3-409d-8bb4-dc7852179ecc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:08.256953 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:08.262146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-fb52c5bf-14d3-409d-8bb4-dc7852179ecc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:13:08.262146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:08.262146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:08.262146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:08.262146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:08.262146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:08.262146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:08.262146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:08.262146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:08.262146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:08.262146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:08.262146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:08.262146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:13:08.262146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:13:08.262146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:13:08.263050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:13:08.263050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:08.263050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:08.263050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:08.263050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:08.263050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:08.263050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:08.263050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:08.263050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:08.263050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:08.263050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:08.263050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:08.263050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:08.263050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:08.263050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:08.263050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:08.263050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:08.263930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:13:08.263930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:13:08.263930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:13:08.263930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:08.268493 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 530/1030] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:13:08.269929 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52c5bf-14d3-409d-8bb4-dc7852179ecc None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:08.284853 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:08.335963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a114e19-05ea-460b-8dfe-0807b2ac3e70 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:08.370451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f80dee-ff61-4323-abee-316455a5cdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:08.371080 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f80dee-ff61-4323-abee-316455a5cdd9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:08.371360 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f80dee-ff61-4323-abee-316455a5cdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:08.371627 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f80dee-ff61-4323-abee-316455a5cdd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:08.372413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f80dee-ff61-4323-abee-316455a5cdd9 None admin] RBAC: Adding query filter params (interface=public, service_id=d175168db657451594270021d6c896a7, region_id=RegionOne) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:08.372728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f80dee-ff61-4323-abee-316455a5cdd9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:08.374345 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f80dee-ff61-4323-abee-316455a5cdd9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:08.384677 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 501/1031] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Aug 4 10:13:08 2022] GET /identity/v3/endpoints?service_id=d175168db657451594270021d6c896a7&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:08.385665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f80dee-ff61-4323-abee-316455a5cdd9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:08.388972 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52c5bf-14d3-409d-8bb4-dc7852179ecc None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:08.426003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff9394-7baf-4587-8f41-13eec26a7bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:08.426634 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff9394-7baf-4587-8f41-13eec26a7bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:08.426919 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff9394-7baf-4587-8f41-13eec26a7bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:08.427198 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff9394-7baf-4587-8f41-13eec26a7bb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:08.427895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff9394-7baf-4587-8f41-13eec26a7bb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:08.428234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff9394-7baf-4587-8f41-13eec26a7bb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:08.429618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff9394-7baf-4587-8f41-13eec26a7bb4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:08.443868 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 531/1032] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:08.449829 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff9394-7baf-4587-8f41-13eec26a7bb4 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:08.491288 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:08.494249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f80dee-ff61-4323-abee-316455a5cdd9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:08.532657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34039746-5241-4489-89e1-e0cf50a15499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:08.533390 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34039746-5241-4489-89e1-e0cf50a15499 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:08.536689 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34039746-5241-4489-89e1-e0cf50a15499 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:08.536689 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34039746-5241-4489-89e1-e0cf50a15499 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:08.536689 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34039746-5241-4489-89e1-e0cf50a15499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:08.536689 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34039746-5241-4489-89e1-e0cf50a15499 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:08.552888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 502/1033] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Aug 4 10:13:08 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:13:08.553115 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:08.592857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff9394-7baf-4587-8f41-13eec26a7bb4 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:08.636583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8e35a-bdf4-4de4-9603-696a70374ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:08.637442 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8e35a-bdf4-4de4-9603-696a70374ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:08.637716 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8e35a-bdf4-4de4-9603-696a70374ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:08.637989 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8e35a-bdf4-4de4-9603-696a70374ee6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:08.647280 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8e35a-bdf4-4de4-9603-696a70374ee6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:08.648809 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8e35a-bdf4-4de4-9603-696a70374ee6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:08.662099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-2fe8e35a-bdf4-4de4-9603-696a70374ee6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 10:13:08.662099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:08.662099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:08.662099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:08.662099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:08.662099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:08.662099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:08.662099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:08.662099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:08.662099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:08.662099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:08.662099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:08.662099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:13:08.662099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:13:08.662099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:13:08.662099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:13:08.663141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:08.663141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:08.663141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:13:08.663141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:13:08.663141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:13:08.663141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:13:08.663141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:08.663141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:08.663141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:08.663141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:08.663141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:08.663141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:08.663141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:08.663141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:08.663141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:08.663141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:08.663141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:08.663141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:08.664070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:08.664070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:08.664070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:13:08.664070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:13:08.664070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:13:08.664070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:13:08.664070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:13:08.664070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:13:08.664070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 10:13:08.664070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:08.668223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 532/1034] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Aug 4 10:13:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:08.669542 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34039746-5241-4489-89e1-e0cf50a15499 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:08.777996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34039746-5241-4489-89e1-e0cf50a15499 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:08.814771 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bdbe8-e173-4f78-b0ef-983a91364609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:08.815409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bdbe8-e173-4f78-b0ef-983a91364609 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:08.815686 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bdbe8-e173-4f78-b0ef-983a91364609 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:08.815959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bdbe8-e173-4f78-b0ef-983a91364609 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:08.816790 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bdbe8-e173-4f78-b0ef-983a91364609 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:08.817097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bdbe8-e173-4f78-b0ef-983a91364609 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:08.818511 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bdbe8-e173-4f78-b0ef-983a91364609 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:08.836959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 503/1035] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Aug 4 10:13:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:08.842751 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8e35a-bdf4-4de4-9603-696a70374ee6 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:08.954572 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8e35a-bdf4-4de4-9603-696a70374ee6 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:08.983198 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:08.995176 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b556d1-b5e7-4ee1-af03-eb136d0505e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:08.995801 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b556d1-b5e7-4ee1-af03-eb136d0505e9 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:08.996082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b556d1-b5e7-4ee1-af03-eb136d0505e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:08.996377 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b556d1-b5e7-4ee1-af03-eb136d0505e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:09.068297 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b556d1-b5e7-4ee1-af03-eb136d0505e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:09.069691 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b556d1-b5e7-4ee1-af03-eb136d0505e9 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:09.178005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 533/1036] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:13:08 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:13:09.179720 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bdbe8-e173-4f78-b0ef-983a91364609 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:09.204886 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:09.283216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bdbe8-e173-4f78-b0ef-983a91364609 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:09.318640 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c12ad9-8e74-4356-a252-adcc26a9943f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:09.319212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c12ad9-8e74-4356-a252-adcc26a9943f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:09.319497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c12ad9-8e74-4356-a252-adcc26a9943f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:09.319776 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c12ad9-8e74-4356-a252-adcc26a9943f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:09.330347 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c12ad9-8e74-4356-a252-adcc26a9943f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:09.331796 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c12ad9-8e74-4356-a252-adcc26a9943f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:09.347537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-b9c12ad9-8e74-4356-a252-adcc26a9943f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:13:09.347537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:09.347537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:09.347537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:09.347537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:09.347537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:09.347537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:09.347537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:09.347537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:09.347537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:09.347537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:09.347537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:09.347537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:13:09.347537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:13:09.347537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:13:09.348673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:13:09.348673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:09.348673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:09.348673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:09.348673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:09.348673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:09.348673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:09.348673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:09.348673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:09.348673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:09.348673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:09.348673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:09.348673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:09.348673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:09.348673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:09.348673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:09.348673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:09.349676 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:13:09.349676 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:13:09.349676 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:13:09.349676 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:09.349676 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 504/1037] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:09.354753 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b556d1-b5e7-4ee1-af03-eb136d0505e9 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:09.383262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:09.457591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b556d1-b5e7-4ee1-af03-eb136d0505e9 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:09.492250 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c0f84-5e19-4aa2-af04-f8bc21c68d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:09.492887 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c0f84-5e19-4aa2-af04-f8bc21c68d9a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:09.493173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c0f84-5e19-4aa2-af04-f8bc21c68d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:09.493453 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c0f84-5e19-4aa2-af04-f8bc21c68d9a None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:09.494149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c0f84-5e19-4aa2-af04-f8bc21c68d9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:09.494458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c0f84-5e19-4aa2-af04-f8bc21c68d9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:09.495833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c0f84-5e19-4aa2-af04-f8bc21c68d9a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:09.507561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 534/1038] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:09.513267 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c12ad9-8e74-4356-a252-adcc26a9943f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:09.603265 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:09.638025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c12ad9-8e74-4356-a252-adcc26a9943f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:09.678658 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4b36d-caac-4c67-8634-170c5d1ea7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:09.680153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4b36d-caac-4c67-8634-170c5d1ea7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:09.680153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4b36d-caac-4c67-8634-170c5d1ea7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:09.680153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4b36d-caac-4c67-8634-170c5d1ea7f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:09.688321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4b36d-caac-4c67-8634-170c5d1ea7f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:09.689848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4b36d-caac-4c67-8634-170c5d1ea7f0 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:09.701952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-22a4b36d-caac-4c67-8634-170c5d1ea7f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:13:09.701952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:09.701952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:09.701952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:09.701952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:09.701952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:09.701952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:09.701952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:09.701952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:09.701952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:09.701952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:09.701952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:09.701952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:13:09.701952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:13:09.701952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:13:09.702884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:13:09.702884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:09.702884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:09.702884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:09.702884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:09.702884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:09.702884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:09.702884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:09.702884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:09.702884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:09.702884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:09.702884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:09.702884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:09.702884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:09.702884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:09.702884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:09.702884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:09.704067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:13:09.704067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:13:09.704067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:13:09.704067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:13:09.704067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:13:09.704067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:13:09.704067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:13:09.704067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:09.704067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 505/1039] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:13:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:09.709195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c0f84-5e19-4aa2-af04-f8bc21c68d9a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:09.801660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:09.815727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c0f84-5e19-4aa2-af04-f8bc21c68d9a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:09.823455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfbc52-5501-467f-9d7e-d19d14c3b948 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:09.823747 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfbc52-5501-467f-9d7e-d19d14c3b948 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:09.824030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfbc52-5501-467f-9d7e-d19d14c3b948 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:09.825551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 506/1040] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:09.830376 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d38cbf-0525-4fa5-bf50-5db4810c76d1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:09.830667 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d38cbf-0525-4fa5-bf50-5db4810c76d1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:09.830944 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d38cbf-0525-4fa5-bf50-5db4810c76d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:09.849376 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-34d38cbf-0525-4fa5-bf50-5db4810c76d1 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:09.850589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-34d38cbf-0525-4fa5-bf50-5db4810c76d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:09.851726 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd067d3-8d53-4b9b-ac7c-f59ed59df59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:09.852383 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd067d3-8d53-4b9b-ac7c-f59ed59df59e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:09.852666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd067d3-8d53-4b9b-ac7c-f59ed59df59e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:09.852938 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd067d3-8d53-4b9b-ac7c-f59ed59df59e None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:09.853754 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd067d3-8d53-4b9b-ac7c-f59ed59df59e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:09.853984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd067d3-8d53-4b9b-ac7c-f59ed59df59e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:09.855406 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd067d3-8d53-4b9b-ac7c-f59ed59df59e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:09.873999 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 535/1041] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:13:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:09.875165 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd067d3-8d53-4b9b-ac7c-f59ed59df59e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:09.936589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 507/1042] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 10:13:09.951232 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d38cbf-0525-4fa5-bf50-5db4810c76d1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:09.983519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd067d3-8d53-4b9b-ac7c-f59ed59df59e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:10.015324 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:10.022519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea51d5b-db87-42c4-b695-cc72cfa36b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:10.023348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea51d5b-db87-42c4-b695-cc72cfa36b61 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:10.023646 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea51d5b-db87-42c4-b695-cc72cfa36b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:10.023921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea51d5b-db87-42c4-b695-cc72cfa36b61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:10.024739 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea51d5b-db87-42c4-b695-cc72cfa36b61 None admin] RBAC: Adding query filter params (role.id=15b22a1f53864b52a7b212d5adf916db, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=592539924feb44ad8ea520d8539b6608) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:10.025049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea51d5b-db87-42c4-b695-cc72cfa36b61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:10.026474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea51d5b-db87-42c4-b695-cc72cfa36b61 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:10.040588 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 536/1043] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:13:09 2022] GET /identity/v3/role_assignments?user.id=592539924feb44ad8ea520d8539b6608&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=15b22a1f53864b52a7b212d5adf916db => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:10.063702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d38cbf-0525-4fa5-bf50-5db4810c76d1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:10.117504 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbaa7c-e86c-4af5-94c2-d3b2a7d9d989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:10.118104 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbaa7c-e86c-4af5-94c2-d3b2a7d9d989 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:10.118390 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbaa7c-e86c-4af5-94c2-d3b2a7d9d989 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:10.118670 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbaa7c-e86c-4af5-94c2-d3b2a7d9d989 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:10.119962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbaa7c-e86c-4af5-94c2-d3b2a7d9d989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:10.121656 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbaa7c-e86c-4af5-94c2-d3b2a7d9d989 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:10.128494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 508/1044] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:13:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:10.129827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea51d5b-db87-42c4-b695-cc72cfa36b61 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:10.146650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:10.244898 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea51d5b-db87-42c4-b695-cc72cfa36b61 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:10.279482 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fc89f-ef44-464e-9154-b2fbe7c1151b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:10.280110 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fc89f-ef44-464e-9154-b2fbe7c1151b None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:10.280427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fc89f-ef44-464e-9154-b2fbe7c1151b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:10.280704 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fc89f-ef44-464e-9154-b2fbe7c1151b None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:10.281936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fc89f-ef44-464e-9154-b2fbe7c1151b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:10.283403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fc89f-ef44-464e-9154-b2fbe7c1151b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:10.312263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 537/1045] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Aug 4 10:13:10 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:13:10.590089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d8732-1fdd-41c6-82d1-fdd617eacac9 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:10.590636 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d8732-1fdd-41c6-82d1-fdd617eacac9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:10.590636 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d8732-1fdd-41c6-82d1-fdd617eacac9 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:10.592044 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 509/1046] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:10.597511 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632029e9-dfa9-4757-8ef9-a8b304601422 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:10.597920 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632029e9-dfa9-4757-8ef9-a8b304601422 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:10.598087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632029e9-dfa9-4757-8ef9-a8b304601422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:10.616718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-632029e9-dfa9-4757-8ef9-a8b304601422 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:10.620662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-632029e9-dfa9-4757-8ef9-a8b304601422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:10.684662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:10.696253 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 538/1047] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:10.715437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d8732-1fdd-41c6-82d1-fdd617eacac9 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:10.822509 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d8732-1fdd-41c6-82d1-fdd617eacac9 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:10.853370 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:10.860037 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5772a-eb4a-4d80-af7b-51fadb2723e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:10.860739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5772a-eb4a-4d80-af7b-51fadb2723e1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:10.861029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5772a-eb4a-4d80-af7b-51fadb2723e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:10.861308 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5772a-eb4a-4d80-af7b-51fadb2723e1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:10.861939 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5772a-eb4a-4d80-af7b-51fadb2723e1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:10.863313 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5772a-eb4a-4d80-af7b-51fadb2723e1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:10.872566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-d3a5772a-eb4a-4d80-af7b-51fadb2723e1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 10:13:10.872566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:10.872566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:13:10.872566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:13:10.872566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:13:10.872566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:13:10.872566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:13:10.872566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:13:10.872566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 10:13:10.872566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:10.872566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:13:10.872566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:10.872566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:10.872566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:10.872566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:10.872566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:10.872566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:10.873571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:10.873571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:10.873571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:10.873571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:10.873571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:10.873571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:10.873571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:13:10.873571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:13:10.873571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:13:10.873571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:13:10.873571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:10.873571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:10.873571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:10.873571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:10.873571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:10.873571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:10.874414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:10.874414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:10.874414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:10.874414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:10.874414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:10.874414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:10.874414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:10.874414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:10.874414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:10.874414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:10.874414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:13:10.874414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:13:10.874414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 10:13:10.874414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:10.879339 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 510/1048] 10.222.0.48 () {56 vars in 1105 bytes} [Thu Aug 4 10:13:10 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:10.880613 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632029e9-dfa9-4757-8ef9-a8b304601422 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:10.982250 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632029e9-dfa9-4757-8ef9-a8b304601422 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:11.017857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e2304-0f1b-4a5d-8ebc-99f1fd9e6aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:11.018495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e2304-0f1b-4a5d-8ebc-99f1fd9e6aaa None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:11.018781 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e2304-0f1b-4a5d-8ebc-99f1fd9e6aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:11.019062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e2304-0f1b-4a5d-8ebc-99f1fd9e6aaa None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:11.019746 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e2304-0f1b-4a5d-8ebc-99f1fd9e6aaa None admin] RBAC: Adding query filter params (name=image) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:11.020061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e2304-0f1b-4a5d-8ebc-99f1fd9e6aaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:11.021546 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e2304-0f1b-4a5d-8ebc-99f1fd9e6aaa None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:11.031691 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 539/1049] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:13:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:11.033126 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5772a-eb4a-4d80-af7b-51fadb2723e1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:11.139864 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5772a-eb4a-4d80-af7b-51fadb2723e1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:11.176676 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2b2af-7a17-4025-9521-cbda7ba4e990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:11.177314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2b2af-7a17-4025-9521-cbda7ba4e990 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:11.177599 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2b2af-7a17-4025-9521-cbda7ba4e990 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:11.177877 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2b2af-7a17-4025-9521-cbda7ba4e990 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:11.178567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2b2af-7a17-4025-9521-cbda7ba4e990 None admin] RBAC: Adding query filter params (type=image) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:11.178878 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2b2af-7a17-4025-9521-cbda7ba4e990 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:11.180281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2b2af-7a17-4025-9521-cbda7ba4e990 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:11.185474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 511/1050] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:13:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:11.192220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e2304-0f1b-4a5d-8ebc-99f1fd9e6aaa None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:11.255251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:11.296125 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e2304-0f1b-4a5d-8ebc-99f1fd9e6aaa None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:11.330451 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f758a-5d43-461f-938c-a8bac74b3444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:11.331077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f758a-5d43-461f-938c-a8bac74b3444 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:11.331363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f758a-5d43-461f-938c-a8bac74b3444 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:11.331642 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f758a-5d43-461f-938c-a8bac74b3444 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:11.332388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f758a-5d43-461f-938c-a8bac74b3444 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:11.333769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f758a-5d43-461f-938c-a8bac74b3444 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:11.364196 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 540/1051] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:13:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:13:12.078673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7adad3-266f-4723-a3ab-1bbee2a452cd None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:12.079201 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7adad3-266f-4723-a3ab-1bbee2a452cd None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:12.079280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7adad3-266f-4723-a3ab-1bbee2a452cd None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:12.080836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 512/1052] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:12.086265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0c532-394a-4e8d-9fdb-197a375148e1 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:12.086698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0c532-394a-4e8d-9fdb-197a375148e1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:12.086900 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0c532-394a-4e8d-9fdb-197a375148e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:12.105745 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f6e0c532-394a-4e8d-9fdb-197a375148e1 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:12.106947 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f6e0c532-394a-4e8d-9fdb-197a375148e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:12.182153 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 541/1053] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:12.205129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7adad3-266f-4723-a3ab-1bbee2a452cd None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:12.266562 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:12.310685 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7adad3-266f-4723-a3ab-1bbee2a452cd None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:12.344952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678d6ed-6974-40ce-aafc-c8a60821cc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:12.345534 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678d6ed-6974-40ce-aafc-c8a60821cc05 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:12.345820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678d6ed-6974-40ce-aafc-c8a60821cc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:12.346099 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678d6ed-6974-40ce-aafc-c8a60821cc05 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:12.357785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678d6ed-6974-40ce-aafc-c8a60821cc05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:13:12.364274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-8678d6ed-6974-40ce-aafc-c8a60821cc05 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 10:13:12.364274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:12.364274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:12.364274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:12.364274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:12.364274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:12.364274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:12.364274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:12.364274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:12.364274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:12.364274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:12.364274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:12.364274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:13:12.364274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:13:12.364274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:13:12.364274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:13:12.365173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:13:12.365173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:13:12.365173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:13:12.365173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:13:12.365173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:12.365173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:12.365173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:12.365173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:12.365173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:12.365173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:12.365173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:12.365173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:12.365173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:12.365173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:12.365173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:12.365173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:12.365994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:12.365994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:12.365994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:12.365994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:12.365994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:13:12.365994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:13:12.365994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:13:12.365994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:13:12.365994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:13:12.365994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:13:12.365994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 10:13:12.365994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:12.367219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 513/1054] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Aug 4 10:13:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:12.371492 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0c532-394a-4e8d-9fdb-197a375148e1 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:12.395230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6b55-4166-4a1b-90a8-149f5bf446fb None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:12.395582 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6b55-4166-4a1b-90a8-149f5bf446fb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:12.395797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a6b55-4166-4a1b-90a8-149f5bf446fb None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:12.397333 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 514/1055] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:13:12.402142 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cd33b-6611-4d0b-aa48-b5b34d59a361 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:12.402442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cd33b-6611-4d0b-aa48-b5b34d59a361 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:12.402717 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cd33b-6611-4d0b-aa48-b5b34d59a361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:12.421070 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-362cd33b-6611-4d0b-aa48-b5b34d59a361 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:12.422888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-362cd33b-6611-4d0b-aa48-b5b34d59a361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:12.423356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:12.490127 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0c532-394a-4e8d-9fdb-197a375148e1 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:12.501415 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 515/1056] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 10:13:12.524119 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cd33b-6611-4d0b-aa48-b5b34d59a361 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:12.530332 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab7f43-4dcf-4161-a714-bad8347a73d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:12.530978 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab7f43-4dcf-4161-a714-bad8347a73d1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:12.531255 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab7f43-4dcf-4161-a714-bad8347a73d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:12.531525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab7f43-4dcf-4161-a714-bad8347a73d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:12.535492 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab7f43-4dcf-4161-a714-bad8347a73d1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:12.535492 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab7f43-4dcf-4161-a714-bad8347a73d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:12.535492 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab7f43-4dcf-4161-a714-bad8347a73d1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:12.544970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 542/1057] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Aug 4 10:13:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:12.550934 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab7f43-4dcf-4161-a714-bad8347a73d1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:12.580453 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:12.643255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cd33b-6611-4d0b-aa48-b5b34d59a361 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:12.660283 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab7f43-4dcf-4161-a714-bad8347a73d1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:12.667665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:12.682168 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330eb50-3426-4100-a499-99bcfc69c2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:12.683104 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330eb50-3426-4100-a499-99bcfc69c2be None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:12.683534 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330eb50-3426-4100-a499-99bcfc69c2be None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:12.683968 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330eb50-3426-4100-a499-99bcfc69c2be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:12.696904 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b330eb50-3426-4100-a499-99bcfc69c2be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:13:12.697537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ecbad-f703-4f5a-bd6b-380279def393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:12.698184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ecbad-f703-4f5a-bd6b-380279def393 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:12.698468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ecbad-f703-4f5a-bd6b-380279def393 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:12.698749 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ecbad-f703-4f5a-bd6b-380279def393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:12.703436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-b330eb50-3426-4100-a499-99bcfc69c2be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:13:12.703436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:12.703436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:12.703436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:12.703436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:12.703436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:12.703436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:12.703436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:12.703436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:12.703436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:12.703436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:12.703436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:12.703436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:13:12.703436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:13:12.703436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:13:12.703436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:13:12.704603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:13:12.704603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:13:12.704603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:13:12.704603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:13:12.704603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:12.704603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:12.704603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:12.704603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:12.704603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:12.704603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:12.704603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:12.704603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:12.704603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:12.704603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:12.704603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:12.704603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:12.705428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:12.705428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:12.705428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:12.705428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:12.705428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:13:12.705428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:13:12.705428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:13:12.705428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:13:12.705428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:13:12.705428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:13:12.705428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:13:12.705428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:12.706073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 516/1058] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:13:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:13:12.711353 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330eb50-3426-4100-a499-99bcfc69c2be None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:12.714492 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ecbad-f703-4f5a-bd6b-380279def393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:12.716035 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ecbad-f703-4f5a-bd6b-380279def393 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:12.731223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-de5ecbad-f703-4f5a-bd6b-380279def393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:13:12.731223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:12.731223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:12.731223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:12.731223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:12.731223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:12.731223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:12.731223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:12.731223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:12.731223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:12.731223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:12.731223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:12.731223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:13:12.731223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:13:12.731223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:13:12.732145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:13:12.732145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:12.732145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:12.732145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:12.732145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:12.732145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:12.732145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:12.732145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:12.732145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:12.732145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:12.732145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:12.732145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:12.732145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:12.732145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:12.732145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:12.732145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:12.732145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:12.738692 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:13:12.738692 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:13:12.738692 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:13:12.738692 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:12.738692 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 543/1059] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:13:12.738692 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ecbad-f703-4f5a-bd6b-380279def393 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:12.825752 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330eb50-3426-4100-a499-99bcfc69c2be None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:12.837734 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:12.847296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ecbad-f703-4f5a-bd6b-380279def393 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:12.866352 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23e7ec-edb3-4269-bd89-b40add8ca553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:12.867212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23e7ec-edb3-4269-bd89-b40add8ca553 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:12.867642 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23e7ec-edb3-4269-bd89-b40add8ca553 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:12.868066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23e7ec-edb3-4269-bd89-b40add8ca553 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:12.868995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23e7ec-edb3-4269-bd89-b40add8ca553 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:12.869308 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23e7ec-edb3-4269-bd89-b40add8ca553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:12.870672 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23e7ec-edb3-4269-bd89-b40add8ca553 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:12.879838 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 517/1060] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:13:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:12.884374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1039f7f-6f9e-4904-b8aa-eb57f11b6640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:12.885114 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23e7ec-edb3-4269-bd89-b40add8ca553 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:12.885359 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1039f7f-6f9e-4904-b8aa-eb57f11b6640 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:12.885791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1039f7f-6f9e-4904-b8aa-eb57f11b6640 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:12.886197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1039f7f-6f9e-4904-b8aa-eb57f11b6640 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:12.887034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1039f7f-6f9e-4904-b8aa-eb57f11b6640 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:12.887515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1039f7f-6f9e-4904-b8aa-eb57f11b6640 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:12.890402 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1039f7f-6f9e-4904-b8aa-eb57f11b6640 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:12.906535 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 544/1061] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:12.912134 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1039f7f-6f9e-4904-b8aa-eb57f11b6640 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:12.934649 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:12.996204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23e7ec-edb3-4269-bd89-b40add8ca553 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:13.022162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1039f7f-6f9e-4904-b8aa-eb57f11b6640 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:13.035844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069b259-99c9-41fd-81ec-7be5cf8748e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:13.036523 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069b259-99c9-41fd-81ec-7be5cf8748e7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:13.036857 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069b259-99c9-41fd-81ec-7be5cf8748e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:13.037140 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069b259-99c9-41fd-81ec-7be5cf8748e7 None admin] PATH_INFO: `/v3/users/7755eed6bafa4b8d85c8116c45add350` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:13.051672 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069b259-99c9-41fd-81ec-7be5cf8748e7 None admin] RBAC: Authorizing `identity:get_user(user_id=7755eed6bafa4b8d85c8116c45add350)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:13.053154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069b259-99c9-41fd-81ec-7be5cf8748e7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:13.059416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 518/1062] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:13:12 2022] GET /identity/v3/users/7755eed6bafa4b8d85c8116c45add350 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:13.060463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069b259-99c9-41fd-81ec-7be5cf8748e7 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:13.063378 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c259525-0f37-4e41-bfb3-08c5cc2864fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:13.064041 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c259525-0f37-4e41-bfb3-08c5cc2864fa None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:13.064355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c259525-0f37-4e41-bfb3-08c5cc2864fa None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:13.064631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c259525-0f37-4e41-bfb3-08c5cc2864fa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:13.072364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c259525-0f37-4e41-bfb3-08c5cc2864fa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:13.073811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c259525-0f37-4e41-bfb3-08c5cc2864fa None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:13.086892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-7c259525-0f37-4e41-bfb3-08c5cc2864fa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 10:13:13.086892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:13.086892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:13.086892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:13.086892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:13.086892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:13.086892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:13.086892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:13.086892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:13.086892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:13.086892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:13.086892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:13.086892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:13:13.086892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:13:13.086892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:13:13.086892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:13:13.088495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:13.088495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:13.088495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:13:13.088495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:13:13.088495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:13:13.088495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:13:13.088495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:13.088495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:13.088495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:13.088495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:13.088495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:13.088495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:13.088495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:13.088495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:13.088495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:13.088495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:13.088495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:13.088495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:13.089429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:13.089429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:13.089429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:13:13.089429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:13:13.089429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:13:13.089429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:13:13.089429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:13:13.089429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:13:13.089429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 10:13:13.089429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:13.089429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 545/1063] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Aug 4 10:13:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:13:13.094151 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c259525-0f37-4e41-bfb3-08c5cc2864fa None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:13.097055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:13.175128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069b259-99c9-41fd-81ec-7be5cf8748e7 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:13.177600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:13.201106 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c259525-0f37-4e41-bfb3-08c5cc2864fa None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:13.220437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fec317-aa0b-4d43-8829-a2957a282dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:13.221069 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fec317-aa0b-4d43-8829-a2957a282dae None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:13.221352 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fec317-aa0b-4d43-8829-a2957a282dae None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:13.221629 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fec317-aa0b-4d43-8829-a2957a282dae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:13.236131 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ecb6f-7cf8-425d-a729-cd0db850270f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:13.236798 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ecb6f-7cf8-425d-a729-cd0db850270f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:13.237087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ecb6f-7cf8-425d-a729-cd0db850270f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:13.237367 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ecb6f-7cf8-425d-a729-cd0db850270f None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:13.238167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ecb6f-7cf8-425d-a729-cd0db850270f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:13.238484 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ecb6f-7cf8-425d-a729-cd0db850270f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:13.239951 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ecb6f-7cf8-425d-a729-cd0db850270f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:13.258054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 546/1064] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Aug 4 10:13:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:13.263644 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ecb6f-7cf8-425d-a729-cd0db850270f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:13.309248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fec317-aa0b-4d43-8829-a2957a282dae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:13.311164 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fec317-aa0b-4d43-8829-a2957a282dae None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:13.345223 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:13.376013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ecb6f-7cf8-425d-a729-cd0db850270f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:13.413192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141f1de-019d-497b-a879-57bb4c05e05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:13.413845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141f1de-019d-497b-a879-57bb4c05e05d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:13.414127 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141f1de-019d-497b-a879-57bb4c05e05d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:13.414412 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141f1de-019d-497b-a879-57bb4c05e05d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:13.417084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:13.420009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 519/1065] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:13:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 10:13:13.421398 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6400f4-d571-4969-9421-2ff38d0570a7 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:13.421721 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6400f4-d571-4969-9421-2ff38d0570a7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:13.422000 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6400f4-d571-4969-9421-2ff38d0570a7 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:13.423257 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 520/1066] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:13.425979 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6400f4-d571-4969-9421-2ff38d0570a7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:13.429156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141f1de-019d-497b-a879-57bb4c05e05d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:13.430609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141f1de-019d-497b-a879-57bb4c05e05d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:13.445980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-4141f1de-019d-497b-a879-57bb4c05e05d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:13:13.445980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:13.445980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:13.445980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:13.445980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:13.445980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:13.445980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:13.445980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:13.445980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:13.445980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:13.445980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:13.445980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:13.445980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:13:13.445980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:13:13.445980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:13:13.447060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:13:13.447060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:13.447060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:13.447060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:13.447060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:13.447060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:13.447060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:13.447060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:13.447060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:13.447060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:13.447060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:13.447060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:13.447060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:13.447060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:13.447060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:13.447060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:13.447060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:13.447933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:13:13.447933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:13:13.447933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:13:13.447933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:13.447933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 547/1067] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:13:13.448518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f5bcf-407c-40c9-8ef0-aebe68786f05 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:13.448677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f5bcf-407c-40c9-8ef0-aebe68786f05 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:13.448917 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f5bcf-407c-40c9-8ef0-aebe68786f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:13.467396 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-110f5bcf-407c-40c9-8ef0-aebe68786f05 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:13.469212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-110f5bcf-407c-40c9-8ef0-aebe68786f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:13.530365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6400f4-d571-4969-9421-2ff38d0570a7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:13.537129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 548/1068] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:13.541088 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f5bcf-407c-40c9-8ef0-aebe68786f05 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:13.563141 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:13.569555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0837f-8efc-44a0-bb8e-8ee0d90c9507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:13.570196 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0837f-8efc-44a0-bb8e-8ee0d90c9507 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:13.570474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0837f-8efc-44a0-bb8e-8ee0d90c9507 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:13.570749 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0837f-8efc-44a0-bb8e-8ee0d90c9507 None admin] PATH_INFO: `/v3/projects/6c10903fdd10479ebde242169c435af2` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:13.571895 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0837f-8efc-44a0-bb8e-8ee0d90c9507 None admin] RBAC: Authorizing `identity:get_project(project_id=6c10903fdd10479ebde242169c435af2)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:13.573350 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0837f-8efc-44a0-bb8e-8ee0d90c9507 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:13.575032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 521/1069] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:13:13 2022] GET /identity/v3/projects/6c10903fdd10479ebde242169c435af2 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:13.575772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0837f-8efc-44a0-bb8e-8ee0d90c9507 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:13.642397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f5bcf-407c-40c9-8ef0-aebe68786f05 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:13.659991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:13.677684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2f0d4-43f8-45cb-a273-e5b9591b2838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:13.678519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2f0d4-43f8-45cb-a273-e5b9591b2838 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:13.678519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2f0d4-43f8-45cb-a273-e5b9591b2838 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:13.678788 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2f0d4-43f8-45cb-a273-e5b9591b2838 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:13.679478 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2f0d4-43f8-45cb-a273-e5b9591b2838 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:13.679786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2f0d4-43f8-45cb-a273-e5b9591b2838 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:13.681207 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2f0d4-43f8-45cb-a273-e5b9591b2838 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:13.689109 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0837f-8efc-44a0-bb8e-8ee0d90c9507 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:13.698265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 549/1070] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:13.699103 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2f0d4-43f8-45cb-a273-e5b9591b2838 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:13.725109 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb62a5-2974-4010-8db0-c9f170c38852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:13.725739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb62a5-2974-4010-8db0-c9f170c38852 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:13.726025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb62a5-2974-4010-8db0-c9f170c38852 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:13.726353 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb62a5-2974-4010-8db0-c9f170c38852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:13.794391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:13.799061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb62a5-2974-4010-8db0-c9f170c38852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:13.800816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb62a5-2974-4010-8db0-c9f170c38852 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:13.806985 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2f0d4-43f8-45cb-a273-e5b9591b2838 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:13.839792 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bc820-ad06-490d-b879-1a6ae9111a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:13.840628 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bc820-ad06-490d-b879-1a6ae9111a3d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:13.840915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bc820-ad06-490d-b879-1a6ae9111a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:13.841199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bc820-ad06-490d-b879-1a6ae9111a3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:13.841981 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1bc820-ad06-490d-b879-1a6ae9111a3d None admin] RBAC: Adding query filter params (role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.project.id=6c10903fdd10479ebde242169c435af2, user.id=7755eed6bafa4b8d85c8116c45add350) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:13.842292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1bc820-ad06-490d-b879-1a6ae9111a3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:13.844396 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1bc820-ad06-490d-b879-1a6ae9111a3d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:13.849872 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 550/1071] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:13:13 2022] GET /identity/v3/role_assignments?user.id=7755eed6bafa4b8d85c8116c45add350&scope.project.id=6c10903fdd10479ebde242169c435af2&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:13.850646 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bc820-ad06-490d-b879-1a6ae9111a3d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:13.899525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:13.916231 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 522/1072] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:13:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:13:13.921558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb62a5-2974-4010-8db0-c9f170c38852 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:13.969859 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bc820-ad06-490d-b879-1a6ae9111a3d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:14.011277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858932c-a475-4794-a061-17a5fdc38ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:14.011943 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858932c-a475-4794-a061-17a5fdc38ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:14.012270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858932c-a475-4794-a061-17a5fdc38ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:14.013015 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858932c-a475-4794-a061-17a5fdc38ee8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:14.020340 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858932c-a475-4794-a061-17a5fdc38ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:14.021813 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858932c-a475-4794-a061-17a5fdc38ee8 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:14.030088 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:14.034789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb62a5-2974-4010-8db0-c9f170c38852 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:14.035033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-b858932c-a475-4794-a061-17a5fdc38ee8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:13:14.035033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:14.035033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:14.035033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:14.035033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:14.035033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:14.035033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:14.035033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:14.035033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:14.035033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:14.035033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:14.035033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:14.035033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:13:14.035033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:13:14.035033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:13:14.035933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:13:14.035933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:14.035933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:14.035933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:14.035933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:14.035933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:14.035933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:14.035933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:14.035933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:14.035933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:14.035933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:14.035933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:14.035933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:14.035933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:14.035933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:14.035933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:14.035933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:14.037064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:13:14.037064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:13:14.037064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:13:14.037064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:13:14.037064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:13:14.037064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:13:14.037064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:13:14.037064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:14.037064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 551/1073] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:13:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:14.041972 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858932c-a475-4794-a061-17a5fdc38ee8 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:14.079608 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d8362-9da4-4af4-860f-9d9f50b0605c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:14.079988 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d8362-9da4-4af4-860f-9d9f50b0605c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:14.080315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d8362-9da4-4af4-860f-9d9f50b0605c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:14.080593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d8362-9da4-4af4-860f-9d9f50b0605c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:14.091230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d8362-9da4-4af4-860f-9d9f50b0605c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:14.092718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d8362-9da4-4af4-860f-9d9f50b0605c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:14.108785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-e21d8362-9da4-4af4-860f-9d9f50b0605c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:13:14.108785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:14.108785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:14.108785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:14.108785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:14.108785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:14.108785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:14.108785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:14.108785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:14.108785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:14.108785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:14.108785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:14.108785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:13:14.108785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:13:14.108785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:13:14.110395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:13:14.110395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:14.110395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:14.110395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:14.110395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:14.110395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:14.110395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:14.110395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:14.110395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:14.110395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:14.110395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:14.110395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:14.110395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:14.110395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:14.110395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:14.110395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:14.110395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:14.111259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:13:14.111259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:13:14.111259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:13:14.111259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:14.111259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 523/1074] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:13:14.115700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d8362-9da4-4af4-860f-9d9f50b0605c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:14.156030 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858932c-a475-4794-a061-17a5fdc38ee8 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:14.158166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:14.195702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8226e11-7578-4389-918d-ab0eff7d6ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:14.196380 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8226e11-7578-4389-918d-ab0eff7d6ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:14.196666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8226e11-7578-4389-918d-ab0eff7d6ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:14.196945 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8226e11-7578-4389-918d-ab0eff7d6ac7 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:14.197707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8226e11-7578-4389-918d-ab0eff7d6ac7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:14.198023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8226e11-7578-4389-918d-ab0eff7d6ac7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:14.199478 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8226e11-7578-4389-918d-ab0eff7d6ac7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:14.212898 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 552/1075] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:13:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:14.219241 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8226e11-7578-4389-918d-ab0eff7d6ac7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:14.222814 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d8362-9da4-4af4-860f-9d9f50b0605c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:14.262306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d49d71-d71b-4e67-a5c1-915fc0597949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:14.262938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d49d71-d71b-4e67-a5c1-915fc0597949 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:14.263220 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d49d71-d71b-4e67-a5c1-915fc0597949 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:14.263499 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d49d71-d71b-4e67-a5c1-915fc0597949 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:14.264247 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d49d71-d71b-4e67-a5c1-915fc0597949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:14.264556 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d49d71-d71b-4e67-a5c1-915fc0597949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:14.266445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d49d71-d71b-4e67-a5c1-915fc0597949 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:14.279022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 524/1076] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:14.333598 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8226e11-7578-4389-918d-ab0eff7d6ac7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:14.371556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632a884-577e-4358-baaa-635da1b73d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:14.372281 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632a884-577e-4358-baaa-635da1b73d8b None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:14.372563 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632a884-577e-4358-baaa-635da1b73d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:14.372836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632a884-577e-4358-baaa-635da1b73d8b None admin] PATH_INFO: `/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/592539924feb44ad8ea520d8539b6608/roles/15b22a1f53864b52a7b212d5adf916db` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:14.375654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632a884-577e-4358-baaa-635da1b73d8b None admin] RBAC: Authorizing `identity:create_grant(project_id=7e37543156ee42a0818bf5cfe747fdc2, user_id=592539924feb44ad8ea520d8539b6608, role_id=15b22a1f53864b52a7b212d5adf916db)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:14.377153 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632a884-577e-4358-baaa-635da1b73d8b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:14.392381 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 553/1077] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:13:14 2022] PUT /identity/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/592539924feb44ad8ea520d8539b6608/roles/15b22a1f53864b52a7b212d5adf916db => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:13:15.884867 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c81863-dd05-40a0-a840-7532e54c89e4 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:15.885365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c81863-dd05-40a0-a840-7532e54c89e4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:15.885365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c81863-dd05-40a0-a840-7532e54c89e4 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:15.886877 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 525/1078] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:15.891932 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847beb3-a748-4513-84cc-c8a4fa02f1aa None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:15.892437 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847beb3-a748-4513-84cc-c8a4fa02f1aa None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:15.892538 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847beb3-a748-4513-84cc-c8a4fa02f1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:15.911371 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3847beb3-a748-4513-84cc-c8a4fa02f1aa None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:15.912592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3847beb3-a748-4513-84cc-c8a4fa02f1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:15.929942 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:15.983932 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 554/1079] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:16.006607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c81863-dd05-40a0-a840-7532e54c89e4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:16.020080 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:16.117198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c81863-dd05-40a0-a840-7532e54c89e4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:16.153882 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272ec3e-c84a-45de-b092-6ca9af2bc93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:16.154453 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272ec3e-c84a-45de-b092-6ca9af2bc93f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:16.154739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272ec3e-c84a-45de-b092-6ca9af2bc93f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:16.155016 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272ec3e-c84a-45de-b092-6ca9af2bc93f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:16.166013 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272ec3e-c84a-45de-b092-6ca9af2bc93f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:13:16.171029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-0272ec3e-c84a-45de-b092-6ca9af2bc93f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:13:16.171029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:16.171029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:16.171029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:16.171029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:16.171029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:16.171029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:16.171029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:16.171029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:16.171029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:16.171029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:16.171029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:16.171029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:13:16.171029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:13:16.171029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:13:16.171029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:13:16.172660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:13:16.172660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:13:16.172660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:13:16.172660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:13:16.172660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:16.172660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:16.172660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:16.172660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:16.172660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:16.172660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:16.172660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:16.172660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:16.172660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:16.172660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:16.172660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:16.172660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:16.173684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:16.173684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:16.173684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:16.173684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:16.173684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:13:16.173684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:13:16.173684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:13:16.173684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:13:16.173684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:13:16.173684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:13:16.173684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:13:16.173684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:16.176336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 526/1080] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:13:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:16.178801 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847beb3-a748-4513-84cc-c8a4fa02f1aa None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:16.281140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847beb3-a748-4513-84cc-c8a4fa02f1aa None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:16.317861 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8e360-f724-41f1-905a-a66e1ebe3a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:16.318659 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8e360-f724-41f1-905a-a66e1ebe3a57 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:16.319077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8e360-f724-41f1-905a-a66e1ebe3a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:16.319416 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8e360-f724-41f1-905a-a66e1ebe3a57 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:16.320141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8e360-f724-41f1-905a-a66e1ebe3a57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:16.320483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8e360-f724-41f1-905a-a66e1ebe3a57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:16.321873 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8e360-f724-41f1-905a-a66e1ebe3a57 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:16.331450 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 555/1081] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:13:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:16.337153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272ec3e-c84a-45de-b092-6ca9af2bc93f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:16.407336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:16.422482 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955a82d-c32b-431a-b435-9ad5509701d5 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:16.422771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955a82d-c32b-431a-b435-9ad5509701d5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:16.423053 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955a82d-c32b-431a-b435-9ad5509701d5 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:16.424451 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 556/1082] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:13:16.429500 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32eac5e-0454-4535-b154-e47fb024f7f3 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:16.429789 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32eac5e-0454-4535-b154-e47fb024f7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:16.430070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32eac5e-0454-4535-b154-e47fb024f7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:16.440650 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272ec3e-c84a-45de-b092-6ca9af2bc93f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:16.451174 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d32eac5e-0454-4535-b154-e47fb024f7f3 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:16.452396 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d32eac5e-0454-4535-b154-e47fb024f7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:16.461828 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:16.475185 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffd81f-5c7f-4d0c-8eac-1234db56b464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:16.475837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffd81f-5c7f-4d0c-8eac-1234db56b464 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:16.476123 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffd81f-5c7f-4d0c-8eac-1234db56b464 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:16.476539 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffd81f-5c7f-4d0c-8eac-1234db56b464 None admin] PATH_INFO: `/v3/users/7755eed6bafa4b8d85c8116c45add350` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:16.477722 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffd81f-5c7f-4d0c-8eac-1234db56b464 None admin] RBAC: Authorizing `identity:get_user(user_id=7755eed6bafa4b8d85c8116c45add350)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:16.479242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffd81f-5c7f-4d0c-8eac-1234db56b464 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:16.480917 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 527/1083] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:13:16 2022] GET /identity/v3/users/7755eed6bafa4b8d85c8116c45add350 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:16.487259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffd81f-5c7f-4d0c-8eac-1234db56b464 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:16.521526 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 557/1084] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 10:13:16.545151 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32eac5e-0454-4535-b154-e47fb024f7f3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:16.588466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffd81f-5c7f-4d0c-8eac-1234db56b464 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:16.624764 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430e942-3e67-4706-9aad-3cd91f6450ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:16.625170 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430e942-3e67-4706-9aad-3cd91f6450ec None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:16.625531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430e942-3e67-4706-9aad-3cd91f6450ec None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:16.625724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430e942-3e67-4706-9aad-3cd91f6450ec None admin] PATH_INFO: `/v3/projects/6c10903fdd10479ebde242169c435af2` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:16.626902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430e942-3e67-4706-9aad-3cd91f6450ec None admin] RBAC: Authorizing `identity:get_project(project_id=6c10903fdd10479ebde242169c435af2)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:16.628378 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430e942-3e67-4706-9aad-3cd91f6450ec None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:16.630070 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 528/1085] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:13:16 2022] GET /identity/v3/projects/6c10903fdd10479ebde242169c435af2 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:16.636132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430e942-3e67-4706-9aad-3cd91f6450ec None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:16.645229 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:16.647715 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32eac5e-0454-4535-b154-e47fb024f7f3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:16.685453 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b3fc9-3c7b-4a9b-907e-abe47e2706ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:16.686021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b3fc9-3c7b-4a9b-907e-abe47e2706ee None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:16.686568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b3fc9-3c7b-4a9b-907e-abe47e2706ee None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:16.686842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b3fc9-3c7b-4a9b-907e-abe47e2706ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:16.697915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b3fc9-3c7b-4a9b-907e-abe47e2706ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:13:16.703428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-ab0b3fc9-3c7b-4a9b-907e-abe47e2706ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 10:13:16.703428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:16.703428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:16.703428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:16.703428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:16.703428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:16.703428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:16.703428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:16.703428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:16.703428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:16.703428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:16.703428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:16.703428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:13:16.703428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:13:16.703428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:13:16.703428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:13:16.704428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:13:16.704428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:13:16.704428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:13:16.704428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:13:16.704428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:16.704428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:16.704428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:16.704428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:16.704428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:16.704428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:16.704428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:16.704428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:16.704428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:16.704428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:16.704428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:16.704428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:16.705260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:16.705260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:16.705260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:16.705260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:16.705260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:13:16.705260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:13:16.705260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:13:16.705260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:13:16.705260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:13:16.705260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:13:16.705260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 10:13:16.705260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:16.705260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 558/1086] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Aug 4 10:13:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:13:16.710664 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b3fc9-3c7b-4a9b-907e-abe47e2706ee None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:16.714930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:16.744032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430e942-3e67-4706-9aad-3cd91f6450ec None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:16.782474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cd402-2d6c-4210-b50a-88d441b308a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:16.783227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cd402-2d6c-4210-b50a-88d441b308a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:16.783570 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cd402-2d6c-4210-b50a-88d441b308a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:16.783853 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cd402-2d6c-4210-b50a-88d441b308a2 None admin] PATH_INFO: `/v3/projects/6c10903fdd10479ebde242169c435af2/users/7755eed6bafa4b8d85c8116c45add350/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:16.786012 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cd402-2d6c-4210-b50a-88d441b308a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c10903fdd10479ebde242169c435af2, user_id=7755eed6bafa4b8d85c8116c45add350, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:16.787438 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cd402-2d6c-4210-b50a-88d441b308a2 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:16.801896 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 529/1087] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:13:16 2022] PUT /identity/v3/projects/6c10903fdd10479ebde242169c435af2/users/7755eed6bafa4b8d85c8116c45add350/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:13:16.817258 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b3fc9-3c7b-4a9b-907e-abe47e2706ee None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:16.855699 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9349d-ed4e-4b3d-8822-278866528602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:16.856381 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9349d-ed4e-4b3d-8822-278866528602 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:16.856695 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9349d-ed4e-4b3d-8822-278866528602 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:16.856982 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9349d-ed4e-4b3d-8822-278866528602 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:16.857725 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9349d-ed4e-4b3d-8822-278866528602 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:16.858036 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9349d-ed4e-4b3d-8822-278866528602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:16.860370 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9349d-ed4e-4b3d-8822-278866528602 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:16.869593 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 559/1088] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Aug 4 10:13:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:16.875815 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cd402-2d6c-4210-b50a-88d441b308a2 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:16.948724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:16.988387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cd402-2d6c-4210-b50a-88d441b308a2 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:17.022959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0545a30-8845-4964-b126-f00b369c151f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:17.023609 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0545a30-8845-4964-b126-f00b369c151f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:17.023891 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0545a30-8845-4964-b126-f00b369c151f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:17.024188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0545a30-8845-4964-b126-f00b369c151f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:17.036233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0545a30-8845-4964-b126-f00b369c151f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:17.037689 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0545a30-8845-4964-b126-f00b369c151f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:17.052994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-f0545a30-8845-4964-b126-f00b369c151f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:13:17.052994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:17.052994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:17.052994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:17.052994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:17.052994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:17.052994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:17.052994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:17.052994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:17.052994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:17.052994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:17.052994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:17.052994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:13:17.052994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:13:17.052994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:13:17.053966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:13:17.053966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:17.053966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:17.053966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:17.053966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:17.053966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:17.053966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:17.053966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:17.053966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:17.053966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:17.053966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:17.053966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:17.053966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:17.053966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:17.053966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:17.053966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:17.053966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:17.055349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:13:17.055349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:13:17.055349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:13:17.055349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:17.055349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 530/1089] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:17.059798 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9349d-ed4e-4b3d-8822-278866528602 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:17.124514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:17.161064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9349d-ed4e-4b3d-8822-278866528602 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:17.194241 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe1a65-fa3c-4c51-a00f-e61c4619a7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:17.194873 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe1a65-fa3c-4c51-a00f-e61c4619a7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:17.195162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe1a65-fa3c-4c51-a00f-e61c4619a7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:17.195439 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe1a65-fa3c-4c51-a00f-e61c4619a7a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:17.196130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe1a65-fa3c-4c51-a00f-e61c4619a7a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:17.196469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe1a65-fa3c-4c51-a00f-e61c4619a7a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:17.197849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe1a65-fa3c-4c51-a00f-e61c4619a7a7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:17.210758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 560/1090] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:17.216473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0545a30-8845-4964-b126-f00b369c151f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:17.316700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0545a30-8845-4964-b126-f00b369c151f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:17.333844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:17.350692 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e53eb4-802f-4e68-a1e0-3e3e86ab84b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:17.351338 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e53eb4-802f-4e68-a1e0-3e3e86ab84b7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:17.351620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e53eb4-802f-4e68-a1e0-3e3e86ab84b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:17.351918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e53eb4-802f-4e68-a1e0-3e3e86ab84b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:17.359842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e53eb4-802f-4e68-a1e0-3e3e86ab84b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:17.361318 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e53eb4-802f-4e68-a1e0-3e3e86ab84b7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:17.372975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-e8e53eb4-802f-4e68-a1e0-3e3e86ab84b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 10:13:17.372975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:17.372975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:17.372975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:17.372975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:17.372975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:17.372975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:17.372975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:17.372975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:17.372975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:17.372975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:17.372975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:17.372975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:13:17.372975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:13:17.372975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:13:17.372975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:13:17.374074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:17.374074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:17.374074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:13:17.374074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:13:17.374074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:13:17.374074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:13:17.374074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:17.374074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:17.374074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:17.374074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:17.374074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:17.374074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:17.374074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:17.374074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:17.374074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:17.374074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:17.374074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:17.374074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:17.375751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:17.375751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:17.375751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:13:17.375751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:13:17.375751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:13:17.375751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:13:17.375751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:13:17.375751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:13:17.375751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 10:13:17.375751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:17.375751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 531/1091] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Aug 4 10:13:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:13:17.380500 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe1a65-fa3c-4c51-a00f-e61c4619a7a7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:17.479804 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe1a65-fa3c-4c51-a00f-e61c4619a7a7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:17.506336 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:17.516269 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeeb810-a7d9-474a-929f-312ca70e2572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:17.516918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeeb810-a7d9-474a-929f-312ca70e2572 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:17.517205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeeb810-a7d9-474a-929f-312ca70e2572 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:17.517485 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeeb810-a7d9-474a-929f-312ca70e2572 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:17.518296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeeb810-a7d9-474a-929f-312ca70e2572 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:17.518611 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeeb810-a7d9-474a-929f-312ca70e2572 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:17.520061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeeb810-a7d9-474a-929f-312ca70e2572 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:17.542075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 561/1092] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Aug 4 10:13:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:17.548354 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e53eb4-802f-4e68-a1e0-3e3e86ab84b7 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:17.653034 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e53eb4-802f-4e68-a1e0-3e3e86ab84b7 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:17.688003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79978293-6c15-4592-97f9-9cf0266f24cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:17.688646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79978293-6c15-4592-97f9-9cf0266f24cf None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:17.688927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79978293-6c15-4592-97f9-9cf0266f24cf None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:17.689205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79978293-6c15-4592-97f9-9cf0266f24cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:17.742960 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:17.766804 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79978293-6c15-4592-97f9-9cf0266f24cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:17.768357 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79978293-6c15-4592-97f9-9cf0266f24cf None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:17.867893 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 532/1093] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:13:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:13:17.872936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeeb810-a7d9-474a-929f-312ca70e2572 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:17.974385 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeeb810-a7d9-474a-929f-312ca70e2572 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:18.009336 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f656a55-4c0b-4c88-b0de-33de6f103ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:18.009893 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f656a55-4c0b-4c88-b0de-33de6f103ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:18.010171 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f656a55-4c0b-4c88-b0de-33de6f103ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:18.010443 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f656a55-4c0b-4c88-b0de-33de6f103ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:18.021099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f656a55-4c0b-4c88-b0de-33de6f103ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:18.022584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f656a55-4c0b-4c88-b0de-33de6f103ab2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:18.037525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-7f656a55-4c0b-4c88-b0de-33de6f103ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:13:18.037525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:18.037525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:18.037525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:18.037525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:18.037525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:18.037525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:18.037525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:18.037525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:18.037525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:18.037525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:18.037525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:18.037525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:13:18.037525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:13:18.037525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:13:18.038420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:13:18.038420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:18.038420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:18.038420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:18.038420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:18.038420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:18.038420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:18.038420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:18.038420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:18.038420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:18.038420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:18.038420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:18.038420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:18.038420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:18.038420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:18.038420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:18.038420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:18.039313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:13:18.039313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:13:18.039313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:13:18.039313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:18.039313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 562/1094] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:18.044475 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79978293-6c15-4592-97f9-9cf0266f24cf None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:18.120029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:18.141854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79978293-6c15-4592-97f9-9cf0266f24cf None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:18.174384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b6f08-968f-4fee-b9b7-abcd61464d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:18.174996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b6f08-968f-4fee-b9b7-abcd61464d1c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:18.175275 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b6f08-968f-4fee-b9b7-abcd61464d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:18.175545 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b6f08-968f-4fee-b9b7-abcd61464d1c None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:18.176257 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b6f08-968f-4fee-b9b7-abcd61464d1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:18.176560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b6f08-968f-4fee-b9b7-abcd61464d1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:18.177908 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b6f08-968f-4fee-b9b7-abcd61464d1c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:18.190065 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 533/1095] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:18.195468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f656a55-4c0b-4c88-b0de-33de6f103ab2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:18.230075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:18.295810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f656a55-4c0b-4c88-b0de-33de6f103ab2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:18.329448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6ca2c-84bf-483d-a932-9f5b68e03908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:18.330088 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6ca2c-84bf-483d-a932-9f5b68e03908 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:18.330371 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6ca2c-84bf-483d-a932-9f5b68e03908 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:18.330648 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6ca2c-84bf-483d-a932-9f5b68e03908 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:18.337167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6ca2c-84bf-483d-a932-9f5b68e03908 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:18.338611 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6ca2c-84bf-483d-a932-9f5b68e03908 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:18.349911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-a6e6ca2c-84bf-483d-a932-9f5b68e03908 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:13:18.349911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:18.349911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:18.349911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:18.349911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:18.349911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:18.349911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:18.349911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:18.349911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:18.349911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:18.349911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:18.349911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:18.349911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:13:18.349911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:13:18.349911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:13:18.350961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:13:18.350961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:18.350961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:18.350961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:18.350961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:18.350961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:18.350961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:18.350961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:18.350961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:18.350961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:18.350961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:18.350961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:18.350961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:18.350961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:18.350961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:18.350961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:18.350961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:18.352374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:13:18.352374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:13:18.352374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:13:18.352374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:13:18.352374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:13:18.352374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:13:18.352374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:13:18.352374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:18.352374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 563/1096] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:13:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:18.356865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b6f08-968f-4fee-b9b7-abcd61464d1c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:18.460708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b6f08-968f-4fee-b9b7-abcd61464d1c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:18.494215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796402ad-362b-4794-b218-cde881666cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:18.494833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796402ad-362b-4794-b218-cde881666cdd None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:18.495112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796402ad-362b-4794-b218-cde881666cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:18.495384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796402ad-362b-4794-b218-cde881666cdd None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:18.496126 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796402ad-362b-4794-b218-cde881666cdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:18.496459 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796402ad-362b-4794-b218-cde881666cdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:18.497863 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796402ad-362b-4794-b218-cde881666cdd None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:18.505413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:18.511082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 534/1097] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:13:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:18.517706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6ca2c-84bf-483d-a932-9f5b68e03908 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:18.611449 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:18.617521 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6ca2c-84bf-483d-a932-9f5b68e03908 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:18.654170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813c7e5-5d66-4aa0-8909-d91244470d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:18.655229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813c7e5-5d66-4aa0-8909-d91244470d9f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:18.655731 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813c7e5-5d66-4aa0-8909-d91244470d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:18.656743 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813c7e5-5d66-4aa0-8909-d91244470d9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:18.658658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813c7e5-5d66-4aa0-8909-d91244470d9f None admin] RBAC: Adding query filter params (role.id=15b22a1f53864b52a7b212d5adf916db, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=592539924feb44ad8ea520d8539b6608) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:18.659234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813c7e5-5d66-4aa0-8909-d91244470d9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:18.661501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813c7e5-5d66-4aa0-8909-d91244470d9f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:18.667763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 564/1098] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:13:18 2022] GET /identity/v3/role_assignments?user.id=592539924feb44ad8ea520d8539b6608&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=15b22a1f53864b52a7b212d5adf916db => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:18.829944 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3f62f-4f9d-4647-9cf4-40b7e2875394 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:18.830301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3f62f-4f9d-4647-9cf4-40b7e2875394 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:18.830583 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3f62f-4f9d-4647-9cf4-40b7e2875394 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:18.831954 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 535/1099] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:18.837456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3adb76-063a-4b1c-acc3-8e15e78cb5e8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:18.837746 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3adb76-063a-4b1c-acc3-8e15e78cb5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:18.838027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3adb76-063a-4b1c-acc3-8e15e78cb5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:18.857356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1a3adb76-063a-4b1c-acc3-8e15e78cb5e8 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:18.858595 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1a3adb76-063a-4b1c-acc3-8e15e78cb5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:18.929152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 565/1100] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:18.953581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3f62f-4f9d-4647-9cf4-40b7e2875394 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:19.060763 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3f62f-4f9d-4647-9cf4-40b7e2875394 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:19.097226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12c9d8-1640-4bc7-8976-91940080327a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:19.097883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12c9d8-1640-4bc7-8976-91940080327a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:19.098175 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12c9d8-1640-4bc7-8976-91940080327a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:19.098460 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12c9d8-1640-4bc7-8976-91940080327a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:19.109658 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12c9d8-1640-4bc7-8976-91940080327a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:13:19.114654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-3f12c9d8-1640-4bc7-8976-91940080327a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:13:19.114654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:19.114654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:19.114654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:19.114654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:19.114654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:19.114654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:19.114654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:19.114654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:19.114654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:19.114654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:19.114654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:19.114654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:13:19.114654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:13:19.114654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:13:19.114654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:13:19.115572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:13:19.115572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:13:19.115572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:13:19.115572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:13:19.115572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:19.115572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:19.115572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:19.115572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:19.115572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:19.115572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:19.115572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:19.115572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:19.115572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:19.115572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:19.115572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:19.115572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:19.116457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:19.116457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:19.116457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:19.116457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:19.116457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:13:19.116457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:13:19.116457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:13:19.116457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:13:19.116457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:13:19.116457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:13:19.116457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:13:19.116457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:19.116457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 536/1101] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:13:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:19.121985 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3adb76-063a-4b1c-acc3-8e15e78cb5e8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:19.216504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:19.227035 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3adb76-063a-4b1c-acc3-8e15e78cb5e8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:19.268112 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b170f5-14b9-4958-95ae-92aad08c8628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:19.268760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b170f5-14b9-4958-95ae-92aad08c8628 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:19.269043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b170f5-14b9-4958-95ae-92aad08c8628 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:19.269324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b170f5-14b9-4958-95ae-92aad08c8628 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:19.270040 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b170f5-14b9-4958-95ae-92aad08c8628 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:19.270402 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b170f5-14b9-4958-95ae-92aad08c8628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:19.271787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b170f5-14b9-4958-95ae-92aad08c8628 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:19.280323 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 566/1102] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:13:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:19.286387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12c9d8-1640-4bc7-8976-91940080327a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:19.349784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:19.398690 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12c9d8-1640-4bc7-8976-91940080327a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:19.436952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39ac1f-6c03-4a75-ac4b-b718e8835ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:19.438152 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39ac1f-6c03-4a75-ac4b-b718e8835ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:19.438438 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39ac1f-6c03-4a75-ac4b-b718e8835ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:19.438712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39ac1f-6c03-4a75-ac4b-b718e8835ec1 None admin] PATH_INFO: `/v3/users/7755eed6bafa4b8d85c8116c45add350` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:19.439930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39ac1f-6c03-4a75-ac4b-b718e8835ec1 None admin] RBAC: Authorizing `identity:get_user(user_id=7755eed6bafa4b8d85c8116c45add350)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:19.441419 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39ac1f-6c03-4a75-ac4b-b718e8835ec1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:19.443096 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 537/1103] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:13:19 2022] GET /identity/v3/users/7755eed6bafa4b8d85c8116c45add350 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:19.449131 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b170f5-14b9-4958-95ae-92aad08c8628 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:19.559763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b170f5-14b9-4958-95ae-92aad08c8628 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:19.592911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13552a-0029-41b9-8f08-b2957cdb469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:19.594089 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13552a-0029-41b9-8f08-b2957cdb469d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:19.594369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13552a-0029-41b9-8f08-b2957cdb469d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:19.594650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13552a-0029-41b9-8f08-b2957cdb469d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:19.616780 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:19.663457 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13552a-0029-41b9-8f08-b2957cdb469d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:19.664950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13552a-0029-41b9-8f08-b2957cdb469d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:19.768448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 567/1104] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:13:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:13:19.774546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39ac1f-6c03-4a75-ac4b-b718e8835ec1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:19.874075 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39ac1f-6c03-4a75-ac4b-b718e8835ec1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:19.900549 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:19.909699 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7371706-e091-474a-ba4f-1cc8a0710bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:19.910340 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7371706-e091-474a-ba4f-1cc8a0710bda None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:19.910623 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7371706-e091-474a-ba4f-1cc8a0710bda None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:19.910900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7371706-e091-474a-ba4f-1cc8a0710bda None admin] PATH_INFO: `/v3/projects/6c10903fdd10479ebde242169c435af2` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:19.912055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7371706-e091-474a-ba4f-1cc8a0710bda None admin] RBAC: Authorizing `identity:get_project(project_id=6c10903fdd10479ebde242169c435af2)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:19.913517 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7371706-e091-474a-ba4f-1cc8a0710bda None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:19.915193 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 538/1105] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:13:19 2022] GET /identity/v3/projects/6c10903fdd10479ebde242169c435af2 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:19.921808 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13552a-0029-41b9-8f08-b2957cdb469d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:19.973961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:20.021643 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13552a-0029-41b9-8f08-b2957cdb469d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:20.055175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19fe80-898a-435a-9adc-a142bb58e796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:20.055792 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19fe80-898a-435a-9adc-a142bb58e796 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:20.056072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19fe80-898a-435a-9adc-a142bb58e796 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:20.056373 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19fe80-898a-435a-9adc-a142bb58e796 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:20.057155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19fe80-898a-435a-9adc-a142bb58e796 None admin] RBAC: Adding query filter params (role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.project.id=6c10903fdd10479ebde242169c435af2, user.id=7755eed6bafa4b8d85c8116c45add350) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:20.057462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19fe80-898a-435a-9adc-a142bb58e796 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:20.058881 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19fe80-898a-435a-9adc-a142bb58e796 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:20.066010 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 568/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:13:19 2022] GET /identity/v3/role_assignments?user.id=7755eed6bafa4b8d85c8116c45add350&scope.project.id=6c10903fdd10479ebde242169c435af2&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:22.112080 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2f820-0780-47c1-a3fb-751cdf908190 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:22.112717 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2f820-0780-47c1-a3fb-751cdf908190 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:22.112717 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2f820-0780-47c1-a3fb-751cdf908190 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:22.114042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 539/1107] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:22.119184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59ec93-877f-4b96-ae24-49a873fc1343 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:22.119634 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59ec93-877f-4b96-ae24-49a873fc1343 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:22.119744 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59ec93-877f-4b96-ae24-49a873fc1343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:22.138015 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3f59ec93-877f-4b96-ae24-49a873fc1343 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:22.139211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3f59ec93-877f-4b96-ae24-49a873fc1343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:22.205191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 569/1108] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:22.229381 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2f820-0780-47c1-a3fb-751cdf908190 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:22.329577 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2f820-0780-47c1-a3fb-751cdf908190 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:22.363149 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43118cb6-387f-4acd-9aef-e5635fe97d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:22.363711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43118cb6-387f-4acd-9aef-e5635fe97d02 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:22.363992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43118cb6-387f-4acd-9aef-e5635fe97d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:22.364292 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43118cb6-387f-4acd-9aef-e5635fe97d02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:22.365423 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43118cb6-387f-4acd-9aef-e5635fe97d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:22.366845 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43118cb6-387f-4acd-9aef-e5635fe97d02 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:22.368464 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 540/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:13:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:22.374321 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59ec93-877f-4b96-ae24-49a873fc1343 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:22.418681 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:22.470782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59ec93-877f-4b96-ae24-49a873fc1343 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:22.502458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2746d5-bb4b-4f7d-8a3a-363a013c26a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:22.503066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2746d5-bb4b-4f7d-8a3a-363a013c26a7 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:22.503344 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2746d5-bb4b-4f7d-8a3a-363a013c26a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:22.503617 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2746d5-bb4b-4f7d-8a3a-363a013c26a7 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:22.504460 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2746d5-bb4b-4f7d-8a3a-363a013c26a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:22.505885 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2746d5-bb4b-4f7d-8a3a-363a013c26a7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:22.526880 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 570/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Aug 4 10:13:22 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:13:24.580330 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633f8ee-94db-4835-9a5a-f2ee21f50c4b None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:24.580897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633f8ee-94db-4835-9a5a-f2ee21f50c4b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:24.580897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633f8ee-94db-4835-9a5a-f2ee21f50c4b None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:24.582240 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 541/1111] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:13:24.587472 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0cbe0-8368-40c9-a98c-c865167b895a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:24.587899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0cbe0-8368-40c9-a98c-c865167b895a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:24.588130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0cbe0-8368-40c9-a98c-c865167b895a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:24.606793 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b1f0cbe0-8368-40c9-a98c-c865167b895a None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:24.607976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b1f0cbe0-8368-40c9-a98c-c865167b895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:24.674685 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 571/1112] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:24.699551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633f8ee-94db-4835-9a5a-f2ee21f50c4b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:24.761990 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:24.802135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633f8ee-94db-4835-9a5a-f2ee21f50c4b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:24.834876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310babb-41eb-4b2f-b485-299a40a4d4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:24.835444 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310babb-41eb-4b2f-b485-299a40a4d4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:24.835751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310babb-41eb-4b2f-b485-299a40a4d4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:24.836031 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310babb-41eb-4b2f-b485-299a40a4d4d9 None admin] PATH_INFO: `/v3/roles/472f2455c837486084f108ce944f1bff` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:24.837508 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310babb-41eb-4b2f-b485-299a40a4d4d9 None admin] RBAC: Authorizing `identity:get_role(role_id=472f2455c837486084f108ce944f1bff)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:24.838881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310babb-41eb-4b2f-b485-299a40a4d4d9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:24.840267 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 542/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:13:24 2022] GET /identity/v3/roles/472f2455c837486084f108ce944f1bff => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:24.846824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0cbe0-8368-40c9-a98c-c865167b895a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:24.877135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:24.945217 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0cbe0-8368-40c9-a98c-c865167b895a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:24.977949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880b8ca-deff-4f46-9221-56dd9e21c6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:24.978593 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880b8ca-deff-4f46-9221-56dd9e21c6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:24.978877 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880b8ca-deff-4f46-9221-56dd9e21c6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:24.979155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880b8ca-deff-4f46-9221-56dd9e21c6f3 None admin] PATH_INFO: `/v3/users/c6a168775a2441d28b4da54d4c05f66f` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:24.992530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880b8ca-deff-4f46-9221-56dd9e21c6f3 None admin] RBAC: Authorizing `identity:get_user(user_id=c6a168775a2441d28b4da54d4c05f66f)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:24.993994 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880b8ca-deff-4f46-9221-56dd9e21c6f3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:24.995633 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 572/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:13:24 2022] GET /identity/v3/users/c6a168775a2441d28b4da54d4c05f66f => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:25.001588 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310babb-41eb-4b2f-b485-299a40a4d4d9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:25.099656 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310babb-41eb-4b2f-b485-299a40a4d4d9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:25.127742 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:25.133543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327d918-9806-4578-81f3-2f545e54731d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:25.134165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327d918-9806-4578-81f3-2f545e54731d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:25.134445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327d918-9806-4578-81f3-2f545e54731d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:25.134720 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327d918-9806-4578-81f3-2f545e54731d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:25.201364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327d918-9806-4578-81f3-2f545e54731d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:25.203467 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327d918-9806-4578-81f3-2f545e54731d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:25.300019 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 543/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:13:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:13:25.306066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880b8ca-deff-4f46-9221-56dd9e21c6f3 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:25.395222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:25.405086 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880b8ca-deff-4f46-9221-56dd9e21c6f3 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:25.439063 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b21cd2-3f38-4531-8379-cc117442c455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:25.439707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b21cd2-3f38-4531-8379-cc117442c455 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:25.439993 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b21cd2-3f38-4531-8379-cc117442c455 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:25.440303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b21cd2-3f38-4531-8379-cc117442c455 None admin] PATH_INFO: `/v3/projects/6c10903fdd10479ebde242169c435af2` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:25.441456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b21cd2-3f38-4531-8379-cc117442c455 None admin] RBAC: Authorizing `identity:get_project(project_id=6c10903fdd10479ebde242169c435af2)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:25.442936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b21cd2-3f38-4531-8379-cc117442c455 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:25.444651 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 573/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:13:25 2022] GET /identity/v3/projects/6c10903fdd10479ebde242169c435af2 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:25.450777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327d918-9806-4578-81f3-2f545e54731d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:25.481228 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:25.550511 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327d918-9806-4578-81f3-2f545e54731d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:25.584401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de56c1-aa77-41f6-83c5-b9cf6e0e585d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:25.585025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de56c1-aa77-41f6-83c5-b9cf6e0e585d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:25.585287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de56c1-aa77-41f6-83c5-b9cf6e0e585d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:25.585560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de56c1-aa77-41f6-83c5-b9cf6e0e585d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:25.586344 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de56c1-aa77-41f6-83c5-b9cf6e0e585d None admin] RBAC: Adding query filter params (role.id=472f2455c837486084f108ce944f1bff, scope.project.id=6c10903fdd10479ebde242169c435af2, user.id=c6a168775a2441d28b4da54d4c05f66f) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:25.586655 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de56c1-aa77-41f6-83c5-b9cf6e0e585d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:25.588074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de56c1-aa77-41f6-83c5-b9cf6e0e585d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:25.593949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 544/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:13:25 2022] GET /identity/v3/role_assignments?user.id=c6a168775a2441d28b4da54d4c05f66f&scope.project.id=6c10903fdd10479ebde242169c435af2&role.id=472f2455c837486084f108ce944f1bff => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:27.594259 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959aaa2e-f6a9-481e-95cb-df17a204699d None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:27.594796 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959aaa2e-f6a9-481e-95cb-df17a204699d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:27.594796 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959aaa2e-f6a9-481e-95cb-df17a204699d None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:27.596159 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 574/1118] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:27.601294 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b7467-3975-45ec-84d3-1b1e4cf977aa None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:27.601745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b7467-3975-45ec-84d3-1b1e4cf977aa None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:27.601865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b7467-3975-45ec-84d3-1b1e4cf977aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:27.621146 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-813b7467-3975-45ec-84d3-1b1e4cf977aa None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:27.622784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-813b7467-3975-45ec-84d3-1b1e4cf977aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:27.690867 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 545/1119] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:27.713687 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959aaa2e-f6a9-481e-95cb-df17a204699d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:27.815881 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959aaa2e-f6a9-481e-95cb-df17a204699d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:27.849198 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c6d9c-aa7f-4253-adec-b877296fb131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:27.849778 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c6d9c-aa7f-4253-adec-b877296fb131 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:27.851220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c6d9c-aa7f-4253-adec-b877296fb131 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:27.851220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c6d9c-aa7f-4253-adec-b877296fb131 None admin] PATH_INFO: `/v3/roles/472f2455c837486084f108ce944f1bff` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:27.852084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c6d9c-aa7f-4253-adec-b877296fb131 None admin] RBAC: Authorizing `identity:get_role(role_id=472f2455c837486084f108ce944f1bff)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:27.853553 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c6d9c-aa7f-4253-adec-b877296fb131 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:27.854916 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 575/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:13:27 2022] GET /identity/v3/roles/472f2455c837486084f108ce944f1bff => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:27.861828 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b7467-3975-45ec-84d3-1b1e4cf977aa None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:27.886608 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:27.960313 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b7467-3975-45ec-84d3-1b1e4cf977aa None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:27.994400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159def1f-dc12-467f-8e21-2445f9438617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:27.995068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159def1f-dc12-467f-8e21-2445f9438617 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:27.995353 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159def1f-dc12-467f-8e21-2445f9438617 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:27.995632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159def1f-dc12-467f-8e21-2445f9438617 None admin] PATH_INFO: `/v3/users/c6a168775a2441d28b4da54d4c05f66f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:27.996816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159def1f-dc12-467f-8e21-2445f9438617 None admin] RBAC: Authorizing `identity:get_user(user_id=c6a168775a2441d28b4da54d4c05f66f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:27.998256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159def1f-dc12-467f-8e21-2445f9438617 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:28.000483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 546/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:13:27 2022] GET /identity/v3/users/c6a168775a2441d28b4da54d4c05f66f => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:28.006299 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c6d9c-aa7f-4253-adec-b877296fb131 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:28.034605 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:28.106937 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c6d9c-aa7f-4253-adec-b877296fb131 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:28.141129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb783e64-ccfc-4673-ab23-2e37485e7564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:28.141785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb783e64-ccfc-4673-ab23-2e37485e7564 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:28.142070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb783e64-ccfc-4673-ab23-2e37485e7564 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:28.142348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb783e64-ccfc-4673-ab23-2e37485e7564 None admin] PATH_INFO: `/v3/projects/6c10903fdd10479ebde242169c435af2` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:28.143500 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb783e64-ccfc-4673-ab23-2e37485e7564 None admin] RBAC: Authorizing `identity:get_project(project_id=6c10903fdd10479ebde242169c435af2)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:28.144974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb783e64-ccfc-4673-ab23-2e37485e7564 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:28.146652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 576/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:13:28 2022] GET /identity/v3/projects/6c10903fdd10479ebde242169c435af2 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:28.152729 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159def1f-dc12-467f-8e21-2445f9438617 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:28.243902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:28.253385 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159def1f-dc12-467f-8e21-2445f9438617 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:28.286630 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e93157-5a7e-4b75-87ac-575d006b13f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:28.287299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e93157-5a7e-4b75-87ac-575d006b13f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:28.287585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e93157-5a7e-4b75-87ac-575d006b13f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:28.287867 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e93157-5a7e-4b75-87ac-575d006b13f1 None admin] PATH_INFO: `/v3/projects/6c10903fdd10479ebde242169c435af2/users/c6a168775a2441d28b4da54d4c05f66f/roles/472f2455c837486084f108ce944f1bff` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:28.290084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e93157-5a7e-4b75-87ac-575d006b13f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c10903fdd10479ebde242169c435af2, user_id=c6a168775a2441d28b4da54d4c05f66f, role_id=472f2455c837486084f108ce944f1bff)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:28.291529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e93157-5a7e-4b75-87ac-575d006b13f1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:28.304715 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 547/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:13:28 2022] PUT /identity/v3/projects/6c10903fdd10479ebde242169c435af2/users/c6a168775a2441d28b4da54d4c05f66f/roles/472f2455c837486084f108ce944f1bff => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:13:30.289325 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb40b37-7785-45b8-8b7f-0ff106083803 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:30.289885 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb40b37-7785-45b8-8b7f-0ff106083803 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:30.289885 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb40b37-7785-45b8-8b7f-0ff106083803 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:30.291211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 577/1124] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:30.296461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7726b50-3c02-4940-86df-3810188e96e4 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:30.296896 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7726b50-3c02-4940-86df-3810188e96e4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:30.297022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7726b50-3c02-4940-86df-3810188e96e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:30.315601 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-e7726b50-3c02-4940-86df-3810188e96e4 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:30.316831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e7726b50-3c02-4940-86df-3810188e96e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:30.382106 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 548/1125] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:30.406111 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb40b37-7785-45b8-8b7f-0ff106083803 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:30.499114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:30.507661 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb40b37-7785-45b8-8b7f-0ff106083803 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:30.540342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4153178-f63f-49d3-88b3-ab1c22c41e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:30.540915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4153178-f63f-49d3-88b3-ab1c22c41e56 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:30.541200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4153178-f63f-49d3-88b3-ab1c22c41e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:30.541480 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4153178-f63f-49d3-88b3-ab1c22c41e56 None admin] PATH_INFO: `/v3/roles/472f2455c837486084f108ce944f1bff` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:30.542936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4153178-f63f-49d3-88b3-ab1c22c41e56 None admin] RBAC: Authorizing `identity:get_role(role_id=472f2455c837486084f108ce944f1bff)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:30.544346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4153178-f63f-49d3-88b3-ab1c22c41e56 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:30.545703 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 578/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:13:30 2022] GET /identity/v3/roles/472f2455c837486084f108ce944f1bff => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:30.552584 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7726b50-3c02-4940-86df-3810188e96e4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:30.633119 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:30.651851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7726b50-3c02-4940-86df-3810188e96e4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:30.685209 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6507457-877c-4dab-b76d-99aef7fa11dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:30.685849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6507457-877c-4dab-b76d-99aef7fa11dd None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:30.686134 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6507457-877c-4dab-b76d-99aef7fa11dd None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:30.686665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6507457-877c-4dab-b76d-99aef7fa11dd None admin] PATH_INFO: `/v3/users/c6a168775a2441d28b4da54d4c05f66f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:30.688463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6507457-877c-4dab-b76d-99aef7fa11dd None admin] RBAC: Authorizing `identity:get_user(user_id=c6a168775a2441d28b4da54d4c05f66f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:30.689915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6507457-877c-4dab-b76d-99aef7fa11dd None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:30.691542 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 549/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:13:30 2022] GET /identity/v3/users/c6a168775a2441d28b4da54d4c05f66f => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:30.697362 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4153178-f63f-49d3-88b3-ab1c22c41e56 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:30.795000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4153178-f63f-49d3-88b3-ab1c22c41e56 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:30.828103 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06d564-5baa-4c99-93f1-df367afa687a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:30.828742 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06d564-5baa-4c99-93f1-df367afa687a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:30.829025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06d564-5baa-4c99-93f1-df367afa687a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:30.829300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06d564-5baa-4c99-93f1-df367afa687a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:30.858006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:30.895178 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06d564-5baa-4c99-93f1-df367afa687a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:30.896652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06d564-5baa-4c99-93f1-df367afa687a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:30.992347 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 579/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:13:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:13:30.998287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6507457-877c-4dab-b76d-99aef7fa11dd None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:31.097353 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6507457-877c-4dab-b76d-99aef7fa11dd None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:31.130699 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386fe8f-851b-43a3-a04f-095d0057d436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:31.131336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386fe8f-851b-43a3-a04f-095d0057d436 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:31.131627 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386fe8f-851b-43a3-a04f-095d0057d436 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:31.131901 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386fe8f-851b-43a3-a04f-095d0057d436 None admin] PATH_INFO: `/v3/projects/6c10903fdd10479ebde242169c435af2` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:31.133100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386fe8f-851b-43a3-a04f-095d0057d436 None admin] RBAC: Authorizing `identity:get_project(project_id=6c10903fdd10479ebde242169c435af2)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:31.134534 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386fe8f-851b-43a3-a04f-095d0057d436 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:31.136227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 550/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:13:30 2022] GET /identity/v3/projects/6c10903fdd10479ebde242169c435af2 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:31.143350 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06d564-5baa-4c99-93f1-df367afa687a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:31.203932 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:31.241937 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06d564-5baa-4c99-93f1-df367afa687a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:31.275150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1df38-c772-418e-a882-37f348ed6997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:31.275772 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1df38-c772-418e-a882-37f348ed6997 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:31.276058 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1df38-c772-418e-a882-37f348ed6997 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:31.276372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1df38-c772-418e-a882-37f348ed6997 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:31.277160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1df38-c772-418e-a882-37f348ed6997 None admin] RBAC: Adding query filter params (role.id=472f2455c837486084f108ce944f1bff, scope.project.id=6c10903fdd10479ebde242169c435af2, user.id=c6a168775a2441d28b4da54d4c05f66f) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:31.277476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1df38-c772-418e-a882-37f348ed6997 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:31.278910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1df38-c772-418e-a882-37f348ed6997 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:31.285206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 580/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:13:31 2022] GET /identity/v3/role_assignments?user.id=c6a168775a2441d28b4da54d4c05f66f&scope.project.id=6c10903fdd10479ebde242169c435af2&role.id=472f2455c837486084f108ce944f1bff => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:33.340770 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e2844-e54e-4c27-b69f-0486c04a755d None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:33.341330 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e2844-e54e-4c27-b69f-0486c04a755d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:33.341330 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e2844-e54e-4c27-b69f-0486c04a755d None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:33.342698 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 551/1131] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:33.348737 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436b673-fc67-4650-b0ce-ab235a9a4767 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:33.349125 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436b673-fc67-4650-b0ce-ab235a9a4767 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:33.349303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436b673-fc67-4650-b0ce-ab235a9a4767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:33.367622 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8436b673-fc67-4650-b0ce-ab235a9a4767 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:33.368857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8436b673-fc67-4650-b0ce-ab235a9a4767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:33.434470 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 581/1132] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:33.458096 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e2844-e54e-4c27-b69f-0486c04a755d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:33.477321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:33.561263 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e2844-e54e-4c27-b69f-0486c04a755d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:33.595168 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415735d3-3929-403c-871d-b92993ec20c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:33.595721 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415735d3-3929-403c-871d-b92993ec20c7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:33.595997 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415735d3-3929-403c-871d-b92993ec20c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:33.596310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415735d3-3929-403c-871d-b92993ec20c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:33.597450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415735d3-3929-403c-871d-b92993ec20c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:33.598885 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415735d3-3929-403c-871d-b92993ec20c7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:33.600512 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 552/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:13:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:33.606662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436b673-fc67-4650-b0ce-ab235a9a4767 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:33.662072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:33.704894 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436b673-fc67-4650-b0ce-ab235a9a4767 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:33.738577 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7636947-9d4e-42e8-84b0-620f597af52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:33.739201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7636947-9d4e-42e8-84b0-620f597af52c None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:33.739485 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7636947-9d4e-42e8-84b0-620f597af52c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:33.739760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7636947-9d4e-42e8-84b0-620f597af52c None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:33.740470 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7636947-9d4e-42e8-84b0-620f597af52c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:33.741898 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7636947-9d4e-42e8-84b0-620f597af52c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:33.769045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 582/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Aug 4 10:13:33 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:13:35.822760 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70e4ce-026c-40e0-a370-7f60a16bf3da None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:35.823323 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70e4ce-026c-40e0-a370-7f60a16bf3da None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:35.823431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70e4ce-026c-40e0-a370-7f60a16bf3da None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:35.824769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 553/1135] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:35.830452 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b66048-0d5b-41b3-b5e4-c2e6e6dc09a6 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:35.830876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b66048-0d5b-41b3-b5e4-c2e6e6dc09a6 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:35.831001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b66048-0d5b-41b3-b5e4-c2e6e6dc09a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:35.849449 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e9b66048-0d5b-41b3-b5e4-c2e6e6dc09a6 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:35.850628 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e9b66048-0d5b-41b3-b5e4-c2e6e6dc09a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:35.915588 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 583/1136] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:35.940465 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70e4ce-026c-40e0-a370-7f60a16bf3da None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:36.033856 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:36.049730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70e4ce-026c-40e0-a370-7f60a16bf3da None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:36.084289 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad257e-8c86-4403-86da-819a2a4f3bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:36.084932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad257e-8c86-4403-86da-819a2a4f3bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:36.085209 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad257e-8c86-4403-86da-819a2a4f3bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:36.085481 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad257e-8c86-4403-86da-819a2a4f3bd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:36.086627 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad257e-8c86-4403-86da-819a2a4f3bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:36.088052 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad257e-8c86-4403-86da-819a2a4f3bd3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:36.089685 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 554/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:13:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:36.095460 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b66048-0d5b-41b3-b5e4-c2e6e6dc09a6 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:36.134870 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:36.195350 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b66048-0d5b-41b3-b5e4-c2e6e6dc09a6 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:36.228761 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0765bf6-142a-40f2-82ff-907c2640a50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:36.229386 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0765bf6-142a-40f2-82ff-907c2640a50c None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:36.229672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0765bf6-142a-40f2-82ff-907c2640a50c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:36.229953 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0765bf6-142a-40f2-82ff-907c2640a50c None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:36.230646 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0765bf6-142a-40f2-82ff-907c2640a50c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:36.232098 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0765bf6-142a-40f2-82ff-907c2640a50c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:36.255095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 584/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Aug 4 10:13:36 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:13:38.288918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dae14-dcc2-4bb4-ad97-a80f43705342 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:38.289483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dae14-dcc2-4bb4-ad97-a80f43705342 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:38.289483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dae14-dcc2-4bb4-ad97-a80f43705342 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:38.290820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 555/1139] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:38.296798 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca41188-2c30-43e5-80fa-54a099d3132f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:38.297190 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca41188-2c30-43e5-80fa-54a099d3132f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:38.297369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca41188-2c30-43e5-80fa-54a099d3132f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:38.315138 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8ca41188-2c30-43e5-80fa-54a099d3132f None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:38.316358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8ca41188-2c30-43e5-80fa-54a099d3132f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:38.380989 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 585/1140] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:38.404267 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dae14-dcc2-4bb4-ad97-a80f43705342 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:38.505806 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dae14-dcc2-4bb4-ad97-a80f43705342 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:38.539883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9081044-79df-48ec-995d-8e279ce0973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:38.540489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9081044-79df-48ec-995d-8e279ce0973c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:38.540777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9081044-79df-48ec-995d-8e279ce0973c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:38.541056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9081044-79df-48ec-995d-8e279ce0973c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:38.551286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9081044-79df-48ec-995d-8e279ce0973c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:13:38.556281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-c9081044-79df-48ec-995d-8e279ce0973c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:13:38.556281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:38.556281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:38.556281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:38.556281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:38.556281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:38.556281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:38.556281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:38.556281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:38.556281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:38.556281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:38.556281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:38.556281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:13:38.556281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:13:38.556281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:13:38.556281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:13:38.557230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:13:38.557230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:13:38.557230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:13:38.557230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:13:38.557230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:38.557230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:38.557230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:38.557230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:38.557230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:38.557230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:38.557230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:38.557230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:38.557230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:38.557230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:38.557230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:38.557230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:38.558145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:38.558145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:38.558145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:38.558145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:38.558145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:13:38.558145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:13:38.558145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:13:38.558145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:13:38.558145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:13:38.558145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:13:38.558145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:13:38.558145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:38.558145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 556/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:13:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:38.564675 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca41188-2c30-43e5-80fa-54a099d3132f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:38.589072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:38.663772 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca41188-2c30-43e5-80fa-54a099d3132f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:38.698750 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f323497-95b4-4dd1-beaf-51fc6331b8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:38.699376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f323497-95b4-4dd1-beaf-51fc6331b8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:38.699660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f323497-95b4-4dd1-beaf-51fc6331b8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:38.699948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f323497-95b4-4dd1-beaf-51fc6331b8a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:38.700689 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f323497-95b4-4dd1-beaf-51fc6331b8a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:38.700998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f323497-95b4-4dd1-beaf-51fc6331b8a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:38.702654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f323497-95b4-4dd1-beaf-51fc6331b8a8 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:38.710804 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 586/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:13:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:38.716752 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9081044-79df-48ec-995d-8e279ce0973c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:38.732593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:38.816954 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9081044-79df-48ec-995d-8e279ce0973c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:38.850430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988bd95-48de-41a7-8651-e8734d892566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:38.851074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988bd95-48de-41a7-8651-e8734d892566 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:38.851359 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988bd95-48de-41a7-8651-e8734d892566 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:38.851639 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988bd95-48de-41a7-8651-e8734d892566 None admin] PATH_INFO: `/v3/users/d55e2c1723f54acf850672ae4941817a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:38.865464 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988bd95-48de-41a7-8651-e8734d892566 None admin] RBAC: Authorizing `identity:get_user(user_id=d55e2c1723f54acf850672ae4941817a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:38.866925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988bd95-48de-41a7-8651-e8734d892566 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:38.868663 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 557/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:13:38 2022] GET /identity/v3/users/d55e2c1723f54acf850672ae4941817a => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:38.875087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f323497-95b4-4dd1-beaf-51fc6331b8a8 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:38.959703 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:38.974836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f323497-95b4-4dd1-beaf-51fc6331b8a8 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:39.010045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fecec-01dc-4df9-acd8-0dbf19c8a09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:39.010668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fecec-01dc-4df9-acd8-0dbf19c8a09e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:39.010954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fecec-01dc-4df9-acd8-0dbf19c8a09e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:39.011234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fecec-01dc-4df9-acd8-0dbf19c8a09e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:39.079849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fecec-01dc-4df9-acd8-0dbf19c8a09e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:39.081256 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fecec-01dc-4df9-acd8-0dbf19c8a09e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:39.164635 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:39.180299 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 587/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:13:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:13:39.186203 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988bd95-48de-41a7-8651-e8734d892566 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:39.255225 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:39.285018 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988bd95-48de-41a7-8651-e8734d892566 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:39.318407 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35c37b-267b-4a25-a6ec-222ef201fa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:39.319039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35c37b-267b-4a25-a6ec-222ef201fa1f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:39.319316 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35c37b-267b-4a25-a6ec-222ef201fa1f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:39.319592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35c37b-267b-4a25-a6ec-222ef201fa1f None admin] PATH_INFO: `/v3/projects/61eb6047021e4a36ae10fff8814f607a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:39.320759 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35c37b-267b-4a25-a6ec-222ef201fa1f None admin] RBAC: Authorizing `identity:get_project(project_id=61eb6047021e4a36ae10fff8814f607a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:39.322187 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35c37b-267b-4a25-a6ec-222ef201fa1f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:39.323848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 558/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:13:39 2022] GET /identity/v3/projects/61eb6047021e4a36ae10fff8814f607a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:39.330245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fecec-01dc-4df9-acd8-0dbf19c8a09e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:39.428084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fecec-01dc-4df9-acd8-0dbf19c8a09e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:39.461251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442955d-fd5d-4a77-a0d4-02e202fec980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:39.461872 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442955d-fd5d-4a77-a0d4-02e202fec980 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:39.462154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442955d-fd5d-4a77-a0d4-02e202fec980 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:39.462431 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442955d-fd5d-4a77-a0d4-02e202fec980 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:39.463215 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442955d-fd5d-4a77-a0d4-02e202fec980 None admin] RBAC: Adding query filter params (role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.project.id=61eb6047021e4a36ae10fff8814f607a, user.id=d55e2c1723f54acf850672ae4941817a) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:39.463530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442955d-fd5d-4a77-a0d4-02e202fec980 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:39.465276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442955d-fd5d-4a77-a0d4-02e202fec980 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:39.471554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 588/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:13:39 2022] GET /identity/v3/role_assignments?user.id=d55e2c1723f54acf850672ae4941817a&scope.project.id=61eb6047021e4a36ae10fff8814f607a&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:41.450251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a38c0e-4703-4d73-b361-2719900fc60f None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:41.450783 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a38c0e-4703-4d73-b361-2719900fc60f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:41.450783 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a38c0e-4703-4d73-b361-2719900fc60f None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:41.452984 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 559/1147] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:41.458257 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503f26d-0554-44d9-818b-b3431d822c50 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:41.458662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503f26d-0554-44d9-818b-b3431d822c50 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:41.458823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503f26d-0554-44d9-818b-b3431d822c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:41.476481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8503f26d-0554-44d9-818b-b3431d822c50 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:41.477668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8503f26d-0554-44d9-818b-b3431d822c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:41.523562 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:41.544591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 589/1148] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:41.566660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a38c0e-4703-4d73-b361-2719900fc60f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:41.666803 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a38c0e-4703-4d73-b361-2719900fc60f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:41.701213 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13499862-4549-4303-b075-035c774ed69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:41.701767 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13499862-4549-4303-b075-035c774ed69f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:41.702082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13499862-4549-4303-b075-035c774ed69f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:41.702348 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13499862-4549-4303-b075-035c774ed69f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:41.709669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:41.712809 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13499862-4549-4303-b075-035c774ed69f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:13:41.717865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-13499862-4549-4303-b075-035c774ed69f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:13:41.717865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:41.717865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:41.717865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:41.717865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:41.717865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:41.717865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:41.717865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:41.717865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:41.717865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:41.717865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:41.717865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:41.717865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:13:41.717865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:13:41.717865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:13:41.717865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:13:41.718959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:13:41.718959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:13:41.718959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:13:41.718959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:13:41.718959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:41.718959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:41.718959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:41.718959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:41.718959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:41.718959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:41.718959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:41.718959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:41.718959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:41.718959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:41.718959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:41.718959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:41.720158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:41.720158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:41.720158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:41.720158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:41.720158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:13:41.720158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:13:41.720158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:13:41.720158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:13:41.720158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:13:41.720158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:13:41.720158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:13:41.720158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:41.720158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 560/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:13:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:41.725121 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503f26d-0554-44d9-818b-b3431d822c50 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:41.822015 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503f26d-0554-44d9-818b-b3431d822c50 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:41.854851 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0569a13-2ef4-468d-adf8-797bd4421243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:41.855479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0569a13-2ef4-468d-adf8-797bd4421243 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:41.855765 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0569a13-2ef4-468d-adf8-797bd4421243 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:41.856046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0569a13-2ef4-468d-adf8-797bd4421243 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:41.856795 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0569a13-2ef4-468d-adf8-797bd4421243 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:41.857106 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0569a13-2ef4-468d-adf8-797bd4421243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:41.859310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0569a13-2ef4-468d-adf8-797bd4421243 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:41.867360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 590/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:13:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:41.873248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13499862-4549-4303-b075-035c774ed69f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:41.972697 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13499862-4549-4303-b075-035c774ed69f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:42.006722 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd1bf3-370b-4bfd-89af-280ff390598e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:42.007369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd1bf3-370b-4bfd-89af-280ff390598e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:42.007653 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd1bf3-370b-4bfd-89af-280ff390598e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:42.007933 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd1bf3-370b-4bfd-89af-280ff390598e None admin] PATH_INFO: `/v3/users/d55e2c1723f54acf850672ae4941817a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:42.009138 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd1bf3-370b-4bfd-89af-280ff390598e None admin] RBAC: Authorizing `identity:get_user(user_id=d55e2c1723f54acf850672ae4941817a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:42.010566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd1bf3-370b-4bfd-89af-280ff390598e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:42.012209 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 561/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:13:41 2022] GET /identity/v3/users/d55e2c1723f54acf850672ae4941817a => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:42.018820 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0569a13-2ef4-468d-adf8-797bd4421243 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:42.062701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:42.117951 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0569a13-2ef4-468d-adf8-797bd4421243 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:42.151750 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623e01b-2395-4ae2-b673-7cc9dd8903fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:42.152429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623e01b-2395-4ae2-b673-7cc9dd8903fa None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:42.152715 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623e01b-2395-4ae2-b673-7cc9dd8903fa None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:42.152994 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623e01b-2395-4ae2-b673-7cc9dd8903fa None admin] PATH_INFO: `/v3/projects/61eb6047021e4a36ae10fff8814f607a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:42.154149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623e01b-2395-4ae2-b673-7cc9dd8903fa None admin] RBAC: Authorizing `identity:get_project(project_id=61eb6047021e4a36ae10fff8814f607a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:42.156318 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623e01b-2395-4ae2-b673-7cc9dd8903fa None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:42.158001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 591/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:13:42 2022] GET /identity/v3/projects/61eb6047021e4a36ae10fff8814f607a => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:42.163949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd1bf3-370b-4bfd-89af-280ff390598e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:42.230101 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:42.263292 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd1bf3-370b-4bfd-89af-280ff390598e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:42.296749 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201c76f-0dba-42f0-8eb5-cfb803e262ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:42.297548 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c76f-0dba-42f0-8eb5-cfb803e262ef None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:42.297830 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c76f-0dba-42f0-8eb5-cfb803e262ef None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:42.298107 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201c76f-0dba-42f0-8eb5-cfb803e262ef None admin] PATH_INFO: `/v3/projects/61eb6047021e4a36ae10fff8814f607a/users/d55e2c1723f54acf850672ae4941817a/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:42.300044 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201c76f-0dba-42f0-8eb5-cfb803e262ef None admin] RBAC: Authorizing `identity:create_grant(project_id=61eb6047021e4a36ae10fff8814f607a, user_id=d55e2c1723f54acf850672ae4941817a, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:42.301497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201c76f-0dba-42f0-8eb5-cfb803e262ef None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:42.314564 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 562/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:13:42 2022] PUT /identity/v3/projects/61eb6047021e4a36ae10fff8814f607a/users/d55e2c1723f54acf850672ae4941817a/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:13:44.329777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6a0cd-4031-44fa-8f7b-1131cf0c068f None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:44.330314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6a0cd-4031-44fa-8f7b-1131cf0c068f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:44.330314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6a0cd-4031-44fa-8f7b-1131cf0c068f None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:44.331687 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 592/1154] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:44.336847 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304b7af-fedb-4917-9794-e26140d72c81 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:44.337274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304b7af-fedb-4917-9794-e26140d72c81 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:44.337409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304b7af-fedb-4917-9794-e26140d72c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:44.355307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7304b7af-fedb-4917-9794-e26140d72c81 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:44.356532 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7304b7af-fedb-4917-9794-e26140d72c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:44.421566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 563/1155] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:44.444775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6a0cd-4031-44fa-8f7b-1131cf0c068f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:44.545600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6a0cd-4031-44fa-8f7b-1131cf0c068f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:44.556963 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:44.581627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b972742-c6fa-4d33-bc11-75b0634dbf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:44.582197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b972742-c6fa-4d33-bc11-75b0634dbf23 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:44.582480 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b972742-c6fa-4d33-bc11-75b0634dbf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:44.582758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b972742-c6fa-4d33-bc11-75b0634dbf23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:44.592482 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b972742-c6fa-4d33-bc11-75b0634dbf23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:13:44.597358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-6b972742-c6fa-4d33-bc11-75b0634dbf23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:13:44.597358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:44.597358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:44.597358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:44.597358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:44.597358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:44.597358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:44.597358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:44.597358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:44.597358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:44.597358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:44.597358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:44.597358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:13:44.597358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:13:44.597358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:13:44.597358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:13:44.598417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:13:44.598417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:13:44.598417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:13:44.598417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:13:44.598417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:44.598417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:44.598417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:44.598417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:44.598417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:44.598417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:44.598417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:44.598417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:44.598417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:44.598417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:44.598417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:44.598417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:44.604363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:44.604363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:44.604363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:44.604363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:44.604363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:13:44.604363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:13:44.604363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:13:44.604363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:13:44.604363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:13:44.604363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:13:44.604363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:13:44.604363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:44.604363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 593/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:13:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:44.605213 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304b7af-fedb-4917-9794-e26140d72c81 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:44.661771 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:44.704778 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304b7af-fedb-4917-9794-e26140d72c81 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:44.737874 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126edff-e5c9-4f1f-9209-39d77bdfcca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:44.738485 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126edff-e5c9-4f1f-9209-39d77bdfcca6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:44.738765 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126edff-e5c9-4f1f-9209-39d77bdfcca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:44.739038 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126edff-e5c9-4f1f-9209-39d77bdfcca6 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:44.739747 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126edff-e5c9-4f1f-9209-39d77bdfcca6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:44.740052 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126edff-e5c9-4f1f-9209-39d77bdfcca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:44.741441 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126edff-e5c9-4f1f-9209-39d77bdfcca6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:44.750165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 564/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:13:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:44.756074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b972742-c6fa-4d33-bc11-75b0634dbf23 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:44.854203 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b972742-c6fa-4d33-bc11-75b0634dbf23 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:44.887754 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638444b-aebb-4da8-bdc4-83b274b688da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:44.888415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638444b-aebb-4da8-bdc4-83b274b688da None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:44.888693 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638444b-aebb-4da8-bdc4-83b274b688da None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:44.888962 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638444b-aebb-4da8-bdc4-83b274b688da None admin] PATH_INFO: `/v3/users/d55e2c1723f54acf850672ae4941817a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:44.890170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638444b-aebb-4da8-bdc4-83b274b688da None admin] RBAC: Authorizing `identity:get_user(user_id=d55e2c1723f54acf850672ae4941817a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:44.891596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638444b-aebb-4da8-bdc4-83b274b688da None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:44.893216 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 594/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:13:44 2022] GET /identity/v3/users/d55e2c1723f54acf850672ae4941817a => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:44.899027 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126edff-e5c9-4f1f-9209-39d77bdfcca6 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:44.998755 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126edff-e5c9-4f1f-9209-39d77bdfcca6 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:45.018400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:45.032876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f3e32-9f54-455c-963d-49dc92371e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:45.033498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f3e32-9f54-455c-963d-49dc92371e32 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:45.033776 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f3e32-9f54-455c-963d-49dc92371e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:45.034044 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f3e32-9f54-455c-963d-49dc92371e32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:45.100195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f3e32-9f54-455c-963d-49dc92371e32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:45.101631 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f3e32-9f54-455c-963d-49dc92371e32 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:45.198697 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 565/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:13:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:13:45.205332 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638444b-aebb-4da8-bdc4-83b274b688da None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:45.244878 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:45.304777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638444b-aebb-4da8-bdc4-83b274b688da None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:45.338574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9344d5-1749-4a97-9da8-64683c30e508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:45.339209 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9344d5-1749-4a97-9da8-64683c30e508 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:45.339481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9344d5-1749-4a97-9da8-64683c30e508 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:45.339755 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9344d5-1749-4a97-9da8-64683c30e508 None admin] PATH_INFO: `/v3/projects/61eb6047021e4a36ae10fff8814f607a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:45.340927 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9344d5-1749-4a97-9da8-64683c30e508 None admin] RBAC: Authorizing `identity:get_project(project_id=61eb6047021e4a36ae10fff8814f607a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:45.342377 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9344d5-1749-4a97-9da8-64683c30e508 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:45.344090 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 595/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:13:45 2022] GET /identity/v3/projects/61eb6047021e4a36ae10fff8814f607a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:45.350306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f3e32-9f54-455c-963d-49dc92371e32 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:45.370875 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:45.448079 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f3e32-9f54-455c-963d-49dc92371e32 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:45.481831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f731f4c-1a32-4d97-9d08-1211bc494f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:45.482381 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f731f4c-1a32-4d97-9d08-1211bc494f58 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:45.482663 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f731f4c-1a32-4d97-9d08-1211bc494f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:45.482940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f731f4c-1a32-4d97-9d08-1211bc494f58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:45.483887 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f731f4c-1a32-4d97-9d08-1211bc494f58 None admin] RBAC: Adding query filter params (role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.project.id=61eb6047021e4a36ae10fff8814f607a, user.id=d55e2c1723f54acf850672ae4941817a) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:45.484229 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f731f4c-1a32-4d97-9d08-1211bc494f58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:45.485653 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f731f4c-1a32-4d97-9d08-1211bc494f58 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:45.491486 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 566/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:13:45 2022] GET /identity/v3/role_assignments?user.id=d55e2c1723f54acf850672ae4941817a&scope.project.id=61eb6047021e4a36ae10fff8814f607a&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:47.509333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5982bd-6d64-4abe-add9-8a0c5d5c0c08 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:47.509867 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5982bd-6d64-4abe-add9-8a0c5d5c0c08 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:47.509867 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5982bd-6d64-4abe-add9-8a0c5d5c0c08 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:47.511220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 596/1162] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:47.516371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c177a25-6c66-4034-9fa8-0d4d6acad95a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:47.516807 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c177a25-6c66-4034-9fa8-0d4d6acad95a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:47.516925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c177a25-6c66-4034-9fa8-0d4d6acad95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:47.535357 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4c177a25-6c66-4034-9fa8-0d4d6acad95a None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:47.536592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4c177a25-6c66-4034-9fa8-0d4d6acad95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:47.602064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 567/1163] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:47.624816 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5982bd-6d64-4abe-add9-8a0c5d5c0c08 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:47.729091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5982bd-6d64-4abe-add9-8a0c5d5c0c08 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:47.736311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:47.763562 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658cf9b-e1b1-4468-abd0-965051eb475c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:47.764104 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658cf9b-e1b1-4468-abd0-965051eb475c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:47.764956 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658cf9b-e1b1-4468-abd0-965051eb475c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:47.765233 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658cf9b-e1b1-4468-abd0-965051eb475c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:47.832037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658cf9b-e1b1-4468-abd0-965051eb475c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:47.833528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658cf9b-e1b1-4468-abd0-965051eb475c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:47.929885 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 597/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:13:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:13:47.935838 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c177a25-6c66-4034-9fa8-0d4d6acad95a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:47.951393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:48.035098 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c177a25-6c66-4034-9fa8-0d4d6acad95a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:48.071067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d4e7a-074b-4804-b41e-fe001dc1ec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:48.071706 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d4e7a-074b-4804-b41e-fe001dc1ec89 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:48.071987 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d4e7a-074b-4804-b41e-fe001dc1ec89 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:48.072292 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d4e7a-074b-4804-b41e-fe001dc1ec89 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:48.079408 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d4e7a-074b-4804-b41e-fe001dc1ec89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:48.080892 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d4e7a-074b-4804-b41e-fe001dc1ec89 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:48.093712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-4b0d4e7a-074b-4804-b41e-fe001dc1ec89 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 10:13:48.093712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:48.093712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 04 10:13:48.093712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 04 10:13:48.093712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:13:48.093712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:13:48.093712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:13:48.093712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:13:48.093712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 04 10:13:48.093712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:48.093712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:13:48.093712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:48.093712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:48.093712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:48.093712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:48.093712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:48.093712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:48.095555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:48.095555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:48.095555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:48.095555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:48.095555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:48.095555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:48.095555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:13:48.095555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:13:48.095555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:13:48.095555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:13:48.095555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:48.095555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:48.095555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:48.095555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:48.095555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:48.095555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:48.097221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:48.097221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:48.097221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:48.097221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:48.097221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:48.097221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:48.097221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:48.097221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:48.097221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:48.097221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:48.097221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 04 10:13:48.097221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:13:48.097221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 10:13:48.097221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:13:48.100194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 568/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Aug 4 10:13:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:48.101155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658cf9b-e1b1-4468-abd0-965051eb475c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:48.109667 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:48.201704 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658cf9b-e1b1-4468-abd0-965051eb475c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:48.235468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc80a4-153a-4eae-9c87-9b3aab3c7260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:48.236096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc80a4-153a-4eae-9c87-9b3aab3c7260 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:48.236406 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc80a4-153a-4eae-9c87-9b3aab3c7260 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:48.236687 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc80a4-153a-4eae-9c87-9b3aab3c7260 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:48.237379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc80a4-153a-4eae-9c87-9b3aab3c7260 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:48.237686 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc80a4-153a-4eae-9c87-9b3aab3c7260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:48.239058 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc80a4-153a-4eae-9c87-9b3aab3c7260 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:48.246433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 598/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Aug 4 10:13:48 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:13:50.241354 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f14c8c-6d95-4d4b-8ad6-67052cf40ad5 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:50.241916 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f14c8c-6d95-4d4b-8ad6-67052cf40ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:50.241916 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f14c8c-6d95-4d4b-8ad6-67052cf40ad5 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:50.243297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 569/1167] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:50.249237 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944e414-cec7-46fb-85bf-01e2a646450f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:50.249944 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944e414-cec7-46fb-85bf-01e2a646450f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:50.249944 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944e414-cec7-46fb-85bf-01e2a646450f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:50.267665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1944e414-cec7-46fb-85bf-01e2a646450f None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:50.268899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1944e414-cec7-46fb-85bf-01e2a646450f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:50.330177 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:50.335346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 599/1168] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:50.358883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f14c8c-6d95-4d4b-8ad6-67052cf40ad5 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:50.435780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:50.461421 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f14c8c-6d95-4d4b-8ad6-67052cf40ad5 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:50.495115 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74211bab-17f4-446d-b216-399c336609e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:50.495655 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74211bab-17f4-446d-b216-399c336609e2 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:50.495938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74211bab-17f4-446d-b216-399c336609e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:50.496240 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74211bab-17f4-446d-b216-399c336609e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:50.496967 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74211bab-17f4-446d-b216-399c336609e2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:50.498328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74211bab-17f4-446d-b216-399c336609e2 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:50.514391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 570/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Thu Aug 4 10:13:50 2022] POST /identity/v3/domains => generated 267 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:13:52.538404 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfece3-d732-46dc-9e6d-bee96a15ebd8 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:52.538976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfece3-d732-46dc-9e6d-bee96a15ebd8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:52.538976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfece3-d732-46dc-9e6d-bee96a15ebd8 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:52.540323 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 600/1170] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:52.545534 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e300dc1-a128-499c-b07a-e246ce9620bb None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:52.545943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e300dc1-a128-499c-b07a-e246ce9620bb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:52.546105 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e300dc1-a128-499c-b07a-e246ce9620bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:52.564665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7e300dc1-a128-499c-b07a-e246ce9620bb None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:52.565847 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7e300dc1-a128-499c-b07a-e246ce9620bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:52.631162 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 571/1171] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:52.654955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfece3-d732-46dc-9e6d-bee96a15ebd8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:52.757159 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfece3-d732-46dc-9e6d-bee96a15ebd8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:52.791185 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a4799-2ac2-4359-87ef-193364f17369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:52.791713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a4799-2ac2-4359-87ef-193364f17369 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:52.792000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a4799-2ac2-4359-87ef-193364f17369 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:52.792311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a4799-2ac2-4359-87ef-193364f17369 None admin] PATH_INFO: `/v3/domains/af2ee5b464fd46faa627018b52d348c8` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:52.803478 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a4799-2ac2-4359-87ef-193364f17369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=af2ee5b464fd46faa627018b52d348c8)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:52.804972 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a4799-2ac2-4359-87ef-193364f17369 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:52.806650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 601/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Thu Aug 4 10:13:52 2022] GET /identity/v3/domains/af2ee5b464fd46faa627018b52d348c8 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:52.813625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e300dc1-a128-499c-b07a-e246ce9620bb None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:52.873097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:52.912938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e300dc1-a128-499c-b07a-e246ce9620bb None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:52.946839 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29893e4-50a4-42b1-84e4-24999da2290e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:52.947461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29893e4-50a4-42b1-84e4-24999da2290e None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:52.947748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29893e4-50a4-42b1-84e4-24999da2290e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:52.948025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29893e4-50a4-42b1-84e4-24999da2290e None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:52.948750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29893e4-50a4-42b1-84e4-24999da2290e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:52.950179 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29893e4-50a4-42b1-84e4-24999da2290e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:52.975957 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 572/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Aug 4 10:13:52 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:13:55.027518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c688a-bb0f-48bc-9fcf-6887b28f3b96 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:55.028056 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c688a-bb0f-48bc-9fcf-6887b28f3b96 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:55.028056 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c688a-bb0f-48bc-9fcf-6887b28f3b96 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:55.029368 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 602/1174] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:55.035674 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f518e5-cfcf-4e9d-b19e-75d9cbe55178 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:55.036201 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f518e5-cfcf-4e9d-b19e-75d9cbe55178 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:55.036317 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f518e5-cfcf-4e9d-b19e-75d9cbe55178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:55.055846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-94f518e5-cfcf-4e9d-b19e-75d9cbe55178 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:55.057111 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-94f518e5-cfcf-4e9d-b19e-75d9cbe55178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:55.125098 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 573/1175] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:55.149080 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c688a-bb0f-48bc-9fcf-6887b28f3b96 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:55.210330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:55.252834 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c688a-bb0f-48bc-9fcf-6887b28f3b96 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:55.287685 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946f734-d0d4-4ba1-9270-791618d7d444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:55.288279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946f734-d0d4-4ba1-9270-791618d7d444 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:55.288565 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946f734-d0d4-4ba1-9270-791618d7d444 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:55.288842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946f734-d0d4-4ba1-9270-791618d7d444 None admin] PATH_INFO: `/v3/domains/af2ee5b464fd46faa627018b52d348c8` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:55.290018 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946f734-d0d4-4ba1-9270-791618d7d444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=af2ee5b464fd46faa627018b52d348c8)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:55.291460 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946f734-d0d4-4ba1-9270-791618d7d444 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:55.293096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 603/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Thu Aug 4 10:13:55 2022] GET /identity/v3/domains/af2ee5b464fd46faa627018b52d348c8 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:55.298926 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f518e5-cfcf-4e9d-b19e-75d9cbe55178 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:55.348034 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:55.411775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f518e5-cfcf-4e9d-b19e-75d9cbe55178 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:55.454689 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3e75f-ad02-49c0-a4d2-257d97c8aa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:55.455319 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3e75f-ad02-49c0-a4d2-257d97c8aa46 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:55.455602 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3e75f-ad02-49c0-a4d2-257d97c8aa46 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:55.455879 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3e75f-ad02-49c0-a4d2-257d97c8aa46 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:55.456610 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3e75f-ad02-49c0-a4d2-257d97c8aa46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:55.458044 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3e75f-ad02-49c0-a4d2-257d97c8aa46 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:55.482652 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 574/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Aug 4 10:13:55 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:13:57.556086 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d20002-52ba-446d-be9a-51f7517a80f6 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:57.556665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d20002-52ba-446d-be9a-51f7517a80f6 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:57.556665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d20002-52ba-446d-be9a-51f7517a80f6 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:57.558005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 604/1178] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:13:57.563392 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e4f69-e05e-49b7-bb4e-e8f6a8c44d6d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:57.563807 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e4f69-e05e-49b7-bb4e-e8f6a8c44d6d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:57.563957 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e4f69-e05e-49b7-bb4e-e8f6a8c44d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:57.582342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3b5e4f69-e05e-49b7-bb4e-e8f6a8c44d6d None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:13:57.583536 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3b5e4f69-e05e-49b7-bb4e-e8f6a8c44d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:13:57.650484 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 575/1179] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:13:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:13:57.674195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d20002-52ba-446d-be9a-51f7517a80f6 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:57.772946 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d20002-52ba-446d-be9a-51f7517a80f6 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:57.798694 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:57.806582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7626b-973e-4ced-91c1-62a4c8ae5fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:57.807188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7626b-973e-4ced-91c1-62a4c8ae5fed None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:57.807467 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7626b-973e-4ced-91c1-62a4c8ae5fed None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:57.807738 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7626b-973e-4ced-91c1-62a4c8ae5fed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:57.818412 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7626b-973e-4ced-91c1-62a4c8ae5fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:13:57.823232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-9da7626b-973e-4ced-91c1-62a4c8ae5fed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:13:57.823232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:13:57.823232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:13:57.823232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:13:57.823232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:13:57.823232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:13:57.823232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:13:57.823232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:13:57.823232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:13:57.823232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:13:57.823232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:13:57.823232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:13:57.823232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:13:57.823232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:13:57.823232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:13:57.823232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:13:57.824420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:13:57.824420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:13:57.824420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:13:57.824420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:13:57.824420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:13:57.824420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:13:57.824420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:13:57.824420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:13:57.824420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:13:57.824420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:13:57.824420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:13:57.824420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:13:57.824420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:13:57.824420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:13:57.824420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:13:57.824420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:13:57.825655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:13:57.825655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:13:57.825655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:13:57.825655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:13:57.825655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:13:57.825655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:13:57.825655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:13:57.825655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:13:57.825655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:13:57.825655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:13:57.825655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:13:57.825655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:13:57.825655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 605/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:13:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:13:57.831236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e4f69-e05e-49b7-bb4e-e8f6a8c44d6d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:57.861279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:57.934232 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e4f69-e05e-49b7-bb4e-e8f6a8c44d6d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:57.969327 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23aa49b-30d9-4beb-8a4f-acdcf528db65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:57.969945 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23aa49b-30d9-4beb-8a4f-acdcf528db65 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:57.970230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23aa49b-30d9-4beb-8a4f-acdcf528db65 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:57.970509 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23aa49b-30d9-4beb-8a4f-acdcf528db65 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:57.971222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23aa49b-30d9-4beb-8a4f-acdcf528db65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:57.971529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23aa49b-30d9-4beb-8a4f-acdcf528db65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:57.972922 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23aa49b-30d9-4beb-8a4f-acdcf528db65 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:57.980903 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 576/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:13:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:57.986880 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7626b-973e-4ced-91c1-62a4c8ae5fed None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:58.085832 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7626b-973e-4ced-91c1-62a4c8ae5fed None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:58.120188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e77ef3-731a-401d-85de-7a3e4d74cd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:58.120856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e77ef3-731a-401d-85de-7a3e4d74cd4c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:58.121139 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e77ef3-731a-401d-85de-7a3e4d74cd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:58.121418 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e77ef3-731a-401d-85de-7a3e4d74cd4c None admin] PATH_INFO: `/v3/users/73415992513f4f55bd1ee60cf514e6f4` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:58.134514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e77ef3-731a-401d-85de-7a3e4d74cd4c None admin] RBAC: Authorizing `identity:get_user(user_id=73415992513f4f55bd1ee60cf514e6f4)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:58.135981 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e77ef3-731a-401d-85de-7a3e4d74cd4c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:58.137671 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 606/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:13:57 2022] GET /identity/v3/users/73415992513f4f55bd1ee60cf514e6f4 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:58.143813 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23aa49b-30d9-4beb-8a4f-acdcf528db65 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:58.238118 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:58.245233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23aa49b-30d9-4beb-8a4f-acdcf528db65 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:58.278681 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0f1f0-4c50-40a7-b4f0-70968f2c0b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:58.279304 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0f1f0-4c50-40a7-b4f0-70968f2c0b5c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:58.279595 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0f1f0-4c50-40a7-b4f0-70968f2c0b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:58.280482 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0f1f0-4c50-40a7-b4f0-70968f2c0b5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:58.346546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0f1f0-4c50-40a7-b4f0-70968f2c0b5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:58.347915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0f1f0-4c50-40a7-b4f0-70968f2c0b5c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:58.436362 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:58.444359 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 577/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:13:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:13:58.450253 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e77ef3-731a-401d-85de-7a3e4d74cd4c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:58.495909 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:13:58.548150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e77ef3-731a-401d-85de-7a3e4d74cd4c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:58.582123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128703ec-c881-4a52-bbd1-c00cc3c7faf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:58.582758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128703ec-c881-4a52-bbd1-c00cc3c7faf3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:58.583029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128703ec-c881-4a52-bbd1-c00cc3c7faf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:58.583304 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128703ec-c881-4a52-bbd1-c00cc3c7faf3 None admin] PATH_INFO: `/v3/projects/32b496c8b45d454583470cc216cb9ddc` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:58.584462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128703ec-c881-4a52-bbd1-c00cc3c7faf3 None admin] RBAC: Authorizing `identity:get_project(project_id=32b496c8b45d454583470cc216cb9ddc)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:58.585892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128703ec-c881-4a52-bbd1-c00cc3c7faf3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:58.587543 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 607/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:13:58 2022] GET /identity/v3/projects/32b496c8b45d454583470cc216cb9ddc => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:13:58.593975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0f1f0-4c50-40a7-b4f0-70968f2c0b5c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:13:58.692687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0f1f0-4c50-40a7-b4f0-70968f2c0b5c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:13:58.726239 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844300e-5850-428e-82b4-48add270051f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:13:58.726854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844300e-5850-428e-82b4-48add270051f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:13:58.727141 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844300e-5850-428e-82b4-48add270051f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:13:58.727423 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844300e-5850-428e-82b4-48add270051f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:13:58.728243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844300e-5850-428e-82b4-48add270051f None admin] RBAC: Adding query filter params (role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.project.id=32b496c8b45d454583470cc216cb9ddc, user.id=73415992513f4f55bd1ee60cf514e6f4) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:13:58.728562 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844300e-5850-428e-82b4-48add270051f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:13:58.729993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844300e-5850-428e-82b4-48add270051f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:13:58.735855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 578/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:13:58 2022] GET /identity/v3/role_assignments?user.id=73415992513f4f55bd1ee60cf514e6f4&scope.project.id=32b496c8b45d454583470cc216cb9ddc&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:14:00.728399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee6188-456f-40a8-bad6-fa7c1e25ea92 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:14:00.728928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee6188-456f-40a8-bad6-fa7c1e25ea92 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:14:00.729038 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee6188-456f-40a8-bad6-fa7c1e25ea92 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:14:00.730298 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 608/1186] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:14:00.736091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576967c-0fbd-4112-917c-0260facffef9 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:14:00.736546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576967c-0fbd-4112-917c-0260facffef9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:14:00.736711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576967c-0fbd-4112-917c-0260facffef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:14:00.757779 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-5576967c-0fbd-4112-917c-0260facffef9 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:14:00.759455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5576967c-0fbd-4112-917c-0260facffef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:14:00.814681 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:14:00.828032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 579/1187] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:14:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:14:00.850550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee6188-456f-40a8-bad6-fa7c1e25ea92 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:14:00.948210 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee6188-456f-40a8-bad6-fa7c1e25ea92 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:14:00.961509 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:14:00.982112 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34385f12-600f-4ef0-ba20-b471a6589435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:14:00.983366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34385f12-600f-4ef0-ba20-b471a6589435 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:14:00.983649 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34385f12-600f-4ef0-ba20-b471a6589435 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:14:00.983928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34385f12-600f-4ef0-ba20-b471a6589435 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:14:00.993759 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34385f12-600f-4ef0-ba20-b471a6589435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:14:00.998626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-34385f12-600f-4ef0-ba20-b471a6589435 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:14:00.998626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:14:00.998626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:14:00.998626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:14:00.998626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:14:00.998626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:14:00.998626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:14:00.998626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:14:00.998626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:14:00.998626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:14:00.998626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:14:00.998626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:14:00.998626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:14:00.998626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:14:00.998626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:14:00.998626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:14:00.999794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:14:00.999794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:14:00.999794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:14:00.999794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:14:00.999794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:14:00.999794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:14:00.999794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:14:00.999794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:14:00.999794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:14:00.999794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:14:00.999794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:14:00.999794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:14:00.999794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:14:00.999794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:14:00.999794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:14:00.999794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:14:01.000707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:14:01.000707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:14:01.000707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:14:01.000707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:14:01.000707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:14:01.000707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:14:01.000707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:14:01.000707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:14:01.000707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:14:01.000707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:14:01.000707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:14:01.000707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:14:01.000707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 609/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:14:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:14:01.005754 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576967c-0fbd-4112-917c-0260facffef9 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:14:01.104139 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576967c-0fbd-4112-917c-0260facffef9 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:14:01.141738 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb275cda-f87d-479e-9b57-41f5246f36e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:14:01.142364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb275cda-f87d-479e-9b57-41f5246f36e2 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:14:01.142657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb275cda-f87d-479e-9b57-41f5246f36e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:14:01.142936 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb275cda-f87d-479e-9b57-41f5246f36e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:14:01.143654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb275cda-f87d-479e-9b57-41f5246f36e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:14:01.143963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb275cda-f87d-479e-9b57-41f5246f36e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:14:01.145370 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb275cda-f87d-479e-9b57-41f5246f36e2 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:14:01.153400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 580/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:14:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:14:01.160301 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34385f12-600f-4ef0-ba20-b471a6589435 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:14:01.258893 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34385f12-600f-4ef0-ba20-b471a6589435 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:14:01.292713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decee78-be96-4816-a119-d7863eccf526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:14:01.293360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decee78-be96-4816-a119-d7863eccf526 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:14:01.293644 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decee78-be96-4816-a119-d7863eccf526 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:14:01.293921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decee78-be96-4816-a119-d7863eccf526 None admin] PATH_INFO: `/v3/users/73415992513f4f55bd1ee60cf514e6f4` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:14:01.295076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decee78-be96-4816-a119-d7863eccf526 None admin] RBAC: Authorizing `identity:get_user(user_id=73415992513f4f55bd1ee60cf514e6f4)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:14:01.296601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decee78-be96-4816-a119-d7863eccf526 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:14:01.298228 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 610/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:14:01 2022] GET /identity/v3/users/73415992513f4f55bd1ee60cf514e6f4 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:14:01.304315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb275cda-f87d-479e-9b57-41f5246f36e2 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:14:01.356991 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:14:01.409837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb275cda-f87d-479e-9b57-41f5246f36e2 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:14:01.444826 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00755a-a402-440d-b9ad-63aa96c0ac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:14:01.445472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00755a-a402-440d-b9ad-63aa96c0ac0f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:14:01.445758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00755a-a402-440d-b9ad-63aa96c0ac0f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:14:01.446036 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00755a-a402-440d-b9ad-63aa96c0ac0f None admin] PATH_INFO: `/v3/projects/32b496c8b45d454583470cc216cb9ddc` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:14:01.447193 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00755a-a402-440d-b9ad-63aa96c0ac0f None admin] RBAC: Authorizing `identity:get_project(project_id=32b496c8b45d454583470cc216cb9ddc)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:14:01.448656 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00755a-a402-440d-b9ad-63aa96c0ac0f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:14:01.450340 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 581/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:14:01 2022] GET /identity/v3/projects/32b496c8b45d454583470cc216cb9ddc => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:14:01.457210 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decee78-be96-4816-a119-d7863eccf526 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:14:01.500886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:14:01.557651 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decee78-be96-4816-a119-d7863eccf526 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:14:01.591550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af0153-2585-490c-ad5d-e8423ca7f7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:14:01.592279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af0153-2585-490c-ad5d-e8423ca7f7fe None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:14:01.592567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af0153-2585-490c-ad5d-e8423ca7f7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:14:01.592845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af0153-2585-490c-ad5d-e8423ca7f7fe None admin] PATH_INFO: `/v3/projects/32b496c8b45d454583470cc216cb9ddc/users/73415992513f4f55bd1ee60cf514e6f4/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:14:01.594780 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af0153-2585-490c-ad5d-e8423ca7f7fe None admin] RBAC: Authorizing `identity:create_grant(project_id=32b496c8b45d454583470cc216cb9ddc, user_id=73415992513f4f55bd1ee60cf514e6f4, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:14:01.596252 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af0153-2585-490c-ad5d-e8423ca7f7fe None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:14:01.609577 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 611/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:14:01 2022] PUT /identity/v3/projects/32b496c8b45d454583470cc216cb9ddc/users/73415992513f4f55bd1ee60cf514e6f4/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:14:03.664485 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58136f41-d5ef-4bb7-9e24-0ebdfebe7f58 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:14:03.664991 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58136f41-d5ef-4bb7-9e24-0ebdfebe7f58 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:14:03.665097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58136f41-d5ef-4bb7-9e24-0ebdfebe7f58 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:14:03.666401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 582/1193] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:14:03.672476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d643c1f-5468-456d-a056-41166a29c490 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:14:03.672907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d643c1f-5468-456d-a056-41166a29c490 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:14:03.673006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d643c1f-5468-456d-a056-41166a29c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:14:03.692419 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5d643c1f-5468-456d-a056-41166a29c490 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:14:03.693645 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5d643c1f-5468-456d-a056-41166a29c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:14:03.761198 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 612/1194] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:14:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:14:03.785461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58136f41-d5ef-4bb7-9e24-0ebdfebe7f58 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:14:03.890906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58136f41-d5ef-4bb7-9e24-0ebdfebe7f58 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:14:03.908256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:14:03.925217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea7ac1-e0ee-47ab-9dd4-136fb51ba31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:14:03.925863 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea7ac1-e0ee-47ab-9dd4-136fb51ba31b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:14:03.926149 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea7ac1-e0ee-47ab-9dd4-136fb51ba31b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:14:03.926429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea7ac1-e0ee-47ab-9dd4-136fb51ba31b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:14:03.937090 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea7ac1-e0ee-47ab-9dd4-136fb51ba31b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:14:03.942161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-8fea7ac1-e0ee-47ab-9dd4-136fb51ba31b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:14:03.942161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:14:03.942161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:14:03.942161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:14:03.942161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:14:03.942161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:14:03.942161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:14:03.942161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:14:03.942161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:14:03.942161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:14:03.942161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:14:03.942161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:14:03.942161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:14:03.942161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:14:03.942161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:14:03.942161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:14:03.943086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:14:03.943086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:14:03.943086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:14:03.943086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:14:03.943086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:14:03.943086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:14:03.943086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:14:03.943086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:14:03.943086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:14:03.943086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:14:03.943086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:14:03.943086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:14:03.943086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:14:03.943086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:14:03.943086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:14:03.943086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:14:03.943942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:14:03.943942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:14:03.943942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:14:03.943942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:14:03.943942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:14:03.943942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:14:03.943942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:14:03.943942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:14:03.943942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:14:03.943942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:14:03.943942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:14:03.943942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:14:03.943942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 583/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:14:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:14:03.949408 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d643c1f-5468-456d-a056-41166a29c490 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:14:03.980018 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:14:04.048182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d643c1f-5468-456d-a056-41166a29c490 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:14:04.080561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b785f-b99c-4bcb-a8b7-8468a72fcd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:14:04.081173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b785f-b99c-4bcb-a8b7-8468a72fcd85 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:14:04.081458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b785f-b99c-4bcb-a8b7-8468a72fcd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:14:04.081737 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b785f-b99c-4bcb-a8b7-8468a72fcd85 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:14:04.082446 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b785f-b99c-4bcb-a8b7-8468a72fcd85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:14:04.082754 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b785f-b99c-4bcb-a8b7-8468a72fcd85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:14:04.084137 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b785f-b99c-4bcb-a8b7-8468a72fcd85 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:14:04.091912 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 613/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:14:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:14:04.098270 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea7ac1-e0ee-47ab-9dd4-136fb51ba31b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:14:04.194889 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea7ac1-e0ee-47ab-9dd4-136fb51ba31b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:14:04.227899 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355418f-ad39-476b-8245-52edc594ba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:14:04.228562 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355418f-ad39-476b-8245-52edc594ba3f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:14:04.228846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355418f-ad39-476b-8245-52edc594ba3f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:14:04.229121 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355418f-ad39-476b-8245-52edc594ba3f None admin] PATH_INFO: `/v3/users/73415992513f4f55bd1ee60cf514e6f4` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:14:04.230278 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355418f-ad39-476b-8245-52edc594ba3f None admin] RBAC: Authorizing `identity:get_user(user_id=73415992513f4f55bd1ee60cf514e6f4)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:14:04.231702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355418f-ad39-476b-8245-52edc594ba3f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:14:04.233374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 584/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Aug 4 10:14:04 2022] GET /identity/v3/users/73415992513f4f55bd1ee60cf514e6f4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:14:04.239126 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b785f-b99c-4bcb-a8b7-8468a72fcd85 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:14:04.331757 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:14:04.338660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b785f-b99c-4bcb-a8b7-8468a72fcd85 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:14:04.371323 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f69479-79d0-4d01-aa5f-ea346f83cf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:14:04.371937 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f69479-79d0-4d01-aa5f-ea346f83cf36 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:14:04.372251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f69479-79d0-4d01-aa5f-ea346f83cf36 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:14:04.372535 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f69479-79d0-4d01-aa5f-ea346f83cf36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:14:04.439447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f69479-79d0-4d01-aa5f-ea346f83cf36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:14:04.440931 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f69479-79d0-4d01-aa5f-ea346f83cf36 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:14:04.533715 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:14:04.541766 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 614/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:14:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:14:04.547574 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355418f-ad39-476b-8245-52edc594ba3f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:14:04.594625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:14:04.648155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355418f-ad39-476b-8245-52edc594ba3f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:14:04.682893 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac20d77-bb74-493c-8240-8fcc12a7a955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:14:04.683582 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac20d77-bb74-493c-8240-8fcc12a7a955 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:14:04.683819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac20d77-bb74-493c-8240-8fcc12a7a955 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:14:04.684097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac20d77-bb74-493c-8240-8fcc12a7a955 None admin] PATH_INFO: `/v3/projects/32b496c8b45d454583470cc216cb9ddc` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:14:04.685304 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac20d77-bb74-493c-8240-8fcc12a7a955 None admin] RBAC: Authorizing `identity:get_project(project_id=32b496c8b45d454583470cc216cb9ddc)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:14:04.687126 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac20d77-bb74-493c-8240-8fcc12a7a955 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:14:04.688862 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 585/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Aug 4 10:14:04 2022] GET /identity/v3/projects/32b496c8b45d454583470cc216cb9ddc => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:14:04.695032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f69479-79d0-4d01-aa5f-ea346f83cf36 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:14:04.792944 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f69479-79d0-4d01-aa5f-ea346f83cf36 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:14:04.826107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12580e42-73e0-4854-80cf-b44072c13aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:14:04.826804 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12580e42-73e0-4854-80cf-b44072c13aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:14:04.827087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12580e42-73e0-4854-80cf-b44072c13aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:14:04.827364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12580e42-73e0-4854-80cf-b44072c13aa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:14:04.828145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12580e42-73e0-4854-80cf-b44072c13aa5 None admin] RBAC: Adding query filter params (role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.project.id=32b496c8b45d454583470cc216cb9ddc, user.id=73415992513f4f55bd1ee60cf514e6f4) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:14:04.828496 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12580e42-73e0-4854-80cf-b44072c13aa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:14:04.829918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12580e42-73e0-4854-80cf-b44072c13aa5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:14:04.835514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 615/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:14:04 2022] GET /identity/v3/role_assignments?user.id=73415992513f4f55bd1ee60cf514e6f4&scope.project.id=32b496c8b45d454583470cc216cb9ddc&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:14:14.679007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=43 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:14:14.833565 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=71 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:00.961499 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d4e41-0f06-4116-8393-88a5ba9ee1f7 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:00.962208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d4e41-0f06-4116-8393-88a5ba9ee1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:00.962208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d4e41-0f06-4116-8393-88a5ba9ee1f7 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:00.963325 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 586/1201] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:15:00.970062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c36bf3-2ddf-4c2c-a6bf-28f5ff7e3069 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:00.970556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c36bf3-2ddf-4c2c-a6bf-28f5ff7e3069 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:00.970683 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c36bf3-2ddf-4c2c-a6bf-28f5ff7e3069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:00.997285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-91c36bf3-2ddf-4c2c-a6bf-28f5ff7e3069 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:15:00.998529 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-91c36bf3-2ddf-4c2c-a6bf-28f5ff7e3069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:15:01.090901 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 616/1202] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:15:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:15:01.117914 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d4e41-0f06-4116-8393-88a5ba9ee1f7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:01.268512 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d4e41-0f06-4116-8393-88a5ba9ee1f7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:01.320537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a15fc3-2a99-4ab0-b65f-cc117f16492a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:01.321340 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a15fc3-2a99-4ab0-b65f-cc117f16492a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:01.321759 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a15fc3-2a99-4ab0-b65f-cc117f16492a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:01.322201 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a15fc3-2a99-4ab0-b65f-cc117f16492a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:01.342213 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a15fc3-2a99-4ab0-b65f-cc117f16492a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:01.345376 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a15fc3-2a99-4ab0-b65f-cc117f16492a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:01.366566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-f0a15fc3-2a99-4ab0-b65f-cc117f16492a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:01.366566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:01.366566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:01.366566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:01.366566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:01.366566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:01.366566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:01.366566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:01.366566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:01.366566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:01.366566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:01.366566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:01.366566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:15:01.366566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:15:01.366566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:15:01.368993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:15:01.368993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:01.368993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:01.368993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:01.368993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:01.368993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:01.368993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:01.368993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:01.368993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:01.368993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:01.368993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:01.368993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:01.368993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:01.368993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:01.368993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:01.368993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:01.368993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:01.371054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:15:01.371054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:15:01.371054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:01.371054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:15:01.371054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 587/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:01.381508 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c36bf3-2ddf-4c2c-a6bf-28f5ff7e3069 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:01.557822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c36bf3-2ddf-4c2c-a6bf-28f5ff7e3069 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:01.597523 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:01.608957 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db9250-8401-4793-9947-faf5663747ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:01.610676 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db9250-8401-4793-9947-faf5663747ae None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:01.611167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db9250-8401-4793-9947-faf5663747ae None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:01.611660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db9250-8401-4793-9947-faf5663747ae None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:01.613011 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db9250-8401-4793-9947-faf5663747ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:01.613511 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db9250-8401-4793-9947-faf5663747ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:01.616070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db9250-8401-4793-9947-faf5663747ae None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:01.646620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 617/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:01.652038 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a15fc3-2a99-4ab0-b65f-cc117f16492a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:01.724205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:01.786539 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a15fc3-2a99-4ab0-b65f-cc117f16492a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:01.829462 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e40ad7-6311-4a4a-a80a-af295379f75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:01.830541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e40ad7-6311-4a4a-a80a-af295379f75d None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:01.830916 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e40ad7-6311-4a4a-a80a-af295379f75d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:01.831316 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e40ad7-6311-4a4a-a80a-af295379f75d None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:01.832310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e40ad7-6311-4a4a-a80a-af295379f75d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:01.834242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e40ad7-6311-4a4a-a80a-af295379f75d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:01.865605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 588/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Aug 4 10:15:01 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:15:04.233895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb1b9b-02a4-4a97-9166-9cfb129edd85 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:04.235042 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb1b9b-02a4-4a97-9166-9cfb129edd85 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:04.235178 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb1b9b-02a4-4a97-9166-9cfb129edd85 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:04.240242 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 618/1206] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:15:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:15:04.242672 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d27f60-e2e2-4099-95a7-7e8c0590b683 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:04.243166 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d27f60-e2e2-4099-95a7-7e8c0590b683 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:04.243298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d27f60-e2e2-4099-95a7-7e8c0590b683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:04.266461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b0d27f60-e2e2-4099-95a7-7e8c0590b683 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:15:04.267704 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b0d27f60-e2e2-4099-95a7-7e8c0590b683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:15:04.359213 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 589/1207] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:15:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:15:04.385872 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb1b9b-02a4-4a97-9166-9cfb129edd85 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:04.502750 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb1b9b-02a4-4a97-9166-9cfb129edd85 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:04.546228 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8750449-ebb6-46c3-9211-605ad67f0259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:04.546898 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8750449-ebb6-46c3-9211-605ad67f0259 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:04.547189 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8750449-ebb6-46c3-9211-605ad67f0259 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:04.547486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8750449-ebb6-46c3-9211-605ad67f0259 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:04.559991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8750449-ebb6-46c3-9211-605ad67f0259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:15:04.566448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-e8750449-ebb6-46c3-9211-605ad67f0259 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:15:04.566448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:04.566448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:04.566448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:04.566448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:04.566448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:04.566448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:04.566448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:04.566448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:04.566448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:04.566448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:04.566448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:04.566448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:15:04.566448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:15:04.566448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:15:04.566448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:15:04.567475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:15:04.567475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:15:04.567475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:15:04.567475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:15:04.567475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:04.567475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:04.567475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:04.567475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:04.567475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:04.567475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:04.567475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:04.567475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:04.567475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:04.567475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:04.567475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:04.567475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:04.568785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:04.568785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:04.568785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:04.568785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:04.568785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:15:04.568785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:15:04.568785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:15:04.568785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:15:04.568785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:15:04.568785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:15:04.568785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:15:04.568785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:04.568785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 619/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:15:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:04.573510 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d27f60-e2e2-4099-95a7-7e8c0590b683 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:04.622521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:04.694781 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d27f60-e2e2-4099-95a7-7e8c0590b683 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:04.742727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd7b13-e89e-4d0d-a22d-d7146a8ba72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:04.743507 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd7b13-e89e-4d0d-a22d-d7146a8ba72d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:04.743976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd7b13-e89e-4d0d-a22d-d7146a8ba72d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:04.744456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd7b13-e89e-4d0d-a22d-d7146a8ba72d None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:04.745435 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd7b13-e89e-4d0d-a22d-d7146a8ba72d None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:04.745825 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd7b13-e89e-4d0d-a22d-d7146a8ba72d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:04.748380 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd7b13-e89e-4d0d-a22d-d7146a8ba72d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:04.760851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 590/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:15:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:04.766942 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8750449-ebb6-46c3-9211-605ad67f0259 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:04.829858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:04.891956 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8750449-ebb6-46c3-9211-605ad67f0259 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:04.939039 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d86ae5-92f5-4e38-b8b4-209fe2451438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:04.940126 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d86ae5-92f5-4e38-b8b4-209fe2451438 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:04.940577 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d86ae5-92f5-4e38-b8b4-209fe2451438 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:04.941223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d86ae5-92f5-4e38-b8b4-209fe2451438 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:04.957916 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d86ae5-92f5-4e38-b8b4-209fe2451438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:04.960055 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d86ae5-92f5-4e38-b8b4-209fe2451438 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:04.979204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-e9d86ae5-92f5-4e38-b8b4-209fe2451438 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:04.979204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:04.979204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:04.979204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:04.979204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:04.979204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:04.979204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:04.979204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:04.979204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:04.979204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:04.979204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:04.979204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:04.979204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:15:04.979204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:15:04.979204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:15:04.981236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:15:04.981236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:04.981236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:04.981236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:04.981236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:04.981236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:04.981236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:04.981236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:04.981236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:04.981236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:04.981236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:04.981236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:04.981236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:04.981236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:04.981236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:04.981236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:04.981236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:04.982400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:15:04.982400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:15:04.982400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:04.982400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:04.982400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 620/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:04.988036 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd7b13-e89e-4d0d-a22d-d7146a8ba72d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:05.130343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:05.135384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd7b13-e89e-4d0d-a22d-d7146a8ba72d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:05.182591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c684eb6-898e-4685-b7e7-ac08afe89f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:05.183789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c684eb6-898e-4685-b7e7-ac08afe89f93 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:05.184415 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c684eb6-898e-4685-b7e7-ac08afe89f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:05.184701 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c684eb6-898e-4685-b7e7-ac08afe89f93 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:05.185538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c684eb6-898e-4685-b7e7-ac08afe89f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:05.185848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c684eb6-898e-4685-b7e7-ac08afe89f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:05.187420 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c684eb6-898e-4685-b7e7-ac08afe89f93 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:05.203474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 591/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:05.210525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d86ae5-92f5-4e38-b8b4-209fe2451438 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:05.338601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d86ae5-92f5-4e38-b8b4-209fe2451438 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:05.339725 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:05.381109 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb41d1f-be46-4a0c-bfd9-af40ec1593fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:05.381864 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb41d1f-be46-4a0c-bfd9-af40ec1593fc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:05.382289 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb41d1f-be46-4a0c-bfd9-af40ec1593fc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:05.382532 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb41d1f-be46-4a0c-bfd9-af40ec1593fc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:05.393486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb41d1f-be46-4a0c-bfd9-af40ec1593fc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:05.395258 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb41d1f-be46-4a0c-bfd9-af40ec1593fc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:05.408960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-fcb41d1f-be46-4a0c-bfd9-af40ec1593fc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 10:15:05.408960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:05.408960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:05.408960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:05.408960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:05.408960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:05.408960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:05.408960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:05.408960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:05.408960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:05.408960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:05.408960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:05.408960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:15:05.408960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:15:05.408960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:15:05.408960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:15:05.410346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:05.410346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:05.410346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:15:05.410346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:15:05.410346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:15:05.410346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:15:05.410346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:05.410346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:05.410346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:05.410346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:05.410346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:05.410346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:05.410346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:05.410346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:05.410346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:05.410346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:05.410346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:05.410346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:05.411372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:05.411372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:05.411372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:15:05.411372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:15:05.411372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:15:05.411372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:15:05.411372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:15:05.411372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:15:05.411372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 10:15:05.411372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:05.411372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 621/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:05.416433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c684eb6-898e-4685-b7e7-ac08afe89f93 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:05.542971 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c684eb6-898e-4685-b7e7-ac08afe89f93 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:05.587111 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89f9d8-7595-4036-b57b-02e1297b19e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:05.588394 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89f9d8-7595-4036-b57b-02e1297b19e2 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:05.588605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89f9d8-7595-4036-b57b-02e1297b19e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:05.588893 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89f9d8-7595-4036-b57b-02e1297b19e2 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:05.589853 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89f9d8-7595-4036-b57b-02e1297b19e2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:05.590195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89f9d8-7595-4036-b57b-02e1297b19e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:05.591768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89f9d8-7595-4036-b57b-02e1297b19e2 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:05.620612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 592/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Aug 4 10:15:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:05.620824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb41d1f-be46-4a0c-bfd9-af40ec1593fc None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:05.750883 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb41d1f-be46-4a0c-bfd9-af40ec1593fc None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:05.795974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a5b8a-2ef9-4239-a52b-639112ad9231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:05.796688 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a5b8a-2ef9-4239-a52b-639112ad9231 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:05.798064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a5b8a-2ef9-4239-a52b-639112ad9231 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:05.798064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a5b8a-2ef9-4239-a52b-639112ad9231 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:05.832445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:05.876563 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a5b8a-2ef9-4239-a52b-639112ad9231 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:05.878045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a5b8a-2ef9-4239-a52b-639112ad9231 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:06.006323 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 622/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:15:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:15:06.012076 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89f9d8-7595-4036-b57b-02e1297b19e2 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:06.037847 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:06.137489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89f9d8-7595-4036-b57b-02e1297b19e2 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:06.176458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d7109-a50a-4f63-81e1-b76fdfa430b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:06.177380 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d7109-a50a-4f63-81e1-b76fdfa430b9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:06.177655 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d7109-a50a-4f63-81e1-b76fdfa430b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:06.177929 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d7109-a50a-4f63-81e1-b76fdfa430b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:06.193051 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d7109-a50a-4f63-81e1-b76fdfa430b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:06.194999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d7109-a50a-4f63-81e1-b76fdfa430b9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:06.214204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-f40d7109-a50a-4f63-81e1-b76fdfa430b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:06.214204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:06.214204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:06.214204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:06.214204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:06.214204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:06.214204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:06.214204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:06.214204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:06.214204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:06.214204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:06.214204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:06.214204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:15:06.214204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:15:06.214204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:15:06.215202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:15:06.215202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:06.215202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:06.215202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:06.215202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:06.215202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:06.215202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:06.215202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:06.215202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:06.215202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:06.215202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:06.215202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:06.215202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:06.215202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:06.215202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:06.215202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:06.215202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:06.216129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:15:06.216129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:15:06.216129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:06.216129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:15:06.216129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 593/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:06.222519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a5b8a-2ef9-4239-a52b-639112ad9231 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:06.314308 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:06.367332 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a5b8a-2ef9-4239-a52b-639112ad9231 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:06.408589 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15520dab-5343-4685-a6a6-8b71f0328fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:06.409369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15520dab-5343-4685-a6a6-8b71f0328fab None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:06.409801 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15520dab-5343-4685-a6a6-8b71f0328fab None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:06.410211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15520dab-5343-4685-a6a6-8b71f0328fab None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:06.410961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15520dab-5343-4685-a6a6-8b71f0328fab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:06.411313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15520dab-5343-4685-a6a6-8b71f0328fab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:06.412839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15520dab-5343-4685-a6a6-8b71f0328fab None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:06.427370 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 623/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:15:06.432858 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d7109-a50a-4f63-81e1-b76fdfa430b9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:06.514388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:06.556576 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d7109-a50a-4f63-81e1-b76fdfa430b9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:06.606869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b961707-9786-4e3b-b4ba-3b4e5054f37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:06.607447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b961707-9786-4e3b-b4ba-3b4e5054f37f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:06.607705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b961707-9786-4e3b-b4ba-3b4e5054f37f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:06.608008 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b961707-9786-4e3b-b4ba-3b4e5054f37f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:06.616191 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b961707-9786-4e3b-b4ba-3b4e5054f37f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:06.619943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b961707-9786-4e3b-b4ba-3b4e5054f37f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:06.633937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-1b961707-9786-4e3b-b4ba-3b4e5054f37f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:15:06.633937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:06.633937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:06.633937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:06.633937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:06.633937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:06.633937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:06.633937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:06.633937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:06.633937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:06.633937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:06.633937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:06.633937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:15:06.633937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:15:06.633937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:15:06.634949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:15:06.634949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:06.634949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:06.634949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:06.634949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:06.634949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:06.634949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:06.634949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:06.634949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:06.634949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:06.634949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:06.634949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:06.634949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:06.634949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:06.634949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:06.634949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:06.634949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:06.635976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:15:06.635976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:15:06.635976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:15:06.635976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:15:06.635976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:15:06.635976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:15:06.635976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:15:06.635976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:15:06.635976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 594/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:15:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:06.643225 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15520dab-5343-4685-a6a6-8b71f0328fab None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:06.756334 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15520dab-5343-4685-a6a6-8b71f0328fab None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:06.781640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:06.795432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b36033-28d8-4202-93f7-4254d11c3b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:06.796127 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b36033-28d8-4202-93f7-4254d11c3b89 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:06.796456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b36033-28d8-4202-93f7-4254d11c3b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:06.796736 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b36033-28d8-4202-93f7-4254d11c3b89 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:06.798041 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b36033-28d8-4202-93f7-4254d11c3b89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:06.798401 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b36033-28d8-4202-93f7-4254d11c3b89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:06.799871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b36033-28d8-4202-93f7-4254d11c3b89 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:06.819772 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 624/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:15:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:06.821527 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b961707-9786-4e3b-b4ba-3b4e5054f37f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:06.944227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b961707-9786-4e3b-b4ba-3b4e5054f37f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:06.979575 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:06.989448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26a92e-18c3-464b-9786-67e037c9e076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:06.990365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a92e-18c3-464b-9786-67e037c9e076 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:06.990845 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a92e-18c3-464b-9786-67e037c9e076 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:06.991307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a92e-18c3-464b-9786-67e037c9e076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:06.992396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26a92e-18c3-464b-9786-67e037c9e076 None admin] RBAC: Adding query filter params (role.id=88ed5b6546c64ac09d03064e12ca7f10, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=0005b0c9582e430e9cb85704a4505bb0) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:06.992910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26a92e-18c3-464b-9786-67e037c9e076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:06.994545 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26a92e-18c3-464b-9786-67e037c9e076 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:07.001862 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 595/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:15:06 2022] GET /identity/v3/role_assignments?user.id=0005b0c9582e430e9cb85704a4505bb0&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=88ed5b6546c64ac09d03064e12ca7f10 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:09.154808 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86320406-c857-4901-a9b3-f40cef8ca166 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:09.155400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86320406-c857-4901-a9b3-f40cef8ca166 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:09.155400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86320406-c857-4901-a9b3-f40cef8ca166 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:09.157568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 625/1220] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:15:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:15:09.162710 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c67de-8859-44b2-8eb6-c50bcdc16c17 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:09.163141 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c67de-8859-44b2-8eb6-c50bcdc16c17 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:09.163258 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c67de-8859-44b2-8eb6-c50bcdc16c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:09.182645 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-979c67de-8859-44b2-8eb6-c50bcdc16c17 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:15:09.183850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-979c67de-8859-44b2-8eb6-c50bcdc16c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:15:09.262233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 596/1221] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:15:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:15:09.290921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86320406-c857-4901-a9b3-f40cef8ca166 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:09.419267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86320406-c857-4901-a9b3-f40cef8ca166 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:09.458837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc038a1-16d7-48ed-97fc-9d92ff156b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:09.459489 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc038a1-16d7-48ed-97fc-9d92ff156b64 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:09.459771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc038a1-16d7-48ed-97fc-9d92ff156b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:09.460045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc038a1-16d7-48ed-97fc-9d92ff156b64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:09.473270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc038a1-16d7-48ed-97fc-9d92ff156b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:15:09.478658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-2fc038a1-16d7-48ed-97fc-9d92ff156b64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:15:09.478658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:09.478658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:09.478658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:09.478658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:09.478658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:09.478658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:09.478658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:09.478658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:09.478658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:09.478658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:09.478658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:09.478658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:15:09.478658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:15:09.478658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:15:09.478658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:15:09.479833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:15:09.479833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:15:09.479833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:15:09.479833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:15:09.479833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:09.479833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:09.479833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:09.479833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:09.479833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:09.479833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:09.479833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:09.479833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:09.479833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:09.479833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:09.479833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:09.479833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:09.480948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:09.480948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:09.480948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:09.480948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:09.480948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:15:09.480948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:15:09.480948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:15:09.480948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:15:09.480948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:15:09.480948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:15:09.480948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:15:09.480948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:09.480948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 626/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:15:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:09.488955 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c67de-8859-44b2-8eb6-c50bcdc16c17 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:09.626843 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c67de-8859-44b2-8eb6-c50bcdc16c17 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:09.666385 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:09.682615 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c03ca9-d9ee-464b-a03f-4fdbb56b053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:09.683394 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c03ca9-d9ee-464b-a03f-4fdbb56b053c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:09.683812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c03ca9-d9ee-464b-a03f-4fdbb56b053c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:09.684262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c03ca9-d9ee-464b-a03f-4fdbb56b053c None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:09.685125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c03ca9-d9ee-464b-a03f-4fdbb56b053c None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:09.685568 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c03ca9-d9ee-464b-a03f-4fdbb56b053c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:09.687090 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c03ca9-d9ee-464b-a03f-4fdbb56b053c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:09.696030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 597/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:15:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:09.701970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc038a1-16d7-48ed-97fc-9d92ff156b64 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:09.752932 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:09.817164 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc038a1-16d7-48ed-97fc-9d92ff156b64 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:09.854751 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477df83c-94f7-4766-9b4b-d7ea497fdcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:09.855461 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477df83c-94f7-4766-9b4b-d7ea497fdcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:09.855750 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477df83c-94f7-4766-9b4b-d7ea497fdcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:09.856027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477df83c-94f7-4766-9b4b-d7ea497fdcf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:09.866688 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477df83c-94f7-4766-9b4b-d7ea497fdcf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:09.868328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477df83c-94f7-4766-9b4b-d7ea497fdcf3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:09.883756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-477df83c-94f7-4766-9b4b-d7ea497fdcf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:09.883756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:09.883756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:09.883756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:09.883756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:09.883756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:09.883756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:09.883756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:09.883756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:09.883756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:09.883756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:09.883756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:09.883756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:15:09.883756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:15:09.883756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:15:09.885005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:15:09.885005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:09.885005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:09.885005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:09.885005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:09.885005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:09.885005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:09.885005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:09.885005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:09.885005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:09.885005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:09.885005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:09.885005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:09.885005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:09.885005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:09.885005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:09.885005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:09.886144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:15:09.886144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:15:09.886144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:09.886144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:09.886144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 627/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:09.891439 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c03ca9-d9ee-464b-a03f-4fdbb56b053c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:10.003074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c03ca9-d9ee-464b-a03f-4fdbb56b053c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:10.039004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34182da-a8bf-4ce0-8fa0-10452b5c9989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:10.039684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34182da-a8bf-4ce0-8fa0-10452b5c9989 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:10.040116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34182da-a8bf-4ce0-8fa0-10452b5c9989 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:10.040427 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34182da-a8bf-4ce0-8fa0-10452b5c9989 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:10.041328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34182da-a8bf-4ce0-8fa0-10452b5c9989 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:10.041848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34182da-a8bf-4ce0-8fa0-10452b5c9989 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:10.043599 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34182da-a8bf-4ce0-8fa0-10452b5c9989 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:10.060874 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 598/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:10.067550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477df83c-94f7-4766-9b4b-d7ea497fdcf3 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:10.184959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:10.193479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477df83c-94f7-4766-9b4b-d7ea497fdcf3 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:10.231871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04354827-9a4f-4169-80e8-4e59017b7bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:10.232649 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04354827-9a4f-4169-80e8-4e59017b7bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:10.232963 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04354827-9a4f-4169-80e8-4e59017b7bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:10.233295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04354827-9a4f-4169-80e8-4e59017b7bb0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:10.242929 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04354827-9a4f-4169-80e8-4e59017b7bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:10.244561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04354827-9a4f-4169-80e8-4e59017b7bb0 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:10.258339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-04354827-9a4f-4169-80e8-4e59017b7bb0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 10:15:10.258339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:10.258339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:10.258339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:10.258339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:10.258339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:10.258339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:10.258339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:10.258339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:10.258339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:10.258339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:10.258339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:10.258339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:15:10.258339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:15:10.258339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:15:10.258339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:15:10.259637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:10.259637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:10.259637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:15:10.259637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:15:10.259637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:15:10.259637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:15:10.259637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:10.259637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:10.259637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:10.259637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:10.259637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:10.259637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:10.259637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:10.259637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:10.259637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:10.259637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:10.259637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:10.259637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:10.260786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:10.260786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:10.260786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:15:10.260786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:15:10.260786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:15:10.260786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:15:10.260786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:15:10.260786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:15:10.260786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 10:15:10.260786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:10.260786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 628/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:10.266678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34182da-a8bf-4ce0-8fa0-10452b5c9989 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:10.316651 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:10.376546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34182da-a8bf-4ce0-8fa0-10452b5c9989 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:10.412859 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c707a-3dd3-48cb-b79f-772629a0a3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:10.413482 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c707a-3dd3-48cb-b79f-772629a0a3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:10.413761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c707a-3dd3-48cb-b79f-772629a0a3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:10.414039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c707a-3dd3-48cb-b79f-772629a0a3d4 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:10.414836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c707a-3dd3-48cb-b79f-772629a0a3d4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:10.415137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c707a-3dd3-48cb-b79f-772629a0a3d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:10.416745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c707a-3dd3-48cb-b79f-772629a0a3d4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:10.435329 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 599/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Aug 4 10:15:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:10.443252 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04354827-9a4f-4169-80e8-4e59017b7bb0 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:10.559760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04354827-9a4f-4169-80e8-4e59017b7bb0 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:10.596816 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa428ea-c84a-4740-b017-5e46d13330ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:10.597488 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa428ea-c84a-4740-b017-5e46d13330ee None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:10.597753 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa428ea-c84a-4740-b017-5e46d13330ee None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:10.598028 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa428ea-c84a-4740-b017-5e46d13330ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:10.608978 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa428ea-c84a-4740-b017-5e46d13330ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:10.611043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa428ea-c84a-4740-b017-5e46d13330ee None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:10.627167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-5aa428ea-c84a-4740-b017-5e46d13330ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:10.627167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:10.627167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:10.627167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:10.627167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:10.627167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:10.627167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:10.627167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:10.627167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:10.627167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:10.627167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:10.627167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:10.627167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:15:10.627167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:15:10.627167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:15:10.628428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:15:10.628428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:10.628428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:10.628428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:10.628428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:10.628428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:10.628428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:10.628428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:10.628428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:10.628428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:10.628428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:10.628428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:10.628428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:10.628428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:10.628428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:10.628428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:10.628428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:10.629313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:15:10.629313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:15:10.629313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:10.629313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:10.629313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 629/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:15:10.635400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c707a-3dd3-48cb-b79f-772629a0a3d4 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:10.751763 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c707a-3dd3-48cb-b79f-772629a0a3d4 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:10.754207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:10.798205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337619c6-ca7a-4a66-8b82-c1104e61b6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:10.798899 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337619c6-ca7a-4a66-8b82-c1104e61b6de None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:10.799197 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337619c6-ca7a-4a66-8b82-c1104e61b6de None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:10.799585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337619c6-ca7a-4a66-8b82-c1104e61b6de None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:10.800354 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337619c6-ca7a-4a66-8b82-c1104e61b6de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:10.800541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337619c6-ca7a-4a66-8b82-c1104e61b6de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:10.801888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337619c6-ca7a-4a66-8b82-c1104e61b6de None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:10.815405 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 600/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:10.821677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa428ea-c84a-4740-b017-5e46d13330ee None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:10.832219 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:10.930177 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa428ea-c84a-4740-b017-5e46d13330ee None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:10.971392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ba486-c9a1-42eb-b0d9-62c353ad0ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:10.972423 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ba486-c9a1-42eb-b0d9-62c353ad0ede None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:10.972855 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ba486-c9a1-42eb-b0d9-62c353ad0ede None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:10.973215 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ba486-c9a1-42eb-b0d9-62c353ad0ede None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:10.982226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ba486-c9a1-42eb-b0d9-62c353ad0ede None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:10.984101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ba486-c9a1-42eb-b0d9-62c353ad0ede None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:10.997211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-fe5ba486-c9a1-42eb-b0d9-62c353ad0ede None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:15:10.997211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:10.997211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:10.997211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:10.997211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:10.997211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:10.997211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:10.997211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:10.997211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:10.997211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:10.997211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:10.997211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:10.997211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:15:10.997211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:15:10.997211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:15:10.999316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:15:10.999316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:10.999316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:10.999316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:10.999316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:10.999316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:10.999316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:10.999316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:10.999316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:10.999316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:10.999316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:10.999316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:10.999316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:10.999316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:10.999316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:10.999316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:10.999316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:11.001542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:15:11.001542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:15:11.001542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:15:11.001542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:15:11.001542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:15:11.001542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:15:11.001542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:15:11.001542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:11.001542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 630/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:15:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:11.004349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337619c6-ca7a-4a66-8b82-c1104e61b6de None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:11.121200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337619c6-ca7a-4a66-8b82-c1104e61b6de None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:11.165194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3bfe8-6328-469b-85ee-1d791d765e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:11.166172 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3bfe8-6328-469b-85ee-1d791d765e03 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:11.167308 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3bfe8-6328-469b-85ee-1d791d765e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:11.167308 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3bfe8-6328-469b-85ee-1d791d765e03 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:11.167839 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3bfe8-6328-469b-85ee-1d791d765e03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:11.168347 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3bfe8-6328-469b-85ee-1d791d765e03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:11.172602 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3bfe8-6328-469b-85ee-1d791d765e03 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:11.197930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 601/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:15:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:15:11.199676 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ba486-c9a1-42eb-b0d9-62c353ad0ede None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:11.276382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:11.325711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ba486-c9a1-42eb-b0d9-62c353ad0ede None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:11.364235 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493065b-2bc1-4329-a04f-cdddd73615c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:11.365051 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493065b-2bc1-4329-a04f-cdddd73615c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:11.365319 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493065b-2bc1-4329-a04f-cdddd73615c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:11.365604 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493065b-2bc1-4329-a04f-cdddd73615c1 None admin] PATH_INFO: `/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/0005b0c9582e430e9cb85704a4505bb0/roles/88ed5b6546c64ac09d03064e12ca7f10` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:11.383356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493065b-2bc1-4329-a04f-cdddd73615c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e37543156ee42a0818bf5cfe747fdc2, user_id=0005b0c9582e430e9cb85704a4505bb0, role_id=88ed5b6546c64ac09d03064e12ca7f10)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:11.384742 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493065b-2bc1-4329-a04f-cdddd73615c1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:11.399957 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 631/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:15:11 2022] PUT /identity/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/0005b0c9582e430e9cb85704a4505bb0/roles/88ed5b6546c64ac09d03064e12ca7f10 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:15:13.629382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d8ac2-7985-453d-80bd-1fc5066a17a5 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:13.629978 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d8ac2-7985-453d-80bd-1fc5066a17a5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:13.629978 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d8ac2-7985-453d-80bd-1fc5066a17a5 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:13.631607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 602/1233] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:15:13.637846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e30c2c-6605-4b46-861b-1c143c39e4d0 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:13.638320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e30c2c-6605-4b46-861b-1c143c39e4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:13.638457 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e30c2c-6605-4b46-861b-1c143c39e4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:13.659698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-80e30c2c-6605-4b46-861b-1c143c39e4d0 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:15:13.661045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-80e30c2c-6605-4b46-861b-1c143c39e4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:15:13.748617 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 632/1234] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:15:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:15:13.772992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d8ac2-7985-453d-80bd-1fc5066a17a5 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:13.805523 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:13.896392 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d8ac2-7985-453d-80bd-1fc5066a17a5 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:13.935087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a8ebd-9a6b-41cd-afb2-28f73af9078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:13.935728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a8ebd-9a6b-41cd-afb2-28f73af9078c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:13.936007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a8ebd-9a6b-41cd-afb2-28f73af9078c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:13.936310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a8ebd-9a6b-41cd-afb2-28f73af9078c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:13.948878 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a8ebd-9a6b-41cd-afb2-28f73af9078c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:15:13.954017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-266a8ebd-9a6b-41cd-afb2-28f73af9078c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:15:13.954017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:13.954017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:13.954017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:13.954017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:13.954017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:13.954017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:13.954017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:13.954017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:13.954017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:13.954017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:13.954017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:13.954017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:15:13.954017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:15:13.954017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:15:13.954017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:15:13.955202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:15:13.955202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:15:13.955202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:15:13.955202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:15:13.955202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:13.955202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:13.955202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:13.955202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:13.955202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:13.955202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:13.955202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:13.955202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:13.955202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:13.955202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:13.955202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:13.955202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:13.956132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:13.956132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:13.956132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:13.956132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:13.956132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:15:13.956132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:15:13.956132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:15:13.956132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:15:13.956132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:15:13.956132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:15:13.956132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 10:15:13.956132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:15:13.956132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 603/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Aug 4 10:15:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:13.961477 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e30c2c-6605-4b46-861b-1c143c39e4d0 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:14.018376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:14.077850 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e30c2c-6605-4b46-861b-1c143c39e4d0 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:14.114832 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac96f5-b979-46bf-a6e5-113a2d56159a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:14.115584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac96f5-b979-46bf-a6e5-113a2d56159a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:14.115944 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac96f5-b979-46bf-a6e5-113a2d56159a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:14.116400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac96f5-b979-46bf-a6e5-113a2d56159a None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:14.117177 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac96f5-b979-46bf-a6e5-113a2d56159a None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:14.117546 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac96f5-b979-46bf-a6e5-113a2d56159a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:14.118976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac96f5-b979-46bf-a6e5-113a2d56159a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:14.127398 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 633/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Aug 4 10:15:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:14.133173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a8ebd-9a6b-41cd-afb2-28f73af9078c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:14.231608 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:14.247617 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a8ebd-9a6b-41cd-afb2-28f73af9078c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:14.286441 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ce025-3e1a-45e4-977a-724b7458a63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:14.287082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ce025-3e1a-45e4-977a-724b7458a63c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:14.287361 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ce025-3e1a-45e4-977a-724b7458a63c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:14.287651 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ce025-3e1a-45e4-977a-724b7458a63c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:14.299951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ce025-3e1a-45e4-977a-724b7458a63c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:14.301566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ce025-3e1a-45e4-977a-724b7458a63c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:14.318087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-3a9ce025-3e1a-45e4-977a-724b7458a63c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:14.318087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:14.318087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:14.318087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:14.318087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:14.318087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:14.318087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:14.318087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:14.318087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:14.318087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:14.318087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:14.318087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:14.318087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:15:14.318087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:15:14.318087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:15:14.319337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:15:14.319337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:14.319337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:14.319337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:14.319337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:14.319337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:14.319337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:14.319337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:14.319337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:14.319337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:14.319337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:14.319337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:14.319337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:14.319337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:14.319337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:14.319337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:14.319337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:14.320489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:15:14.320489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:15:14.320489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:14.320489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:15:14.320489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 604/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:14.325174 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac96f5-b979-46bf-a6e5-113a2d56159a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:14.440417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac96f5-b979-46bf-a6e5-113a2d56159a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:14.450189 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:14.478163 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a1244-a722-4aca-86bd-7adeed3d557f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:14.478903 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a1244-a722-4aca-86bd-7adeed3d557f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:14.479281 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a1244-a722-4aca-86bd-7adeed3d557f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:14.479486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a1244-a722-4aca-86bd-7adeed3d557f None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:14.480267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a1244-a722-4aca-86bd-7adeed3d557f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:14.480601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a1244-a722-4aca-86bd-7adeed3d557f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:14.482114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a1244-a722-4aca-86bd-7adeed3d557f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:14.496504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 634/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:15:14.503535 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ce025-3e1a-45e4-977a-724b7458a63c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:14.624663 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ce025-3e1a-45e4-977a-724b7458a63c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:14.664881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231eaaf6-aec5-4611-82a0-4290086e9016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:14.665574 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231eaaf6-aec5-4611-82a0-4290086e9016 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:14.665799 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231eaaf6-aec5-4611-82a0-4290086e9016 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:14.666080 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231eaaf6-aec5-4611-82a0-4290086e9016 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:14.669007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:14.675534 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231eaaf6-aec5-4611-82a0-4290086e9016 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:14.679128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231eaaf6-aec5-4611-82a0-4290086e9016 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:14.697025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-231eaaf6-aec5-4611-82a0-4290086e9016 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 10:15:14.697025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:14.697025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:14.697025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:14.697025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:14.697025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:14.697025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:14.697025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:14.697025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:14.697025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:14.697025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:14.697025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:14.697025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:15:14.697025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:15:14.697025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:15:14.697025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:15:14.698384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:14.698384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:14.698384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:15:14.698384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:15:14.698384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:15:14.698384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:15:14.698384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:14.698384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:14.698384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:14.698384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:14.698384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:14.698384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:14.698384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:14.698384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:14.698384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:14.698384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:14.698384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:14.698384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:14.699620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:14.699620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:14.699620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:15:14.699620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:15:14.699620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:15:14.699620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:15:14.699620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:15:14.699620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:15:14.699620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 10:15:14.699620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:15:14.704652 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 605/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:14.707620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a1244-a722-4aca-86bd-7adeed3d557f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:14.844282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a1244-a722-4aca-86bd-7adeed3d557f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:14.885045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33decf1-3745-4d31-ad67-636256237c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:14.885672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33decf1-3745-4d31-ad67-636256237c9d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:14.885955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33decf1-3745-4d31-ad67-636256237c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:14.886255 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33decf1-3745-4d31-ad67-636256237c9d None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:14.887046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33decf1-3745-4d31-ad67-636256237c9d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:14.887352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33decf1-3745-4d31-ad67-636256237c9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:14.888866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33decf1-3745-4d31-ad67-636256237c9d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:14.910449 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 635/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Aug 4 10:15:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:15:14.916348 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231eaaf6-aec5-4611-82a0-4290086e9016 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:15.036518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231eaaf6-aec5-4611-82a0-4290086e9016 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:15.079810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f74b00-8caf-4e5a-ba96-a5a6cf241037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:15.080519 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f74b00-8caf-4e5a-ba96-a5a6cf241037 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:15.080845 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f74b00-8caf-4e5a-ba96-a5a6cf241037 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:15.081294 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f74b00-8caf-4e5a-ba96-a5a6cf241037 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:15.152090 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:15.161342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f74b00-8caf-4e5a-ba96-a5a6cf241037 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:15.162992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f74b00-8caf-4e5a-ba96-a5a6cf241037 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:15.286230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 606/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:15:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 10:15:15.293025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33decf1-3745-4d31-ad67-636256237c9d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:15.329105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:15.421523 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33decf1-3745-4d31-ad67-636256237c9d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:15.461035 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62669be0-722f-48b1-9bff-3b47e74e9af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:15.461679 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62669be0-722f-48b1-9bff-3b47e74e9af2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:15.461961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62669be0-722f-48b1-9bff-3b47e74e9af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:15.462231 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62669be0-722f-48b1-9bff-3b47e74e9af2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:15.475513 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62669be0-722f-48b1-9bff-3b47e74e9af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:15.476988 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62669be0-722f-48b1-9bff-3b47e74e9af2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:15.492154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-62669be0-722f-48b1-9bff-3b47e74e9af2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:15.492154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:15.492154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:15.492154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:15.492154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:15.492154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:15.492154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:15.492154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:15.492154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:15.492154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:15.492154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:15.492154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:15.492154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:15:15.492154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:15:15.492154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:15:15.493886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:15:15.493886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:15.493886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:15.493886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:15.493886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:15.493886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:15.493886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:15.493886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:15.493886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:15.493886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:15.493886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:15.493886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:15.493886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:15.493886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:15.493886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:15.493886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:15.493886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:15.495645 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:15:15.495645 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:15:15.495645 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:15.495645 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:15.495645 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 636/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:15.499361 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f74b00-8caf-4e5a-ba96-a5a6cf241037 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:15.628793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:15.635798 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f74b00-8caf-4e5a-ba96-a5a6cf241037 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:15.675774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375532b-0a6f-4f1c-b82f-2e7cc2253e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:15.676474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375532b-0a6f-4f1c-b82f-2e7cc2253e7a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:15.676754 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375532b-0a6f-4f1c-b82f-2e7cc2253e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:15.677034 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375532b-0a6f-4f1c-b82f-2e7cc2253e7a None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:15.677674 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375532b-0a6f-4f1c-b82f-2e7cc2253e7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:15.677977 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375532b-0a6f-4f1c-b82f-2e7cc2253e7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:15.679494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375532b-0a6f-4f1c-b82f-2e7cc2253e7a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:15.696097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 607/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:15.702161 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62669be0-722f-48b1-9bff-3b47e74e9af2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:15.801065 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:15.832956 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62669be0-722f-48b1-9bff-3b47e74e9af2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:15.876100 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931362d-48a7-4e68-9bb9-8b5a182ce68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:15.876853 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931362d-48a7-4e68-9bb9-8b5a182ce68a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:15.877134 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931362d-48a7-4e68-9bb9-8b5a182ce68a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:15.877415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931362d-48a7-4e68-9bb9-8b5a182ce68a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:15.884628 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931362d-48a7-4e68-9bb9-8b5a182ce68a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:15.886074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931362d-48a7-4e68-9bb9-8b5a182ce68a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:15.904654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-9931362d-48a7-4e68-9bb9-8b5a182ce68a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:15:15.904654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:15.904654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:15.904654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:15.904654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:15.904654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:15.904654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:15.904654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:15.904654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:15.904654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:15.904654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:15.904654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:15.904654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:15:15.904654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:15:15.904654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:15:15.905652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:15:15.905652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:15.905652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:15.905652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:15.905652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:15.905652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:15.905652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:15.905652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:15.905652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:15.905652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:15.905652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:15.905652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:15.905652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:15.905652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:15.905652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:15.905652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:15.905652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:15.906657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:15:15.906657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:15:15.906657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:15:15.906657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:15:15.906657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:15:15.906657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:15:15.906657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:15:15.906657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:15.907330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 637/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:15:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:15.913478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375532b-0a6f-4f1c-b82f-2e7cc2253e7a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:16.050011 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375532b-0a6f-4f1c-b82f-2e7cc2253e7a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:16.096402 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651a42d-a349-4662-b5ba-716c41e89c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:16.097167 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651a42d-a349-4662-b5ba-716c41e89c2b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:16.097512 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651a42d-a349-4662-b5ba-716c41e89c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:16.097850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651a42d-a349-4662-b5ba-716c41e89c2b None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:16.098874 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651a42d-a349-4662-b5ba-716c41e89c2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:16.099305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651a42d-a349-4662-b5ba-716c41e89c2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:16.101104 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651a42d-a349-4662-b5ba-716c41e89c2b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:16.118550 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 608/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:15:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:16.127658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931362d-48a7-4e68-9bb9-8b5a182ce68a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:16.257649 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931362d-48a7-4e68-9bb9-8b5a182ce68a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:16.298174 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027555d-a351-41c4-bc6a-aa6f0a65035b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:16.299137 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027555d-a351-41c4-bc6a-aa6f0a65035b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:16.299355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027555d-a351-41c4-bc6a-aa6f0a65035b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:16.299631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027555d-a351-41c4-bc6a-aa6f0a65035b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:16.300766 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027555d-a351-41c4-bc6a-aa6f0a65035b None admin] RBAC: Adding query filter params (role.id=88ed5b6546c64ac09d03064e12ca7f10, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=0005b0c9582e430e9cb85704a4505bb0) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:16.301092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027555d-a351-41c4-bc6a-aa6f0a65035b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:16.302722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027555d-a351-41c4-bc6a-aa6f0a65035b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:16.310305 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 638/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:15:16 2022] GET /identity/v3/role_assignments?user.id=0005b0c9582e430e9cb85704a4505bb0&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=88ed5b6546c64ac09d03064e12ca7f10 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:18.623043 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1b506-a90f-42f9-a548-202a56560bd5 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:18.623580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1b506-a90f-42f9-a548-202a56560bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:18.624192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1b506-a90f-42f9-a548-202a56560bd5 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:18.626197 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 609/1247] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:15:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:15:18.631802 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939158a-f0c9-4f23-b2d7-0be499bef75a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:18.632354 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939158a-f0c9-4f23-b2d7-0be499bef75a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:18.632487 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939158a-f0c9-4f23-b2d7-0be499bef75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:18.640528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:18.654217 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b939158a-f0c9-4f23-b2d7-0be499bef75a None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:15:18.655441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b939158a-f0c9-4f23-b2d7-0be499bef75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:15:18.735570 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 639/1248] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:15:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:15:18.760680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1b506-a90f-42f9-a548-202a56560bd5 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:18.787032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:18.900692 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1b506-a90f-42f9-a548-202a56560bd5 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:18.944018 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb05164-518e-4a34-8587-34efa4554ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:18.944700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb05164-518e-4a34-8587-34efa4554ffe None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:18.945066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb05164-518e-4a34-8587-34efa4554ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:18.945430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb05164-518e-4a34-8587-34efa4554ffe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:18.959461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb05164-518e-4a34-8587-34efa4554ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:15:18.965309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-efb05164-518e-4a34-8587-34efa4554ffe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:15:18.965309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:18.965309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:18.965309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:18.965309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:18.965309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:18.965309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:18.965309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:18.965309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:18.965309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:18.965309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:18.965309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:18.965309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:15:18.965309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:15:18.965309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:15:18.965309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:15:18.966393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:15:18.966393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:15:18.966393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:15:18.966393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:15:18.966393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:18.966393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:18.966393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:18.966393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:18.966393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:18.966393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:18.966393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:18.966393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:18.966393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:18.966393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:18.966393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:18.966393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:18.967286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:18.967286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:18.967286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:18.967286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:18.967286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:15:18.967286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:15:18.967286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:15:18.967286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:15:18.967286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:15:18.967286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:15:18.967286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:15:18.967286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:15:18.967286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 610/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:15:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:15:18.973232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939158a-f0c9-4f23-b2d7-0be499bef75a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:19.096323 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939158a-f0c9-4f23-b2d7-0be499bef75a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:19.137013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:19.143720 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc88a29-ca09-47be-8e88-bb7f567bce74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:19.144390 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc88a29-ca09-47be-8e88-bb7f567bce74 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:19.144679 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc88a29-ca09-47be-8e88-bb7f567bce74 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:19.144958 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc88a29-ca09-47be-8e88-bb7f567bce74 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:19.145680 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc88a29-ca09-47be-8e88-bb7f567bce74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:19.145992 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc88a29-ca09-47be-8e88-bb7f567bce74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:19.147661 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc88a29-ca09-47be-8e88-bb7f567bce74 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:19.157170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 640/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:15:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:15:19.163829 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb05164-518e-4a34-8587-34efa4554ffe None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:19.263150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:19.295460 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb05164-518e-4a34-8587-34efa4554ffe None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:19.334805 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b766f6-a973-4228-bb53-0c15d2a04897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:19.335558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b766f6-a973-4228-bb53-0c15d2a04897 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:19.335789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b766f6-a973-4228-bb53-0c15d2a04897 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:19.336068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b766f6-a973-4228-bb53-0c15d2a04897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:19.348662 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b766f6-a973-4228-bb53-0c15d2a04897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:19.350151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b766f6-a973-4228-bb53-0c15d2a04897 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:19.367022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-06b766f6-a973-4228-bb53-0c15d2a04897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:19.367022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:19.367022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:19.367022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:19.367022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:19.367022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:19.367022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:19.367022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:19.367022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:19.367022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:19.367022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:19.367022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:19.367022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:15:19.367022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:15:19.367022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:15:19.369242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:15:19.369242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:19.369242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:19.369242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:19.369242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:19.369242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:19.369242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:19.369242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:19.369242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:19.369242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:19.369242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:19.369242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:19.369242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:19.369242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:19.369242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:19.369242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:19.369242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:19.371408 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:15:19.371408 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:15:19.371408 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:19.371408 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:15:19.371408 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 611/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:19.375045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc88a29-ca09-47be-8e88-bb7f567bce74 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:19.503970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc88a29-ca09-47be-8e88-bb7f567bce74 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:19.547123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948e4d6-ee72-4274-a988-048278156d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:19.548107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948e4d6-ee72-4274-a988-048278156d04 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:19.548422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948e4d6-ee72-4274-a988-048278156d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:19.548765 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948e4d6-ee72-4274-a988-048278156d04 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:19.549605 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948e4d6-ee72-4274-a988-048278156d04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:19.549979 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948e4d6-ee72-4274-a988-048278156d04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:19.551756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948e4d6-ee72-4274-a988-048278156d04 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:19.568201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 641/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:19.572561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b766f6-a973-4228-bb53-0c15d2a04897 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:19.696635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b766f6-a973-4228-bb53-0c15d2a04897 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:19.725916 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:19.735984 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebf499-eceb-455c-b68e-7b867bcb22bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:19.736666 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebf499-eceb-455c-b68e-7b867bcb22bd None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:19.736957 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebf499-eceb-455c-b68e-7b867bcb22bd None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:19.737277 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebf499-eceb-455c-b68e-7b867bcb22bd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:19.747743 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebf499-eceb-455c-b68e-7b867bcb22bd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:19.749219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebf499-eceb-455c-b68e-7b867bcb22bd None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:19.762514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-33ebf499-eceb-455c-b68e-7b867bcb22bd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 10:15:19.762514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:19.762514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:19.762514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:19.762514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:19.762514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:19.762514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:19.762514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:19.762514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:19.762514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:19.762514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:19.762514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:19.762514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:15:19.762514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:15:19.762514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:15:19.762514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:15:19.763514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:19.763514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:19.763514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:15:19.763514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:15:19.763514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:15:19.763514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:15:19.763514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:19.763514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:19.763514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:19.763514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:19.763514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:19.763514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:19.763514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:19.763514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:19.763514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:19.763514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:19.763514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:19.763514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:19.764497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:19.764497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:19.764497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:15:19.764497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:15:19.764497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:15:19.764497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:15:19.764497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:15:19.764497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:15:19.764497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 10:15:19.764497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:15:19.764497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 612/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:19.770236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948e4d6-ee72-4274-a988-048278156d04 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:19.842523 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:19.897068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948e4d6-ee72-4274-a988-048278156d04 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:19.935084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a0851-da9e-4267-b05d-7bcb5b333ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:19.935711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a0851-da9e-4267-b05d-7bcb5b333ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:19.935993 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a0851-da9e-4267-b05d-7bcb5b333ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:19.936302 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a0851-da9e-4267-b05d-7bcb5b333ae1 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:19.937119 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a0851-da9e-4267-b05d-7bcb5b333ae1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:19.938017 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a0851-da9e-4267-b05d-7bcb5b333ae1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:19.939894 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a0851-da9e-4267-b05d-7bcb5b333ae1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:19.964234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 642/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Aug 4 10:15:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:19.966122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebf499-eceb-455c-b68e-7b867bcb22bd None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:20.094831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebf499-eceb-455c-b68e-7b867bcb22bd None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:20.139810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a03f5-599b-4876-948b-cd61d5ca6679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:20.141101 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a03f5-599b-4876-948b-cd61d5ca6679 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:20.141452 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a03f5-599b-4876-948b-cd61d5ca6679 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:20.141689 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a03f5-599b-4876-948b-cd61d5ca6679 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:20.209472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:20.228069 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a03f5-599b-4876-948b-cd61d5ca6679 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:20.229740 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a03f5-599b-4876-948b-cd61d5ca6679 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:20.358062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 613/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:15:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:15:20.359307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a0851-da9e-4267-b05d-7bcb5b333ae1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:20.486379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a0851-da9e-4267-b05d-7bcb5b333ae1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:20.505963 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:20.535273 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac9254-0db4-4036-aff4-b98b923a821b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:20.536427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac9254-0db4-4036-aff4-b98b923a821b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:20.536876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac9254-0db4-4036-aff4-b98b923a821b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:20.537375 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac9254-0db4-4036-aff4-b98b923a821b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:20.551299 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac9254-0db4-4036-aff4-b98b923a821b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:20.553335 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac9254-0db4-4036-aff4-b98b923a821b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:20.571519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-ebac9254-0db4-4036-aff4-b98b923a821b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:20.571519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:20.571519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:20.571519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:20.571519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:20.571519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:20.571519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:20.571519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:20.571519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:20.571519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:20.571519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:20.571519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:20.571519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:15:20.571519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:15:20.571519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:15:20.572637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:15:20.572637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:20.572637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:20.572637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:20.572637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:20.572637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:20.572637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:20.572637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:20.572637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:20.572637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:20.572637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:20.572637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:20.572637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:20.572637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:20.572637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:20.572637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:20.572637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:20.573526 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:15:20.573526 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:15:20.573526 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:20.573526 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:20.573526 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 643/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:15:20.579680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a03f5-599b-4876-948b-cd61d5ca6679 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:20.691843 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:20.711578 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a03f5-599b-4876-948b-cd61d5ca6679 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:20.753249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1023d0-c19d-4eaf-9ecb-61f0f980ea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:20.756902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1023d0-c19d-4eaf-9ecb-61f0f980ea58 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:20.757346 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1023d0-c19d-4eaf-9ecb-61f0f980ea58 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:20.757723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1023d0-c19d-4eaf-9ecb-61f0f980ea58 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:20.758586 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1023d0-c19d-4eaf-9ecb-61f0f980ea58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:20.758994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1023d0-c19d-4eaf-9ecb-61f0f980ea58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:20.760789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1023d0-c19d-4eaf-9ecb-61f0f980ea58 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:20.776653 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 614/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:20.783929 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac9254-0db4-4036-aff4-b98b923a821b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:20.915362 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac9254-0db4-4036-aff4-b98b923a821b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:20.964727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4c3a3-12ea-4e12-a908-230d60e39890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:20.965481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4c3a3-12ea-4e12-a908-230d60e39890 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:20.965848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4c3a3-12ea-4e12-a908-230d60e39890 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:20.966202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4c3a3-12ea-4e12-a908-230d60e39890 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:20.975417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4c3a3-12ea-4e12-a908-230d60e39890 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:20.977095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4c3a3-12ea-4e12-a908-230d60e39890 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:20.990906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-76f4c3a3-12ea-4e12-a908-230d60e39890 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:15:20.990906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:20.990906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:20.990906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:20.990906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:20.990906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:20.990906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:20.990906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:20.990906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:20.990906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:20.990906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:20.990906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:20.990906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:15:20.990906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:15:20.990906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:15:20.992205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:15:20.992205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:20.992205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:20.992205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:20.992205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:20.992205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:20.992205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:20.992205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:20.992205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:20.992205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:20.992205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:20.992205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:20.992205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:20.992205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:20.992205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:20.992205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:20.992205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:20.993156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:15:20.993156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:15:20.993156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:15:20.993156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:15:20.993156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:15:20.993156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:15:20.993156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:15:20.993156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:20.993156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 644/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:15:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:20.998905 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1023d0-c19d-4eaf-9ecb-61f0f980ea58 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:21.114184 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1023d0-c19d-4eaf-9ecb-61f0f980ea58 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:21.155432 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d213d4-b7a7-45cb-90f9-679c866640d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:21.156216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d213d4-b7a7-45cb-90f9-679c866640d9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:21.156683 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d213d4-b7a7-45cb-90f9-679c866640d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:21.157130 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d213d4-b7a7-45cb-90f9-679c866640d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:21.158357 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d213d4-b7a7-45cb-90f9-679c866640d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:21.158921 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d213d4-b7a7-45cb-90f9-679c866640d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:21.161105 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d213d4-b7a7-45cb-90f9-679c866640d9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:21.175696 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 615/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:15:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:21.181730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4c3a3-12ea-4e12-a908-230d60e39890 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:21.214421 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:21.320597 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4c3a3-12ea-4e12-a908-230d60e39890 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:21.365385 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6be95-d70a-43e2-8975-19e9b63d9af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:21.366154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6be95-d70a-43e2-8975-19e9b63d9af0 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:21.366504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6be95-d70a-43e2-8975-19e9b63d9af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:21.366958 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6be95-d70a-43e2-8975-19e9b63d9af0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:21.368460 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6be95-d70a-43e2-8975-19e9b63d9af0 None admin] RBAC: Adding query filter params (role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=0005b0c9582e430e9cb85704a4505bb0) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:21.369006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6be95-d70a-43e2-8975-19e9b63d9af0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:21.371662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6be95-d70a-43e2-8975-19e9b63d9af0 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:21.380478 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 645/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:15:21 2022] GET /identity/v3/role_assignments?user.id=0005b0c9582e430e9cb85704a4505bb0&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:23.539483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffccd90-6136-4bd7-bdc7-b4cae2b9c430 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:23.540110 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffccd90-6136-4bd7-bdc7-b4cae2b9c430 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:23.540110 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffccd90-6136-4bd7-bdc7-b4cae2b9c430 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:23.541432 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 616/1261] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:15:23.546739 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f71925-9e33-4bcb-aa9d-53287f304a0e None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:23.547296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f71925-9e33-4bcb-aa9d-53287f304a0e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:23.547296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f71925-9e33-4bcb-aa9d-53287f304a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:23.566333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f1f71925-9e33-4bcb-aa9d-53287f304a0e None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:15:23.567596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f1f71925-9e33-4bcb-aa9d-53287f304a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:15:23.637295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 646/1262] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:15:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:15:23.660477 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffccd90-6136-4bd7-bdc7-b4cae2b9c430 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:23.673836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:23.765175 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffccd90-6136-4bd7-bdc7-b4cae2b9c430 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:23.815726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb9453-dc8d-4e0a-9a30-4e423a5ddcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:23.816471 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb9453-dc8d-4e0a-9a30-4e423a5ddcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:23.816873 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb9453-dc8d-4e0a-9a30-4e423a5ddcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:23.817254 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb9453-dc8d-4e0a-9a30-4e423a5ddcb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:23.829723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb9453-dc8d-4e0a-9a30-4e423a5ddcb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:15:23.834836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-41bb9453-dc8d-4e0a-9a30-4e423a5ddcb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:15:23.834836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:23.834836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:23.834836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:23.834836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:23.834836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:23.834836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:23.834836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:23.834836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:23.834836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:23.834836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:23.834836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:23.834836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:15:23.834836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:15:23.834836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:15:23.834836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:15:23.836428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:15:23.836428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:15:23.836428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:15:23.836428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:15:23.836428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:23.836428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:23.836428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:23.836428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:23.836428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:23.836428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:23.836428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:23.836428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:23.836428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:23.836428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:23.836428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:23.836428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:23.837309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:23.837309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:23.837309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:23.837309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:23.837309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:15:23.837309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:15:23.837309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:15:23.837309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:15:23.837309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:15:23.837309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:15:23.837309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:15:23.837309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:15:23.837309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 617/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:15:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:23.842151 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f71925-9e33-4bcb-aa9d-53287f304a0e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:23.861519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:23.950451 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f71925-9e33-4bcb-aa9d-53287f304a0e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:23.989541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbead5-307e-4804-b2a0-b844be11e51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:23.990169 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbead5-307e-4804-b2a0-b844be11e51d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:23.990450 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbead5-307e-4804-b2a0-b844be11e51d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:23.990720 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbead5-307e-4804-b2a0-b844be11e51d None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:23.991437 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbead5-307e-4804-b2a0-b844be11e51d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:23.991743 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbead5-307e-4804-b2a0-b844be11e51d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:23.993135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbead5-307e-4804-b2a0-b844be11e51d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:24.002652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 647/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:15:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:24.008492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb9453-dc8d-4e0a-9a30-4e423a5ddcb1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:24.080451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:24.115186 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb9453-dc8d-4e0a-9a30-4e423a5ddcb1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:24.149648 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b309633-7888-4067-83fb-f222bc4c16f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:24.150287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b309633-7888-4067-83fb-f222bc4c16f4 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:24.150561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b309633-7888-4067-83fb-f222bc4c16f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:24.150835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b309633-7888-4067-83fb-f222bc4c16f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:24.162156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b309633-7888-4067-83fb-f222bc4c16f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:24.163590 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b309633-7888-4067-83fb-f222bc4c16f4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:24.179255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-9b309633-7888-4067-83fb-f222bc4c16f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:24.179255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:24.179255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:24.179255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:24.179255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:24.179255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:24.179255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:24.179255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:24.179255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:24.179255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:24.179255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:24.179255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:24.179255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:15:24.179255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:15:24.179255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:15:24.180431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:15:24.180431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:24.180431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:24.180431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:24.180431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:24.180431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:24.180431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:24.180431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:24.180431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:24.180431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:24.180431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:24.180431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:24.180431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:24.180431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:24.180431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:24.180431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:24.180431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:24.181587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:15:24.181587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:15:24.181587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:24.181587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:15:24.181587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 618/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:24.186240 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbead5-307e-4804-b2a0-b844be11e51d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:24.273714 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:24.295016 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbead5-307e-4804-b2a0-b844be11e51d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:24.332260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c3fe5-77c4-4914-98cc-ed407ee5754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:24.332806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c3fe5-77c4-4914-98cc-ed407ee5754d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:24.333090 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c3fe5-77c4-4914-98cc-ed407ee5754d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:24.333363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c3fe5-77c4-4914-98cc-ed407ee5754d None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:24.334045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c3fe5-77c4-4914-98cc-ed407ee5754d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:24.334346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c3fe5-77c4-4914-98cc-ed407ee5754d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:24.335711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c3fe5-77c4-4914-98cc-ed407ee5754d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:24.347773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 648/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:24.353592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b309633-7888-4067-83fb-f222bc4c16f4 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:24.455675 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b309633-7888-4067-83fb-f222bc4c16f4 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:24.474691 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:24.489754 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805b009-f526-4c96-b0b9-b981f5adb8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:24.490400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805b009-f526-4c96-b0b9-b981f5adb8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:24.490690 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805b009-f526-4c96-b0b9-b981f5adb8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:24.490973 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805b009-f526-4c96-b0b9-b981f5adb8f8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:24.498597 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805b009-f526-4c96-b0b9-b981f5adb8f8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:24.500673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805b009-f526-4c96-b0b9-b981f5adb8f8 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:24.511919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-a805b009-f526-4c96-b0b9-b981f5adb8f8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 10:15:24.511919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:24.511919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:24.511919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:24.511919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:24.511919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:24.511919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:24.511919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:24.511919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:24.511919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:24.511919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:24.511919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:24.511919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:15:24.511919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:15:24.511919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:15:24.511919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:15:24.513086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:24.513086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:24.513086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:15:24.513086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:15:24.513086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:15:24.513086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:15:24.513086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:24.513086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:24.513086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:24.513086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:24.513086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:24.513086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:24.513086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:24.513086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:24.513086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:24.513086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:24.513086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:24.513086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:24.514235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:24.514235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:24.514235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:15:24.514235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:15:24.514235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:15:24.514235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:15:24.514235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:15:24.514235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:15:24.514235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 10:15:24.514235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:15:24.514235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 619/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:24.519715 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c3fe5-77c4-4914-98cc-ed407ee5754d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:24.619178 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c3fe5-77c4-4914-98cc-ed407ee5754d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:24.654054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f8521-7648-41ce-a124-dfb594807d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:24.654704 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f8521-7648-41ce-a124-dfb594807d83 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:24.654996 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f8521-7648-41ce-a124-dfb594807d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:24.655293 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f8521-7648-41ce-a124-dfb594807d83 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:24.656910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f8521-7648-41ce-a124-dfb594807d83 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:24.657397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f8521-7648-41ce-a124-dfb594807d83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:24.658834 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f8521-7648-41ce-a124-dfb594807d83 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:24.667490 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:24.676570 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 649/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Aug 4 10:15:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:24.682309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805b009-f526-4c96-b0b9-b981f5adb8f8 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:24.791013 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805b009-f526-4c96-b0b9-b981f5adb8f8 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:24.835060 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1079a-341a-4561-8f5f-3ba9472dcb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:24.835703 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1079a-341a-4561-8f5f-3ba9472dcb0b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:24.835988 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1079a-341a-4561-8f5f-3ba9472dcb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:24.836297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1079a-341a-4561-8f5f-3ba9472dcb0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:24.847598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1079a-341a-4561-8f5f-3ba9472dcb0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:24.849100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1079a-341a-4561-8f5f-3ba9472dcb0b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:24.863827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-73d1079a-341a-4561-8f5f-3ba9472dcb0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:24.863827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:24.863827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:24.863827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:24.863827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:24.863827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:24.863827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:24.863827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:24.863827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:24.863827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:24.863827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:24.863827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:24.863827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:15:24.863827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:15:24.863827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:15:24.864881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:15:24.864881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:24.864881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:24.864881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:24.864881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:24.864881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:24.864881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:24.864881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:24.864881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:24.864881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:24.864881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:24.864881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:24.864881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:24.864881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:24.864881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:24.864881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:24.864881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:24.869866 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:15:24.869866 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:15:24.869866 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:24.869866 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:15:24.869866 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 620/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:15:24.871357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f8521-7648-41ce-a124-dfb594807d83 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:24.970169 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f8521-7648-41ce-a124-dfb594807d83 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:25.004535 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317fbd9-5b85-40ae-a349-ebb65185cf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:25.005196 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317fbd9-5b85-40ae-a349-ebb65185cf27 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:25.005518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317fbd9-5b85-40ae-a349-ebb65185cf27 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:25.005829 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317fbd9-5b85-40ae-a349-ebb65185cf27 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:25.006554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317fbd9-5b85-40ae-a349-ebb65185cf27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:25.006897 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317fbd9-5b85-40ae-a349-ebb65185cf27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:25.008392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317fbd9-5b85-40ae-a349-ebb65185cf27 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:25.020719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 650/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:25.026378 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1079a-341a-4561-8f5f-3ba9472dcb0b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:25.060472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:25.135333 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1079a-341a-4561-8f5f-3ba9472dcb0b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:25.169697 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bb8a7-9cec-48ae-b170-30a50aa243ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:25.170352 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bb8a7-9cec-48ae-b170-30a50aa243ae None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:25.170638 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bb8a7-9cec-48ae-b170-30a50aa243ae None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:25.170917 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bb8a7-9cec-48ae-b170-30a50aa243ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:25.178962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bb8a7-9cec-48ae-b170-30a50aa243ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:25.180460 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bb8a7-9cec-48ae-b170-30a50aa243ae None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:25.192951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-4c6bb8a7-9cec-48ae-b170-30a50aa243ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:15:25.192951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:25.192951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:25.192951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:25.192951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:25.192951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:25.192951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:25.192951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:25.192951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:25.192951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:25.192951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:25.192951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:25.192951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:15:25.192951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:15:25.192951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:15:25.194004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:15:25.194004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:25.194004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:25.194004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:25.194004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:25.194004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:25.194004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:25.194004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:25.194004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:25.194004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:25.194004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:25.194004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:25.194004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:25.194004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:25.194004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:25.194004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:25.194004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:25.195257 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:15:25.195257 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:15:25.195257 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:15:25.195257 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:15:25.195257 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:15:25.195257 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:15:25.195257 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:15:25.195257 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:15:25.195257 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 621/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:15:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:25.199975 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317fbd9-5b85-40ae-a349-ebb65185cf27 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:25.260236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:25.304999 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317fbd9-5b85-40ae-a349-ebb65185cf27 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:25.339954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43431358-5dc4-4e6e-9a1f-178646143e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:25.340597 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43431358-5dc4-4e6e-9a1f-178646143e8c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:25.340880 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43431358-5dc4-4e6e-9a1f-178646143e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:25.341155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43431358-5dc4-4e6e-9a1f-178646143e8c None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:25.341894 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43431358-5dc4-4e6e-9a1f-178646143e8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:25.342199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43431358-5dc4-4e6e-9a1f-178646143e8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:25.343787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43431358-5dc4-4e6e-9a1f-178646143e8c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:25.355573 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 651/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:15:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:25.362127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bb8a7-9cec-48ae-b170-30a50aa243ae None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:25.454086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:25.463539 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bb8a7-9cec-48ae-b170-30a50aa243ae None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:25.501320 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5d5f5-4c5a-4881-bef5-5dca7deb7287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:25.502013 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5d5f5-4c5a-4881-bef5-5dca7deb7287 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:25.502293 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5d5f5-4c5a-4881-bef5-5dca7deb7287 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:25.502568 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5d5f5-4c5a-4881-bef5-5dca7deb7287 None admin] PATH_INFO: `/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/0005b0c9582e430e9cb85704a4505bb0/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:25.504528 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5d5f5-4c5a-4881-bef5-5dca7deb7287 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e37543156ee42a0818bf5cfe747fdc2, user_id=0005b0c9582e430e9cb85704a4505bb0, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:25.505950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5d5f5-4c5a-4881-bef5-5dca7deb7287 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:25.519134 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 622/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Aug 4 10:15:25 2022] PUT /identity/v3/projects/7e37543156ee42a0818bf5cfe747fdc2/users/0005b0c9582e430e9cb85704a4505bb0/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:15:27.600382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244b1d9-cb63-448c-9057-d8cc8b323232 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:27.600981 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244b1d9-cb63-448c-9057-d8cc8b323232 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:27.600981 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244b1d9-cb63-448c-9057-d8cc8b323232 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:27.602312 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 652/1274] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:15:27.607411 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f03d1-67df-4c74-ab0d-9dbb6057b0ae None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:27.607835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f03d1-67df-4c74-ab0d-9dbb6057b0ae None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:27.607959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f03d1-67df-4c74-ab0d-9dbb6057b0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:27.627220 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-8b6f03d1-67df-4c74-ab0d-9dbb6057b0ae None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:15:27.628444 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8b6f03d1-67df-4c74-ab0d-9dbb6057b0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:15:27.696699 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 623/1275] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:15:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 10:15:27.720819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244b1d9-cb63-448c-9057-d8cc8b323232 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:27.839617 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244b1d9-cb63-448c-9057-d8cc8b323232 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:27.859738 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:27.876582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc61b3-616b-4f94-906c-1934d6223cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:27.877226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc61b3-616b-4f94-906c-1934d6223cda None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:27.877507 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc61b3-616b-4f94-906c-1934d6223cda None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:27.877782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc61b3-616b-4f94-906c-1934d6223cda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:27.887556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc61b3-616b-4f94-906c-1934d6223cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 10:15:27.892475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-d9dc61b3-616b-4f94-906c-1934d6223cda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:15:27.892475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:27.892475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:27.892475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:27.892475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:27.892475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:27.892475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:27.892475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:27.892475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:27.892475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:27.892475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:27.892475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:27.892475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 10:15:27.892475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 10:15:27.892475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 10:15:27.892475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 10:15:27.893542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 10:15:27.893542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 10:15:27.893542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 10:15:27.893542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 10:15:27.893542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:27.893542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:27.893542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:27.893542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:27.893542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:27.893542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:27.893542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:27.893542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:27.893542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:27.893542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:27.893542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:27.893542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:27.894670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:27.894670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:27.894670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:27.894670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:27.894670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 10:15:27.894670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 10:15:27.894670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 10:15:27.894670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 10:15:27.894670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 10:15:27.894670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 10:15:27.894670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 10:15:27.894670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:27.894670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 653/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Aug 4 10:15:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:27.899719 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f03d1-67df-4c74-ab0d-9dbb6057b0ae None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:27.991138 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:28.014287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f03d1-67df-4c74-ab0d-9dbb6057b0ae None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:28.055026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e5103-952b-4ada-a623-8ef1fcacd0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:28.055810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e5103-952b-4ada-a623-8ef1fcacd0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:28.056136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e5103-952b-4ada-a623-8ef1fcacd0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:28.056497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e5103-952b-4ada-a623-8ef1fcacd0f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:28.057377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e5103-952b-4ada-a623-8ef1fcacd0f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:28.057742 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e5103-952b-4ada-a623-8ef1fcacd0f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:28.059415 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e5103-952b-4ada-a623-8ef1fcacd0f3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:28.070467 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 624/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Aug 4 10:15:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:28.075946 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc61b3-616b-4f94-906c-1934d6223cda None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:28.174370 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc61b3-616b-4f94-906c-1934d6223cda None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:28.209171 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ed764-4089-4893-b15d-9be68fa0aafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:28.209810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ed764-4089-4893-b15d-9be68fa0aafd None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:28.210099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ed764-4089-4893-b15d-9be68fa0aafd None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:28.210377 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ed764-4089-4893-b15d-9be68fa0aafd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:28.220285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ed764-4089-4893-b15d-9be68fa0aafd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:28.221732 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ed764-4089-4893-b15d-9be68fa0aafd None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:28.236548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-7e4ed764-4089-4893-b15d-9be68fa0aafd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:28.236548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:28.236548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:28.236548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:28.236548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:28.236548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:28.236548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:28.236548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:28.236548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:28.236548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:28.236548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:28.236548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:28.236548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:15:28.236548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:15:28.236548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:15:28.237582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:15:28.237582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:28.237582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:28.237582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:28.237582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:28.237582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:28.237582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:28.237582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:28.237582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:28.237582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:28.237582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:28.237582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:28.237582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:28.237582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:28.237582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:28.237582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:28.237582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:28.238506 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:15:28.238506 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:15:28.238506 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:28.238506 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:28.238506 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 654/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:28.244921 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e5103-952b-4ada-a623-8ef1fcacd0f3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:28.357984 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e5103-952b-4ada-a623-8ef1fcacd0f3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:28.392805 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdd551-e76f-40d9-b89d-71b23aca591b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:28.393521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdd551-e76f-40d9-b89d-71b23aca591b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:28.393790 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdd551-e76f-40d9-b89d-71b23aca591b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:28.394066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdd551-e76f-40d9-b89d-71b23aca591b None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:28.394761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdd551-e76f-40d9-b89d-71b23aca591b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:28.395066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdd551-e76f-40d9-b89d-71b23aca591b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:28.396471 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdd551-e76f-40d9-b89d-71b23aca591b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:28.408202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 625/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:28.414103 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ed764-4089-4893-b15d-9be68fa0aafd None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:28.446999 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:28.523130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ed764-4089-4893-b15d-9be68fa0aafd None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:28.560562 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18daaa25-e31e-43b8-a992-85691dcf0a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:28.561382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daaa25-e31e-43b8-a992-85691dcf0a42 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:28.561699 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daaa25-e31e-43b8-a992-85691dcf0a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:28.561981 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18daaa25-e31e-43b8-a992-85691dcf0a42 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:28.570643 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18daaa25-e31e-43b8-a992-85691dcf0a42 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:28.572086 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18daaa25-e31e-43b8-a992-85691dcf0a42 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:28.583819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-18daaa25-e31e-43b8-a992-85691dcf0a42 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 10:15:28.583819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:28.583819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:28.583819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:28.583819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:28.583819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:28.583819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:28.583819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:28.583819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:28.583819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:28.583819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:28.583819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:28.583819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 10:15:28.583819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 10:15:28.583819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 10:15:28.583819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 10:15:28.584970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:28.584970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:28.584970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 10:15:28.584970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:15:28.584970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 10:15:28.584970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 10:15:28.584970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:28.584970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:28.584970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:28.584970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:28.584970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:28.584970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:28.584970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:28.584970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:28.584970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:28.584970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:28.584970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:28.584970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:28.586314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:28.586314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:28.586314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 10:15:28.586314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 10:15:28.586314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 10:15:28.586314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 10:15:28.586314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 10:15:28.586314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 10:15:28.586314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 10:15:28.586314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:28.586314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 655/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:28.590859 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdd551-e76f-40d9-b89d-71b23aca591b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:28.595318 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:28.698656 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdd551-e76f-40d9-b89d-71b23aca591b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:28.734168 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fca7b-276b-4e8e-a780-0a9244177fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:28.734785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fca7b-276b-4e8e-a780-0a9244177fcc None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:28.735060 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fca7b-276b-4e8e-a780-0a9244177fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:28.735335 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fca7b-276b-4e8e-a780-0a9244177fcc None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:28.736132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fca7b-276b-4e8e-a780-0a9244177fcc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:28.736471 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fca7b-276b-4e8e-a780-0a9244177fcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:28.737918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fca7b-276b-4e8e-a780-0a9244177fcc None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:28.755724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 626/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Aug 4 10:15:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:28.761630 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18daaa25-e31e-43b8-a992-85691dcf0a42 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:28.857328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:28.867312 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18daaa25-e31e-43b8-a992-85691dcf0a42 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:28.900298 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb44b2d-ef27-49ec-833a-427ecfda7724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:28.900912 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb44b2d-ef27-49ec-833a-427ecfda7724 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:28.901191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb44b2d-ef27-49ec-833a-427ecfda7724 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:28.901466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb44b2d-ef27-49ec-833a-427ecfda7724 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:28.970684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb44b2d-ef27-49ec-833a-427ecfda7724 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:28.972050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb44b2d-ef27-49ec-833a-427ecfda7724 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:29.061707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:29.072870 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 656/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Aug 4 10:15:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 10:15:29.079248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fca7b-276b-4e8e-a780-0a9244177fcc None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:29.140915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:29.180046 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fca7b-276b-4e8e-a780-0a9244177fcc None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:29.214408 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc289e5-899f-4770-9195-73c317a79520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:29.215088 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc289e5-899f-4770-9195-73c317a79520 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:29.215369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc289e5-899f-4770-9195-73c317a79520 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:29.215678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc289e5-899f-4770-9195-73c317a79520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:29.226442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc289e5-899f-4770-9195-73c317a79520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:29.227811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc289e5-899f-4770-9195-73c317a79520 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:29.242180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-3fc289e5-899f-4770-9195-73c317a79520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:29.242180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:29.242180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:29.242180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:29.242180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:29.242180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:29.242180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:29.242180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:29.242180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:29.242180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:29.242180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:29.242180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:29.242180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 10:15:29.242180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 10:15:29.242180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 10:15:29.243128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 10:15:29.243128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:29.243128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:29.243128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:29.243128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:29.243128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:29.243128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:29.243128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:29.243128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:29.243128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:29.243128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:29.243128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:29.243128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:29.243128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:29.243128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:29.243128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:29.243128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:29.244439 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 10:15:29.244439 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 10:15:29.244439 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 10:15:29.244439 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:15:29.244439 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 627/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 10:15:29.249051 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb44b2d-ef27-49ec-833a-427ecfda7724 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:29.346567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb44b2d-ef27-49ec-833a-427ecfda7724 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:29.389213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58384a-6da9-4be5-b81f-c1e949fd79d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:29.390961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58384a-6da9-4be5-b81f-c1e949fd79d6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:29.391476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58384a-6da9-4be5-b81f-c1e949fd79d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:29.391991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58384a-6da9-4be5-b81f-c1e949fd79d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:29.393335 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58384a-6da9-4be5-b81f-c1e949fd79d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:29.393840 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58384a-6da9-4be5-b81f-c1e949fd79d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:29.395222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58384a-6da9-4be5-b81f-c1e949fd79d6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:29.406826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 657/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Aug 4 10:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:29.412585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc289e5-899f-4770-9195-73c317a79520 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:29.513027 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc289e5-899f-4770-9195-73c317a79520 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:29.526954 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:29.547379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f299e-aecb-4b4b-a2df-2ba3b772bbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:29.548023 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f299e-aecb-4b4b-a2df-2ba3b772bbbf None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:29.548347 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f299e-aecb-4b4b-a2df-2ba3b772bbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:29.548627 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f299e-aecb-4b4b-a2df-2ba3b772bbbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:29.557525 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f299e-aecb-4b4b-a2df-2ba3b772bbbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:29.558971 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f299e-aecb-4b4b-a2df-2ba3b772bbbf None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:29.570915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-ee7f299e-aecb-4b4b-a2df-2ba3b772bbbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:15:29.570915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:29.570915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:29.570915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:29.570915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:29.570915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:29.570915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:29.570915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:29.570915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:29.570915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:29.570915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:29.570915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:29.570915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 10:15:29.570915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 10:15:29.570915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 10:15:29.571927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 10:15:29.571927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:29.571927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:29.571927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:29.571927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:29.571927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:29.571927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:29.571927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:29.571927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:29.571927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:29.571927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:29.571927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:29.571927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:29.571927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:29.571927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:29.571927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:29.571927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:29.573178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 10:15:29.573178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 10:15:29.573178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 10:15:29.573178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 10:15:29.573178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 10:15:29.573178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 10:15:29.573178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 10:15:29.573178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Aug 04 10:15:29.573178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 628/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Aug 4 10:15:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:29.578602 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58384a-6da9-4be5-b81f-c1e949fd79d6 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:29.629552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:29.677973 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58384a-6da9-4be5-b81f-c1e949fd79d6 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:29.711553 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d7b00-28e8-4da7-b74d-4b1c3060a945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:29.712198 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d7b00-28e8-4da7-b74d-4b1c3060a945 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:29.712482 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d7b00-28e8-4da7-b74d-4b1c3060a945 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:29.712759 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d7b00-28e8-4da7-b74d-4b1c3060a945 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:29.713498 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d7b00-28e8-4da7-b74d-4b1c3060a945 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:29.713803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d7b00-28e8-4da7-b74d-4b1c3060a945 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:29.715236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d7b00-28e8-4da7-b74d-4b1c3060a945 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:29.727081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 658/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Aug 4 10:15:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:29.733170 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f299e-aecb-4b4b-a2df-2ba3b772bbbf None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:29.838801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f299e-aecb-4b4b-a2df-2ba3b772bbbf None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:29.871736 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df380abd-4bc8-4e1d-8c74-78e940ff5f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:29.872377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df380abd-4bc8-4e1d-8c74-78e940ff5f5d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:29.872660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df380abd-4bc8-4e1d-8c74-78e940ff5f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:29.872934 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df380abd-4bc8-4e1d-8c74-78e940ff5f5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:29.873718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df380abd-4bc8-4e1d-8c74-78e940ff5f5d None admin] RBAC: Adding query filter params (role.id=66ac7d7d384e439995b1c4d3dc16f3b1, scope.project.id=7e37543156ee42a0818bf5cfe747fdc2, user.id=0005b0c9582e430e9cb85704a4505bb0) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:29.874024 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df380abd-4bc8-4e1d-8c74-78e940ff5f5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:29.876104 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df380abd-4bc8-4e1d-8c74-78e940ff5f5d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:29.881846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 629/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Aug 4 10:15:29 2022] GET /identity/v3/role_assignments?user.id=0005b0c9582e430e9cb85704a4505bb0&scope.project.id=7e37543156ee42a0818bf5cfe747fdc2&role.id=66ac7d7d384e439995b1c4d3dc16f3b1 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:31.927454 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464326fe-fcc9-458a-8516-4bde5a83442a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:31.927996 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464326fe-fcc9-458a-8516-4bde5a83442a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:31.927996 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464326fe-fcc9-458a-8516-4bde5a83442a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:31.929320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 659/1288] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:15:31.934432 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77a3c2-eaf5-420a-88f6-47b8204e2404 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:31.934882 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77a3c2-eaf5-420a-88f6-47b8204e2404 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:31.934973 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77a3c2-eaf5-420a-88f6-47b8204e2404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:31.954328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3d77a3c2-eaf5-420a-88f6-47b8204e2404 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:15:31.955508 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3d77a3c2-eaf5-420a-88f6-47b8204e2404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:15:31.985807 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:32.037318 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 630/1289] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:15:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:15:32.060401 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464326fe-fcc9-458a-8516-4bde5a83442a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:32.173107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464326fe-fcc9-458a-8516-4bde5a83442a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:32.186886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:32.212771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f9cd7-7f51-48be-9f9f-37325c64b6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:32.213420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f9cd7-7f51-48be-9f9f-37325c64b6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:32.213701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f9cd7-7f51-48be-9f9f-37325c64b6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:32.213976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f9cd7-7f51-48be-9f9f-37325c64b6d6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:32.214592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f9cd7-7f51-48be-9f9f-37325c64b6d6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:32.215959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f9cd7-7f51-48be-9f9f-37325c64b6d6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:32.225677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-cd2f9cd7-7f51-48be-9f9f-37325c64b6d6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 10:15:32.225677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:32.225677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:15:32.225677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:15:32.225677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:15:32.225677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:15:32.225677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:15:32.225677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:15:32.225677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 10:15:32.225677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:32.225677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:15:32.225677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:32.225677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:32.225677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:32.225677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:32.225677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:32.225677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:32.226869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:32.226869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:32.226869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:32.226869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:32.226869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:32.226869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:32.226869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:15:32.226869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:15:32.226869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:15:32.226869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:15:32.226869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:32.226869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:32.226869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:32.226869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:32.226869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:32.226869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:32.227702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:32.227702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:32.227702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:32.227702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:32.227702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:32.227702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:32.227702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:32.227702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:32.227702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:32.227702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:32.227702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:15:32.227702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:15:32.227702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 10:15:32.227702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:32.227702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 660/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Aug 4 10:15:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:32.233048 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77a3c2-eaf5-420a-88f6-47b8204e2404 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:32.331765 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77a3c2-eaf5-420a-88f6-47b8204e2404 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:32.365911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafeeecb-d1d3-459d-9adf-c2f72547544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:32.366533 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeeecb-d1d3-459d-9adf-c2f72547544a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:32.366815 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeeecb-d1d3-459d-9adf-c2f72547544a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:32.367090 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafeeecb-d1d3-459d-9adf-c2f72547544a None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:32.367791 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafeeecb-d1d3-459d-9adf-c2f72547544a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:32.368097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafeeecb-d1d3-459d-9adf-c2f72547544a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:32.369490 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafeeecb-d1d3-459d-9adf-c2f72547544a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:32.374719 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 631/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Aug 4 10:15:32 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:32.380418 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f9cd7-7f51-48be-9f9f-37325c64b6d6 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:32.480090 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f9cd7-7f51-48be-9f9f-37325c64b6d6 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:32.513776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acc2c0-adad-4c66-9c89-f74b45abad52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:32.514399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acc2c0-adad-4c66-9c89-f74b45abad52 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:32.514685 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acc2c0-adad-4c66-9c89-f74b45abad52 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:32.514968 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acc2c0-adad-4c66-9c89-f74b45abad52 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:32.516266 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acc2c0-adad-4c66-9c89-f74b45abad52 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:32.516577 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acc2c0-adad-4c66-9c89-f74b45abad52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:32.517957 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acc2c0-adad-4c66-9c89-f74b45abad52 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:32.522393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 661/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Aug 4 10:15:32 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:34.639199 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462793f-3c76-47ba-aef8-d919c052e2b5 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:34.639776 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462793f-3c76-47ba-aef8-d919c052e2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:34.639776 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462793f-3c76-47ba-aef8-d919c052e2b5 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:34.641180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 632/1293] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:15:34.646752 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cfb96-6a44-4eaa-8d61-a73eb8a82f5d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:34.647192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cfb96-6a44-4eaa-8d61-a73eb8a82f5d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:34.647310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cfb96-6a44-4eaa-8d61-a73eb8a82f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:34.666072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-db0cfb96-6a44-4eaa-8d61-a73eb8a82f5d None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:15:34.667251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-db0cfb96-6a44-4eaa-8d61-a73eb8a82f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:15:34.699762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:34.740805 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 662/1294] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:15:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:15:34.765427 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462793f-3c76-47ba-aef8-d919c052e2b5 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:34.806244 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:34.892890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462793f-3c76-47ba-aef8-d919c052e2b5 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:34.930801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9217431-8a4b-4207-9a84-4a2980d1959b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:34.931430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9217431-8a4b-4207-9a84-4a2980d1959b None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:34.931712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9217431-8a4b-4207-9a84-4a2980d1959b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:34.931992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9217431-8a4b-4207-9a84-4a2980d1959b None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:34.932727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9217431-8a4b-4207-9a84-4a2980d1959b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:34.934093 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9217431-8a4b-4207-9a84-4a2980d1959b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:34.950335 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 633/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Aug 4 10:15:34 2022] POST /identity/v3/services => generated 246 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:15:36.983472 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7e695-6b6c-493a-b7e2-091eeccb7c50 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:36.984000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7e695-6b6c-493a-b7e2-091eeccb7c50 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:36.984000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7e695-6b6c-493a-b7e2-091eeccb7c50 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:36.986216 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 663/1296] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:15:36.991364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aed9e8-b190-4576-abc1-5a2c91b82bba None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:36.991778 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aed9e8-b190-4576-abc1-5a2c91b82bba None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:36.991918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aed9e8-b190-4576-abc1-5a2c91b82bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:37.010810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c0aed9e8-b190-4576-abc1-5a2c91b82bba None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:15:37.012053 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c0aed9e8-b190-4576-abc1-5a2c91b82bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:15:37.087999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 634/1297] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:15:36 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:15:37.111675 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7e695-6b6c-493a-b7e2-091eeccb7c50 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:37.211084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7e695-6b6c-493a-b7e2-091eeccb7c50 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:37.245603 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68444264-a78b-4b3b-8774-2d2a31c67bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:37.246174 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68444264-a78b-4b3b-8774-2d2a31c67bba None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:37.246460 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68444264-a78b-4b3b-8774-2d2a31c67bba None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:37.246739 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68444264-a78b-4b3b-8774-2d2a31c67bba None admin] PATH_INFO: `/v3/services/placement` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:37.247368 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68444264-a78b-4b3b-8774-2d2a31c67bba None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:37.248796 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68444264-a78b-4b3b-8774-2d2a31c67bba None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:37.258117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-68444264-a78b-4b3b-8774-2d2a31c67bba None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 10:15:37.258117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:37.258117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:15:37.258117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:15:37.258117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:15:37.258117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:15:37.258117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:15:37.258117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:15:37.258117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 10:15:37.258117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:37.258117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:15:37.258117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:37.258117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:37.258117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:37.258117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:37.258117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:37.258117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:37.259263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:37.259263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:37.259263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:37.259263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:37.259263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:37.259263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:37.259263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:15:37.259263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:15:37.259263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:15:37.259263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:15:37.259263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:37.259263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:37.259263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:37.259263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:37.259263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:37.259263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:37.260229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:37.260229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:37.260229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:37.260229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:37.260229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:37.260229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:37.260229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:37.260229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:37.260229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:37.260229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:37.260229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:15:37.260229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:15:37.260229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 10:15:37.260229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:37.260229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 664/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Aug 4 10:15:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:37.265259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aed9e8-b190-4576-abc1-5a2c91b82bba None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:37.286048 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:37.367046 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aed9e8-b190-4576-abc1-5a2c91b82bba None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:37.400472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41fc71-3d6c-4819-ba39-7ae2b23e700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:37.401106 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41fc71-3d6c-4819-ba39-7ae2b23e700e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:37.401393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41fc71-3d6c-4819-ba39-7ae2b23e700e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:37.401672 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41fc71-3d6c-4819-ba39-7ae2b23e700e None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:37.402358 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41fc71-3d6c-4819-ba39-7ae2b23e700e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:37.402666 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41fc71-3d6c-4819-ba39-7ae2b23e700e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:37.404042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41fc71-3d6c-4819-ba39-7ae2b23e700e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:37.410533 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 635/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Aug 4 10:15:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:37.416418 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68444264-a78b-4b3b-8774-2d2a31c67bba None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:37.449803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:37.521645 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68444264-a78b-4b3b-8774-2d2a31c67bba None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:37.554859 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05864f4f-2427-4efd-88e9-3ad2bee92779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:37.555479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05864f4f-2427-4efd-88e9-3ad2bee92779 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:37.555760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05864f4f-2427-4efd-88e9-3ad2bee92779 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:37.556034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05864f4f-2427-4efd-88e9-3ad2bee92779 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:37.556810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05864f4f-2427-4efd-88e9-3ad2bee92779 None admin] RBAC: Adding query filter params (interface=public, service_id=b4da3d11f24e46dd99275648cfb27f8b, region_id=RegionOne) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:37.557121 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05864f4f-2427-4efd-88e9-3ad2bee92779 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:37.558499 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05864f4f-2427-4efd-88e9-3ad2bee92779 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:37.564694 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 665/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Aug 4 10:15:37 2022] GET /identity/v3/endpoints?service_id=b4da3d11f24e46dd99275648cfb27f8b&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:37.570345 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41fc71-3d6c-4819-ba39-7ae2b23e700e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:37.656261 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:37.677021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41fc71-3d6c-4819-ba39-7ae2b23e700e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:37.711768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c231b56-8313-459f-8922-91cf571bfcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:37.712423 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c231b56-8313-459f-8922-91cf571bfcd6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:37.712709 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c231b56-8313-459f-8922-91cf571bfcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:37.712987 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c231b56-8313-459f-8922-91cf571bfcd6 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:37.713646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c231b56-8313-459f-8922-91cf571bfcd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:37.715011 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c231b56-8313-459f-8922-91cf571bfcd6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:37.722640 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 636/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Aug 4 10:15:37 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:15:39.770950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44e344-3b85-4e5f-b1fd-e354e1204fbc None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:39.771721 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44e344-3b85-4e5f-b1fd-e354e1204fbc None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:39.771721 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44e344-3b85-4e5f-b1fd-e354e1204fbc None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:39.773199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 666/1302] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:15:39.778863 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afbf87-6a93-4f2d-83d9-1296dc66bd9b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:39.779665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afbf87-6a93-4f2d-83d9-1296dc66bd9b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:39.779665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afbf87-6a93-4f2d-83d9-1296dc66bd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:39.797344 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-68afbf87-6a93-4f2d-83d9-1296dc66bd9b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:15:39.798521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-68afbf87-6a93-4f2d-83d9-1296dc66bd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:15:39.865906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 637/1303] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:15:39 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 10:15:39.888145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44e344-3b85-4e5f-b1fd-e354e1204fbc None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:39.987535 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:39.994876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44e344-3b85-4e5f-b1fd-e354e1204fbc None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:40.033652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88dbac4-f7fa-4116-9d18-c2541af95be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:40.034604 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88dbac4-f7fa-4116-9d18-c2541af95be7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:40.034994 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88dbac4-f7fa-4116-9d18-c2541af95be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:40.035418 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88dbac4-f7fa-4116-9d18-c2541af95be7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:40.036364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88dbac4-f7fa-4116-9d18-c2541af95be7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:40.038500 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88dbac4-f7fa-4116-9d18-c2541af95be7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:40.053397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-c88dbac4-f7fa-4116-9d18-c2541af95be7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 10:15:40.053397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:40.053397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 10:15:40.053397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 10:15:40.053397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 10:15:40.053397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 10:15:40.053397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 10:15:40.053397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:15:40.053397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 10:15:40.053397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:40.053397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 10:15:40.053397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:40.053397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 10:15:40.053397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 10:15:40.053397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 10:15:40.053397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 10:15:40.053397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 10:15:40.054554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 10:15:40.054554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 10:15:40.054554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 10:15:40.054554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 10:15:40.054554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 10:15:40.054554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 10:15:40.054554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 10:15:40.054554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 10:15:40.054554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 10:15:40.054554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 10:15:40.054554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 10:15:40.054554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 10:15:40.054554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 10:15:40.054554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 10:15:40.054554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 10:15:40.054554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 10:15:40.055591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 10:15:40.055591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Aug 04 10:15:40.055591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 10:15:40.055591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Aug 04 10:15:40.055591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 10:15:40.055591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 10:15:40.055591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 10:15:40.055591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Aug 04 10:15:40.055591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 10:15:40.055591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Aug 04 10:15:40.055591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 10:15:40.055591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 10:15:40.055591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 10:15:40.055591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Aug 04 10:15:40.056520 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 667/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Aug 4 10:15:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 10:15:40.061491 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afbf87-6a93-4f2d-83d9-1296dc66bd9b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:40.142297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:40.165818 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afbf87-6a93-4f2d-83d9-1296dc66bd9b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:40.200329 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6beca69-7c5f-461d-8d89-7c14e6c3ced6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:40.200949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beca69-7c5f-461d-8d89-7c14e6c3ced6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:40.201231 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beca69-7c5f-461d-8d89-7c14e6c3ced6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:40.201507 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beca69-7c5f-461d-8d89-7c14e6c3ced6 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:40.202188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6beca69-7c5f-461d-8d89-7c14e6c3ced6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:15:40.202496 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6beca69-7c5f-461d-8d89-7c14e6c3ced6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:40.204156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6beca69-7c5f-461d-8d89-7c14e6c3ced6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:40.209570 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 638/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Aug 4 10:15:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:15:40.215399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88dbac4-f7fa-4116-9d18-c2541af95be7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:15:40.314649 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88dbac4-f7fa-4116-9d18-c2541af95be7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:15:40.347952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986a289-fd85-4d63-a629-8f6f6bc282ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:15:40.348602 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986a289-fd85-4d63-a629-8f6f6bc282ea None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:15:40.348887 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986a289-fd85-4d63-a629-8f6f6bc282ea None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:15:40.349165 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986a289-fd85-4d63-a629-8f6f6bc282ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:15:40.349878 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986a289-fd85-4d63-a629-8f6f6bc282ea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:15:40.351249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986a289-fd85-4d63-a629-8f6f6bc282ea None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:15:40.371425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 668/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:15:40 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:15:50.206415 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=30 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:15:50.366992 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:16:45.430360 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb63c9-02ef-4443-a499-56b8e7bbc4a2 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:45.430932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb63c9-02ef-4443-a499-56b8e7bbc4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:45.430932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb63c9-02ef-4443-a499-56b8e7bbc4a2 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:45.437048 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 639/1307] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:16:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:16:45.438813 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91f828-70b2-41dd-8ab6-da4c75636350 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:45.439792 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91f828-70b2-41dd-8ab6-da4c75636350 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:45.440602 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91f828-70b2-41dd-8ab6-da4c75636350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:45.625816 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2f91f828-70b2-41dd-8ab6-da4c75636350 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:16:45.627482 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2f91f828-70b2-41dd-8ab6-da4c75636350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:16:45.874307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 669/1308] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:16:45.928693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6d1c1-8a6b-4d9c-b5fb-15e62597c5d7 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:45.929315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6d1c1-8a6b-4d9c-b5fb-15e62597c5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:45.929776 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6d1c1-8a6b-4d9c-b5fb-15e62597c5d7 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:45.931867 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 640/1309] 10.222.0.48 () {54 vars in 965 bytes} [Thu Aug 4 10:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:16:45.939225 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326ec8b-af42-4490-9fca-7e18cb8c2d72 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:45.939565 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326ec8b-af42-4490-9fca-7e18cb8c2d72 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:45.939848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326ec8b-af42-4490-9fca-7e18cb8c2d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:46.033179 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-4326ec8b-af42-4490-9fca-7e18cb8c2d72 None None] MFA Rules not processed for user `2021ac71491f4bebb0fbd91c533dc383`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:16:46.034762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4326ec8b-af42-4490-9fca-7e18cb8c2d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:16:46.058316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:16:46.131620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 670/1310] 10.222.0.48 () {58 vars in 1062 bytes} [Thu Aug 4 10:16:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:16:46.141945 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6d1c1-8a6b-4d9c-b5fb-15e62597c5d7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:16:46.144230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f1c6d1c1-8a6b-4d9c-b5fb-15e62597c5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:16:46.297828 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6d1c1-8a6b-4d9c-b5fb-15e62597c5d7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:16:46.402455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72533525-1849-4357-8a1c-80c991453a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:16:46.403091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72533525-1849-4357-8a1c-80c991453a56 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:46.403371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72533525-1849-4357-8a1c-80c991453a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:46.403646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72533525-1849-4357-8a1c-80c991453a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:46.405387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-72533525-1849-4357-8a1c-80c991453a56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:16:46.468683 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:16:46.539171 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72533525-1849-4357-8a1c-80c991453a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:16:46.540674 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72533525-1849-4357-8a1c-80c991453a56 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:16:46.561786 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 641/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:16:49.009428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0ae84-bf19-4319-846b-86e2e4e683b3 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:49.009988 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0ae84-bf19-4319-846b-86e2e4e683b3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:49.009988 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0ae84-bf19-4319-846b-86e2e4e683b3 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:49.011309 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 671/1312] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:16:49.017621 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb80f2-5467-4602-8d3c-901c09bc7ba5 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:49.018178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb80f2-5467-4602-8d3c-901c09bc7ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:49.018178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb80f2-5467-4602-8d3c-901c09bc7ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:49.124340 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-74cb80f2-5467-4602-8d3c-901c09bc7ba5 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:16:49.125616 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-74cb80f2-5467-4602-8d3c-901c09bc7ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:16:49.243622 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 642/1313] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:16:49.282812 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0ae84-bf19-4319-846b-86e2e4e683b3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:16:49.284397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-cee0ae84-bf19-4319-846b-86e2e4e683b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:16:49.409586 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0ae84-bf19-4319-846b-86e2e4e683b3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:16:49.491840 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:16:49.494626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d3f55-8b18-42ac-8210-03c73e899e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:16:49.495264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d3f55-8b18-42ac-8210-03c73e899e14 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:49.495728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d3f55-8b18-42ac-8210-03c73e899e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:49.496314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d3f55-8b18-42ac-8210-03c73e899e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:49.498208 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ee7d3f55-8b18-42ac-8210-03c73e899e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:16:49.611428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d3f55-8b18-42ac-8210-03c73e899e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:16:49.613158 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d3f55-8b18-42ac-8210-03c73e899e14 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:16:49.633108 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 672/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:16:52.027935 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2501a7a-909c-4822-b448-008df83c51da None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:52.028591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2501a7a-909c-4822-b448-008df83c51da None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:52.028591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2501a7a-909c-4822-b448-008df83c51da None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:52.030262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 643/1315] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:16:52.039851 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573c12-52ed-4ab8-bf4c-c0b391f4a073 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:52.040428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573c12-52ed-4ab8-bf4c-c0b391f4a073 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:52.040428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6573c12-52ed-4ab8-bf4c-c0b391f4a073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:52.113148 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c6573c12-52ed-4ab8-bf4c-c0b391f4a073 None None] MFA Rules not processed for user `ec0e7e1f75384c61b47651e3ecc71eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:16:52.114379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c6573c12-52ed-4ab8-bf4c-c0b391f4a073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:16:52.174595 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:16:52.228128 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 673/1316] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:16:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:16:52.272156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2501a7a-909c-4822-b448-008df83c51da None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:16:52.273742 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c2501a7a-909c-4822-b448-008df83c51da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:16:52.285002 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:16:52.394251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2501a7a-909c-4822-b448-008df83c51da None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:16:52.474245 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee2179-ec01-40bb-aa74-9897b903c499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:16:52.474842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee2179-ec01-40bb-aa74-9897b903c499 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:52.475121 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee2179-ec01-40bb-aa74-9897b903c499 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:52.475397 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee2179-ec01-40bb-aa74-9897b903c499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:52.477083 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-24ee2179-ec01-40bb-aa74-9897b903c499 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:16:52.550654 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:16:52.601923 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee2179-ec01-40bb-aa74-9897b903c499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:16:52.603381 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee2179-ec01-40bb-aa74-9897b903c499 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:16:52.622988 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 644/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:16:52 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:16:55.349259 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e6bbe-078f-465e-b4e9-7251e42edf90 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:55.349803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e6bbe-078f-465e-b4e9-7251e42edf90 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:55.349803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e6bbe-078f-465e-b4e9-7251e42edf90 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:55.351181 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 674/1318] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:16:55.356701 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f2665-a49b-4685-850c-bfe72624cf64 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:55.357170 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f2665-a49b-4685-850c-bfe72624cf64 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:55.357303 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f2665-a49b-4685-850c-bfe72624cf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:55.431647 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ba0f2665-a49b-4685-850c-bfe72624cf64 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:16:55.432973 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ba0f2665-a49b-4685-850c-bfe72624cf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:16:55.539475 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 645/1319] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:16:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:16:55.580106 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e6bbe-078f-465e-b4e9-7251e42edf90 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:16:55.581706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8f4e6bbe-078f-465e-b4e9-7251e42edf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:16:55.689634 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e6bbe-078f-465e-b4e9-7251e42edf90 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:16:55.774696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43272c62-5c91-490d-af4e-e98a804ce195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:16:55.775463 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43272c62-5c91-490d-af4e-e98a804ce195 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:55.775793 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43272c62-5c91-490d-af4e-e98a804ce195 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:55.776110 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43272c62-5c91-490d-af4e-e98a804ce195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:55.778094 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-43272c62-5c91-490d-af4e-e98a804ce195 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:16:55.787536 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:16:55.896061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43272c62-5c91-490d-af4e-e98a804ce195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:16:55.897532 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43272c62-5c91-490d-af4e-e98a804ce195 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:16:55.917379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 675/1320] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:16:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:16:58.795794 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459a0e0-bcd7-4c0e-9ef5-b098127e9173 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:58.796393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459a0e0-bcd7-4c0e-9ef5-b098127e9173 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:58.796393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459a0e0-bcd7-4c0e-9ef5-b098127e9173 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:58.797753 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 646/1321] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:16:58.803538 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611526ec-3d2a-4dfe-a41c-44077c93cfdb None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:58.804137 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611526ec-3d2a-4dfe-a41c-44077c93cfdb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:58.804137 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611526ec-3d2a-4dfe-a41c-44077c93cfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:58.875123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-611526ec-3d2a-4dfe-a41c-44077c93cfdb None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:16:58.877043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-611526ec-3d2a-4dfe-a41c-44077c93cfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:16:58.944038 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:16:58.995443 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 676/1322] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:16:59.050726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b15630-298c-49cf-9409-0d3b6a6103c1 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:59.051121 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b15630-298c-49cf-9409-0d3b6a6103c1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:59.051489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b15630-298c-49cf-9409-0d3b6a6103c1 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:59.053094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 647/1323] 10.222.0.48 () {54 vars in 965 bytes} [Thu Aug 4 10:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:16:59.060252 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3770093-9da5-47f7-b0c7-54e425493206 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:59.060589 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3770093-9da5-47f7-b0c7-54e425493206 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:59.061713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3770093-9da5-47f7-b0c7-54e425493206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:59.161123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a3770093-9da5-47f7-b0c7-54e425493206 None None] MFA Rules not processed for user `2021ac71491f4bebb0fbd91c533dc383`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:16:59.162294 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a3770093-9da5-47f7-b0c7-54e425493206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:16:59.263806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 677/1324] 10.222.0.48 () {58 vars in 1062 bytes} [Thu Aug 4 10:16:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:16:59.273143 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b15630-298c-49cf-9409-0d3b6a6103c1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:16:59.275347 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a3b15630-298c-49cf-9409-0d3b6a6103c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:16:59.299225 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:16:59.407007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b15630-298c-49cf-9409-0d3b6a6103c1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:16:59.494877 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfe1c8-9cb4-449b-85eb-4973e581411d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:16:59.495418 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfe1c8-9cb4-449b-85eb-4973e581411d service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:16:59.495703 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfe1c8-9cb4-449b-85eb-4973e581411d service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:16:59.495979 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfe1c8-9cb4-449b-85eb-4973e581411d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:16:59.497684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-82cfe1c8-9cb4-449b-85eb-4973e581411d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:16:59.585292 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:16:59.633391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cfe1c8-9cb4-449b-85eb-4973e581411d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:16:59.634905 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cfe1c8-9cb4-449b-85eb-4973e581411d service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:16:59.656073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 648/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:16:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:17:02.029145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4ec0d-a48f-4296-bae7-0350aa913d60 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:02.030214 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4ec0d-a48f-4296-bae7-0350aa913d60 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:02.030214 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4ec0d-a48f-4296-bae7-0350aa913d60 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:02.031627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 678/1326] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:17:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:02.038288 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ce297-a4e4-46dd-9d1f-ada0e69a55cc None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:02.038771 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ce297-a4e4-46dd-9d1f-ada0e69a55cc None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:02.039038 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ce297-a4e4-46dd-9d1f-ada0e69a55cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:02.119669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-675ce297-a4e4-46dd-9d1f-ada0e69a55cc None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:02.120917 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-675ce297-a4e4-46dd-9d1f-ada0e69a55cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:02.231486 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 649/1327] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:17:02.268684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4ec0d-a48f-4296-bae7-0350aa913d60 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:17:02.270217 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5fe4ec0d-a48f-4296-bae7-0350aa913d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:02.336873 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:02.382476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4ec0d-a48f-4296-bae7-0350aa913d60 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:17:02.462283 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584abb2-35cc-42f2-a67e-b61f1231eecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:17:02.462893 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584abb2-35cc-42f2-a67e-b61f1231eecd service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:02.463178 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584abb2-35cc-42f2-a67e-b61f1231eecd service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:02.463449 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584abb2-35cc-42f2-a67e-b61f1231eecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:02.465137 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0584abb2-35cc-42f2-a67e-b61f1231eecd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:02.599245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:02.601862 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584abb2-35cc-42f2-a67e-b61f1231eecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:17:02.603426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584abb2-35cc-42f2-a67e-b61f1231eecd service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:17:02.626046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 679/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:17:04.778494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deacbd0-536a-40ea-ba00-6f00ec95b848 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:04.779069 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deacbd0-536a-40ea-ba00-6f00ec95b848 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:04.779069 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deacbd0-536a-40ea-ba00-6f00ec95b848 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:04.781090 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 650/1329] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:17:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:04.786804 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fe9d7-df3d-48ae-886e-11ee561dd700 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:04.787287 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fe9d7-df3d-48ae-886e-11ee561dd700 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:04.787385 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fe9d7-df3d-48ae-886e-11ee561dd700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:04.858126 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1b3fe9d7-df3d-48ae-886e-11ee561dd700 None None] MFA Rules not processed for user `ec0e7e1f75384c61b47651e3ecc71eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:04.859372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1b3fe9d7-df3d-48ae-886e-11ee561dd700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:04.996243 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 680/1330] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:17:04 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:17:05.032591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deacbd0-536a-40ea-ba00-6f00ec95b848 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:17:05.034138 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9deacbd0-536a-40ea-ba00-6f00ec95b848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:05.067451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:05.145678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deacbd0-536a-40ea-ba00-6f00ec95b848 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:17:05.231473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05251723-56db-41e6-8ae6-ce1fac60cebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:17:05.232010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05251723-56db-41e6-8ae6-ce1fac60cebc service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:05.232327 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05251723-56db-41e6-8ae6-ce1fac60cebc service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:05.233194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05251723-56db-41e6-8ae6-ce1fac60cebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:05.234855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-05251723-56db-41e6-8ae6-ce1fac60cebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:05.321635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:05.364124 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05251723-56db-41e6-8ae6-ce1fac60cebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:17:05.365612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05251723-56db-41e6-8ae6-ce1fac60cebc service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:17:05.384938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 651/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:17:05 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:17:07.925611 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb088c1d-0781-40da-8638-ce9bb3f62e53 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:07.926379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb088c1d-0781-40da-8638-ce9bb3f62e53 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:07.926379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb088c1d-0781-40da-8638-ce9bb3f62e53 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:07.927549 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 681/1332] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:07.934034 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516b91d-d4b3-42b5-bbe7-05364f47855c None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:07.934530 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516b91d-d4b3-42b5-bbe7-05364f47855c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:07.934738 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516b91d-d4b3-42b5-bbe7-05364f47855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:08.011115 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c516b91d-d4b3-42b5-bbe7-05364f47855c None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:08.012391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c516b91d-d4b3-42b5-bbe7-05364f47855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:08.116966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 652/1333] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:17:08.153338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb088c1d-0781-40da-8638-ce9bb3f62e53 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:17:08.155777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-eb088c1d-0781-40da-8638-ce9bb3f62e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:08.227454 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:08.262944 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb088c1d-0781-40da-8638-ce9bb3f62e53 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:17:08.340152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4c661-b459-45cb-be50-997f35a1b08a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:17:08.340816 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4c661-b459-45cb-be50-997f35a1b08a service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:08.341099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4c661-b459-45cb-be50-997f35a1b08a service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:08.341374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4c661-b459-45cb-be50-997f35a1b08a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:08.344061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-76a4c661-b459-45cb-be50-997f35a1b08a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:08.458415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4c661-b459-45cb-be50-997f35a1b08a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:17:08.459877 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4c661-b459-45cb-be50-997f35a1b08a service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:17:08.471176 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:08.481131 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 682/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:17:10.573330 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d14f4b-51c7-499b-b2ac-3d02526581ce None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:10.573912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d14f4b-51c7-499b-b2ac-3d02526581ce None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:10.573912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d14f4b-51c7-499b-b2ac-3d02526581ce None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:10.575295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 653/1335] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:17:10.582265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe1968-0cb3-4fce-aff1-85908dad2f9f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:10.582690 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe1968-0cb3-4fce-aff1-85908dad2f9f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:10.582812 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe1968-0cb3-4fce-aff1-85908dad2f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:10.653613 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-06fe1968-0cb3-4fce-aff1-85908dad2f9f None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:10.655631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-06fe1968-0cb3-4fce-aff1-85908dad2f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:10.755111 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 683/1336] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:17:10.797770 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d14f4b-51c7-499b-b2ac-3d02526581ce None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:17:10.799571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-91d14f4b-51c7-499b-b2ac-3d02526581ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:10.847785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:10.921319 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d14f4b-51c7-499b-b2ac-3d02526581ce None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:17:11.001449 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97bfde-0592-465d-b865-9701d3fbb5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:17:11.002074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97bfde-0592-465d-b865-9701d3fbb5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:11.002354 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97bfde-0592-465d-b865-9701d3fbb5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:11.002629 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97bfde-0592-465d-b865-9701d3fbb5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:11.004307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0c97bfde-0592-465d-b865-9701d3fbb5f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:11.088219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:11.114407 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97bfde-0592-465d-b865-9701d3fbb5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:17:11.115771 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97bfde-0592-465d-b865-9701d3fbb5f0 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:17:11.134534 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 654/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:17:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:17:13.511656 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60685855-6e8a-4150-bc8d-047df203837d None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:13.512274 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60685855-6e8a-4150-bc8d-047df203837d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:13.512274 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60685855-6e8a-4150-bc8d-047df203837d None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:13.513620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 684/1338] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:13.519034 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2932d-1891-4718-9217-97b25dee56bb None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:13.519460 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2932d-1891-4718-9217-97b25dee56bb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:13.519604 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2932d-1891-4718-9217-97b25dee56bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:13.589532 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-cdb2932d-1891-4718-9217-97b25dee56bb None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:13.590800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cdb2932d-1891-4718-9217-97b25dee56bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:13.696812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 655/1339] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:17:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:17:13.733983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60685855-6e8a-4150-bc8d-047df203837d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:17:13.735544 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-60685855-6e8a-4150-bc8d-047df203837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:13.814737 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:13.843588 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60685855-6e8a-4150-bc8d-047df203837d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:17:13.917977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a60267-4c3a-4195-9218-31cc0f0ffd8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:17:13.918598 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a60267-4c3a-4195-9218-31cc0f0ffd8f service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:13.918876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a60267-4c3a-4195-9218-31cc0f0ffd8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:13.919148 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a60267-4c3a-4195-9218-31cc0f0ffd8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:13.921324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b7a60267-4c3a-4195-9218-31cc0f0ffd8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:14.030168 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a60267-4c3a-4195-9218-31cc0f0ffd8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:17:14.031530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a60267-4c3a-4195-9218-31cc0f0ffd8f service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:17:14.050829 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 685/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:17:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:17:18.128232 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db31f8d-5d6c-4f10-9e8a-f58e11e9c77b None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:18.128791 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db31f8d-5d6c-4f10-9e8a-f58e11e9c77b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:18.128902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db31f8d-5d6c-4f10-9e8a-f58e11e9c77b None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:18.130240 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 656/1341] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:18.135597 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae2e25-ae7b-4140-9335-d9eb22593ef9 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:18.136018 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae2e25-ae7b-4140-9335-d9eb22593ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:18.136155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae2e25-ae7b-4140-9335-d9eb22593ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:18.141972 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:18.207390 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a9ae2e25-ae7b-4140-9335-d9eb22593ef9 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:18.208628 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a9ae2e25-ae7b-4140-9335-d9eb22593ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:18.307529 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 686/1342] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:17:18.347577 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db31f8d-5d6c-4f10-9e8a-f58e11e9c77b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:17:18.349158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2db31f8d-5d6c-4f10-9e8a-f58e11e9c77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:18.399140 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:18.484187 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db31f8d-5d6c-4f10-9e8a-f58e11e9c77b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:17:18.568052 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15642a6c-2dce-4dab-b06c-f5fd63e5bcfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:17:18.568626 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15642a6c-2dce-4dab-b06c-f5fd63e5bcfd service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:18.568907 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15642a6c-2dce-4dab-b06c-f5fd63e5bcfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:18.569181 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15642a6c-2dce-4dab-b06c-f5fd63e5bcfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:18.570827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-15642a6c-2dce-4dab-b06c-f5fd63e5bcfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:18.680134 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:18.700021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15642a6c-2dce-4dab-b06c-f5fd63e5bcfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:17:18.702128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15642a6c-2dce-4dab-b06c-f5fd63e5bcfd service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:17:18.722202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 657/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:17:21.483682 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e60b1-8b03-47a2-a5c0-5ef0a1acb277 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:21.484275 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e60b1-8b03-47a2-a5c0-5ef0a1acb277 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:21.484275 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e60b1-8b03-47a2-a5c0-5ef0a1acb277 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:21.485691 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 687/1344] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:21.491421 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c7319-fcef-4580-8209-9d8e5c749f5e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:21.491905 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c7319-fcef-4580-8209-9d8e5c749f5e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:21.492109 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c7319-fcef-4580-8209-9d8e5c749f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:21.564312 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-379c7319-fcef-4580-8209-9d8e5c749f5e None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:21.565547 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-379c7319-fcef-4580-8209-9d8e5c749f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:21.668080 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 658/1345] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:17:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:17:21.707227 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e60b1-8b03-47a2-a5c0-5ef0a1acb277 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:17:21.708843 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-577e60b1-8b03-47a2-a5c0-5ef0a1acb277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:21.804663 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:21.829983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e60b1-8b03-47a2-a5c0-5ef0a1acb277 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:17:21.910369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc74ae6-b7ca-4c09-91fd-dc348e28b902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:17:21.911006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc74ae6-b7ca-4c09-91fd-dc348e28b902 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:21.911290 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc74ae6-b7ca-4c09-91fd-dc348e28b902 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:21.911567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc74ae6-b7ca-4c09-91fd-dc348e28b902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:21.913300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-adc74ae6-b7ca-4c09-91fd-dc348e28b902 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:22.029761 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc74ae6-b7ca-4c09-91fd-dc348e28b902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:17:22.031135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc74ae6-b7ca-4c09-91fd-dc348e28b902 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:17:22.051250 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 688/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:17:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:17:26.126338 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354edba-acd3-4382-beff-b58ba35ce219 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:26.126910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354edba-acd3-4382-beff-b58ba35ce219 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:26.126910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354edba-acd3-4382-beff-b58ba35ce219 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:26.128275 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 659/1347] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:26.133517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76433032-74d0-4952-a22b-fa1af8b48dc7 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:26.133958 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76433032-74d0-4952-a22b-fa1af8b48dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:26.134102 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76433032-74d0-4952-a22b-fa1af8b48dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:26.150190 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:26.204967 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-76433032-74d0-4952-a22b-fa1af8b48dc7 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:26.206198 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-76433032-74d0-4952-a22b-fa1af8b48dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:26.338003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 689/1348] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:17:26.377928 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354edba-acd3-4382-beff-b58ba35ce219 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:17:26.379403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6354edba-acd3-4382-beff-b58ba35ce219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:26.448039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:26.501395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354edba-acd3-4382-beff-b58ba35ce219 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:17:26.579967 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d6bcc-7725-43df-a250-cfa0eb5da38a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:17:26.580630 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6bcc-7725-43df-a250-cfa0eb5da38a service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:26.580911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6bcc-7725-43df-a250-cfa0eb5da38a service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:26.581185 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6bcc-7725-43df-a250-cfa0eb5da38a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:26.582840 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-bf0d6bcc-7725-43df-a250-cfa0eb5da38a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:26.703149 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:26.707338 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d6bcc-7725-43df-a250-cfa0eb5da38a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:17:26.709024 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d6bcc-7725-43df-a250-cfa0eb5da38a service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:17:26.728881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 660/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:17:31.682547 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142658bb-0ed1-40c0-a08d-7e72c2bd65d0 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:31.683509 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142658bb-0ed1-40c0-a08d-7e72c2bd65d0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:31.683931 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142658bb-0ed1-40c0-a08d-7e72c2bd65d0 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:31.687235 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 690/1350] 10.222.0.48 () {54 vars in 921 bytes} [Thu Aug 4 10:17:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:31.694085 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f63dad-9062-4b83-b895-4608aa0b86ba None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:31.694560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f63dad-9062-4b83-b895-4608aa0b86ba None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:31.694656 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f63dad-9062-4b83-b895-4608aa0b86ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:31.854605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-82f63dad-9062-4b83-b895-4608aa0b86ba None None] MFA Rules not processed for user `0005b0c9582e430e9cb85704a4505bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:31.855820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-82f63dad-9062-4b83-b895-4608aa0b86ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:31.989744 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 661/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Aug 4 10:17:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:17:36.336212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=59 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:36.340370 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba684e-377e-41f7-bac0-edaa94617a15 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:36.340970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba684e-377e-41f7-bac0-edaa94617a15 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:36.341805 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba684e-377e-41f7-bac0-edaa94617a15 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:36.343695 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 691/1352] 10.222.0.48 () {54 vars in 921 bytes} [Thu Aug 4 10:17:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:36.349264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5e207-341d-414b-866c-10acbbbf851e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:36.349790 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5e207-341d-414b-866c-10acbbbf851e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:36.350147 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5e207-341d-414b-866c-10acbbbf851e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:36.411904 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:36.440959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-dfb5e207-341d-414b-866c-10acbbbf851e None None] MFA Rules not processed for user `0005b0c9582e430e9cb85704a4505bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:36.442832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-dfb5e207-341d-414b-866c-10acbbbf851e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:36.573915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 662/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Aug 4 10:17:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:17:37.796398 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffc503-3afb-4f17-909f-b871a3fe6c1d None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:37.796913 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffc503-3afb-4f17-909f-b871a3fe6c1d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:37.796913 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffc503-3afb-4f17-909f-b871a3fe6c1d None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:37.798205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 692/1354] 10.222.0.48 () {54 vars in 921 bytes} [Thu Aug 4 10:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:37.803376 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be0e53-7b60-41b8-8575-f94c2d28a4f6 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:37.803784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be0e53-7b60-41b8-8575-f94c2d28a4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:37.804081 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be0e53-7b60-41b8-8575-f94c2d28a4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:37.881769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-41be0e53-7b60-41b8-8575-f94c2d28a4f6 None None] MFA Rules not processed for user `0005b0c9582e430e9cb85704a4505bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:37.882970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-41be0e53-7b60-41b8-8575-f94c2d28a4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:37.924908 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:37.992278 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 663/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Aug 4 10:17:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:17:41.386204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90e303-ab83-4882-a532-69620ce88dd4 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:41.387118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90e303-ab83-4882-a532-69620ce88dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:41.387552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90e303-ab83-4882-a532-69620ce88dd4 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:41.390621 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 693/1356] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:17:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:41.396356 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d6554-b44b-4f53-900d-40fb9e553b4a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:41.397303 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d6554-b44b-4f53-900d-40fb9e553b4a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:41.398463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d6554-b44b-4f53-900d-40fb9e553b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:41.482357 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-1e6d6554-b44b-4f53-900d-40fb9e553b4a None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:41.483882 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1e6d6554-b44b-4f53-900d-40fb9e553b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:41.599145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 664/1357] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:17:41.659016 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8e6bd-f226-4a26-b3cf-eff4f84b1925 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:41.659874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8e6bd-f226-4a26-b3cf-eff4f84b1925 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:41.660430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8e6bd-f226-4a26-b3cf-eff4f84b1925 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:41.663785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 694/1358] 10.222.0.48 () {54 vars in 962 bytes} [Thu Aug 4 10:17:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:41.674483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8211b-ee2b-4485-9d71-00a53dc93667 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:41.674802 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8211b-ee2b-4485-9d71-00a53dc93667 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:41.675240 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8211b-ee2b-4485-9d71-00a53dc93667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:41.693222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:41.762318 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-66e8211b-ee2b-4485-9d71-00a53dc93667 None None] MFA Rules not processed for user `592539924feb44ad8ea520d8539b6608`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:41.764339 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-66e8211b-ee2b-4485-9d71-00a53dc93667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:41.891301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 665/1359] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Aug 4 10:17:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:17:41.899171 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8e6bd-f226-4a26-b3cf-eff4f84b1925 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:17:41.900711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-cea8e6bd-f226-4a26-b3cf-eff4f84b1925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:42.062201 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8e6bd-f226-4a26-b3cf-eff4f84b1925 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:17:42.141917 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:42.199242 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddae05-e466-4ea0-a821-703b67a8fa03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:17:42.200036 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddae05-e466-4ea0-a821-703b67a8fa03 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:42.200445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddae05-e466-4ea0-a821-703b67a8fa03 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:42.201504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddae05-e466-4ea0-a821-703b67a8fa03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:42.203728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5cddae05-e466-4ea0-a821-703b67a8fa03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:42.302356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddae05-e466-4ea0-a821-703b67a8fa03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:17:42.305246 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddae05-e466-4ea0-a821-703b67a8fa03 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:17:42.327840 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 695/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:17:44.590438 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82e69b-4474-4a0b-87f3-5ef5282eddd4 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:44.590961 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82e69b-4474-4a0b-87f3-5ef5282eddd4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:44.590961 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82e69b-4474-4a0b-87f3-5ef5282eddd4 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:44.593114 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 666/1361] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:17:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:44.598438 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8103f4-38f5-4ded-b2e1-8d0065266cb0 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:44.598925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8103f4-38f5-4ded-b2e1-8d0065266cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:44.599006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8103f4-38f5-4ded-b2e1-8d0065266cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:44.677822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7a8103f4-38f5-4ded-b2e1-8d0065266cb0 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:44.679153 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7a8103f4-38f5-4ded-b2e1-8d0065266cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:44.722155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:44.808205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 696/1362] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:17:44.859211 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82e69b-4474-4a0b-87f3-5ef5282eddd4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:17:44.859211 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-bd82e69b-4474-4a0b-87f3-5ef5282eddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:44.931600 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:45.057672 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82e69b-4474-4a0b-87f3-5ef5282eddd4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:17:45.192897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd631a-6bf1-4704-98f8-973efdacfeb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:17:45.193446 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd631a-6bf1-4704-98f8-973efdacfeb8 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:45.193726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd631a-6bf1-4704-98f8-973efdacfeb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:45.194002 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd631a-6bf1-4704-98f8-973efdacfeb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:45.195810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-18bd631a-6bf1-4704-98f8-973efdacfeb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:45.225418 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:45.310670 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd631a-6bf1-4704-98f8-973efdacfeb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:17:45.312711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd631a-6bf1-4704-98f8-973efdacfeb8 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:17:45.334838 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 667/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:17:47.715217 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cade9-0b19-41ec-be24-b7c2254fe32d None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:47.715718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cade9-0b19-41ec-be24-b7c2254fe32d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:47.715718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cade9-0b19-41ec-be24-b7c2254fe32d None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:47.717739 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 697/1364] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:47.723514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a92c1f-971d-424e-969c-ac46350eb9c7 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:47.724003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a92c1f-971d-424e-969c-ac46350eb9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:47.724082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a92c1f-971d-424e-969c-ac46350eb9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:47.805034 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d1a92c1f-971d-424e-969c-ac46350eb9c7 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:47.806521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d1a92c1f-971d-424e-969c-ac46350eb9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:47.913992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:47.920228 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 668/1365] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:17:47.968232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf52fba-eb47-43e4-8e6e-4abe280e8b52 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:47.968416 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf52fba-eb47-43e4-8e6e-4abe280e8b52 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:47.968892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf52fba-eb47-43e4-8e6e-4abe280e8b52 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:47.970234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 698/1366] 10.222.0.48 () {54 vars in 962 bytes} [Thu Aug 4 10:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:47.976446 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff2c24-0dbe-402d-8adb-2f39def9686d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:47.977008 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff2c24-0dbe-402d-8adb-2f39def9686d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:47.977391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff2c24-0dbe-402d-8adb-2f39def9686d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:48.063965 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-0cff2c24-0dbe-402d-8adb-2f39def9686d None None] MFA Rules not processed for user `592539924feb44ad8ea520d8539b6608`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:48.065392 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0cff2c24-0dbe-402d-8adb-2f39def9686d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:48.200660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 669/1367] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Aug 4 10:17:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:17:48.209006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf52fba-eb47-43e4-8e6e-4abe280e8b52 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:17:48.212154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9bf52fba-eb47-43e4-8e6e-4abe280e8b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:48.387720 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf52fba-eb47-43e4-8e6e-4abe280e8b52 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:17:48.409798 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:48.512986 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930fce2-e368-4864-9a31-3fec365adbac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:17:48.514009 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930fce2-e368-4864-9a31-3fec365adbac service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:48.514392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930fce2-e368-4864-9a31-3fec365adbac service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:48.514668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930fce2-e368-4864-9a31-3fec365adbac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:48.516307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b930fce2-e368-4864-9a31-3fec365adbac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:48.620295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930fce2-e368-4864-9a31-3fec365adbac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:17:48.620295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930fce2-e368-4864-9a31-3fec365adbac service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:17:48.643222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 699/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:17:49.605908 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08453a15-95fe-4041-ba49-0042f814f961 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:49.606465 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08453a15-95fe-4041-ba49-0042f814f961 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:49.606465 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08453a15-95fe-4041-ba49-0042f814f961 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:49.612262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 670/1369] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:17:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:49.614313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3b130-0b1e-40ed-9db9-b326e034a5a3 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:49.614762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3b130-0b1e-40ed-9db9-b326e034a5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:49.615079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3b130-0b1e-40ed-9db9-b326e034a5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:49.653745 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:49.699330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2fd3b130-0b1e-40ed-9db9-b326e034a5a3 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:49.700519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2fd3b130-0b1e-40ed-9db9-b326e034a5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:49.807967 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 700/1370] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:17:50.176214 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0e58f-f36d-41b8-92f6-b2ba4caa5b72 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:50.176418 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0e58f-f36d-41b8-92f6-b2ba4caa5b72 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:50.176764 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0e58f-f36d-41b8-92f6-b2ba4caa5b72 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:50.178360 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 671/1371] 10.222.0.48 () {54 vars in 964 bytes} [Thu Aug 4 10:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:50.183365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52259a1b-cfee-4137-95a1-25e225270bd2 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:50.183783 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52259a1b-cfee-4137-95a1-25e225270bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:50.184182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52259a1b-cfee-4137-95a1-25e225270bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:50.401130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-52259a1b-cfee-4137-95a1-25e225270bd2 None None] MFA Rules not processed for user `180731bbc26c4681965dfd9cf0c1f063`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:50.402700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-52259a1b-cfee-4137-95a1-25e225270bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:50.458358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:50.495664 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 701/1372] 10.222.0.48 () {58 vars in 1061 bytes} [Thu Aug 4 10:17:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:17:50.503854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0e58f-f36d-41b8-92f6-b2ba4caa5b72 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:17:50.505669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-04d0e58f-f36d-41b8-92f6-b2ba4caa5b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:50.571068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:50.640642 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0e58f-f36d-41b8-92f6-b2ba4caa5b72 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:17:50.753732 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5252a07-1a74-48f5-afff-590223edcfd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:17:50.754731 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5252a07-1a74-48f5-afff-590223edcfd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:50.755212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5252a07-1a74-48f5-afff-590223edcfd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:50.755677 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5252a07-1a74-48f5-afff-590223edcfd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:50.758579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b5252a07-1a74-48f5-afff-590223edcfd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:50.799390 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aaff6-6ef1-45c1-b16c-1387c3d575a5 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:50.799995 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aaff6-6ef1-45c1-b16c-1387c3d575a5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:50.799995 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aaff6-6ef1-45c1-b16c-1387c3d575a5 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:50.801315 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 702/1373] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:50.806336 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f301c-32d6-49b9-bba4-43e244f00edd None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:50.806627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f301c-32d6-49b9-bba4-43e244f00edd None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:50.806907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f301c-32d6-49b9-bba4-43e244f00edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:50.881308 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-152f301c-32d6-49b9-bba4-43e244f00edd None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:50.882640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-152f301c-32d6-49b9-bba4-43e244f00edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:50.903433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:50.919397 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5252a07-1a74-48f5-afff-590223edcfd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:17:50.921493 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5252a07-1a74-48f5-afff-590223edcfd3 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:17:50.953594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 672/1374] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:17:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:17:51.007025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 703/1375] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:17:51.052627 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5252a07-1a74-48f5-afff-590223edcfd3 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:17:51.053930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b5252a07-1a74-48f5-afff-590223edcfd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:51.156811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5252a07-1a74-48f5-afff-590223edcfd3 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:17:51.273284 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:51.286021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774a30f-d3bf-4c03-9dec-bcdbd139f1e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:17:51.286743 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774a30f-d3bf-4c03-9dec-bcdbd139f1e9 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:51.287024 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774a30f-d3bf-4c03-9dec-bcdbd139f1e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:51.287298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774a30f-d3bf-4c03-9dec-bcdbd139f1e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:51.288984 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2774a30f-d3bf-4c03-9dec-bcdbd139f1e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:51.383749 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774a30f-d3bf-4c03-9dec-bcdbd139f1e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:17:51.386117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774a30f-d3bf-4c03-9dec-bcdbd139f1e9 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:17:51.407015 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 673/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:17:53.510161 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fe964-cd5d-4673-8ade-cca68cb5660a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:53.510955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fe964-cd5d-4673-8ade-cca68cb5660a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:53.510955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fe964-cd5d-4673-8ade-cca68cb5660a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:53.512384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 704/1377] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:53.518515 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003604c-f1cc-4514-bc9d-6e539d8cebfa None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:53.519025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003604c-f1cc-4514-bc9d-6e539d8cebfa None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:53.519139 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003604c-f1cc-4514-bc9d-6e539d8cebfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:53.605592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-2003604c-f1cc-4514-bc9d-6e539d8cebfa None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:53.606996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2003604c-f1cc-4514-bc9d-6e539d8cebfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:53.668871 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:53.708596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 674/1378] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:17:53.754027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fe964-cd5d-4673-8ade-cca68cb5660a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:17:53.755552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f20fe964-cd5d-4673-8ade-cca68cb5660a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:53.812691 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:53.921610 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fe964-cd5d-4673-8ade-cca68cb5660a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:17:54.052991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f2ba3-30f7-45cd-8c90-16b019b3a58d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:17:54.053540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f2ba3-30f7-45cd-8c90-16b019b3a58d service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:54.053823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f2ba3-30f7-45cd-8c90-16b019b3a58d service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:54.054096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f2ba3-30f7-45cd-8c90-16b019b3a58d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:54.055758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8a6f2ba3-30f7-45cd-8c90-16b019b3a58d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:54.069382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:54.155315 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f2ba3-30f7-45cd-8c90-16b019b3a58d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:17:54.155589 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f2ba3-30f7-45cd-8c90-16b019b3a58d service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:17:54.174495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 705/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:17:56.300923 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8e76e-789f-4f05-a1a2-bd4d191c128c None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:56.301526 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8e76e-789f-4f05-a1a2-bd4d191c128c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:56.301526 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8e76e-789f-4f05-a1a2-bd4d191c128c None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:56.302912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 675/1380] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:56.308344 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b763c-0f96-4af1-8cc3-b73fbc694eb2 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:56.308815 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b763c-0f96-4af1-8cc3-b73fbc694eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:56.308923 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b763c-0f96-4af1-8cc3-b73fbc694eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:56.384149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-314b763c-0f96-4af1-8cc3-b73fbc694eb2 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:56.385407 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-314b763c-0f96-4af1-8cc3-b73fbc694eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:56.483001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:56.497187 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 706/1381] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:17:56.545261 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8e76e-789f-4f05-a1a2-bd4d191c128c None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:17:56.546997 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a0d8e76e-789f-4f05-a1a2-bd4d191c128c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:56.724798 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8e76e-789f-4f05-a1a2-bd4d191c128c None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:17:56.777097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:56.851783 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34800e-b736-48cd-adf2-c1e76bb3a04a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:17:56.852445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34800e-b736-48cd-adf2-c1e76bb3a04a service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:56.852736 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34800e-b736-48cd-adf2-c1e76bb3a04a service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:56.853018 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34800e-b736-48cd-adf2-c1e76bb3a04a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:56.854662 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0f34800e-b736-48cd-adf2-c1e76bb3a04a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:56.964739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34800e-b736-48cd-adf2-c1e76bb3a04a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:17:56.967228 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34800e-b736-48cd-adf2-c1e76bb3a04a service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:17:56.988132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 676/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:17:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:17:59.210428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f5277-f7c2-4c51-a20f-824c5c64dc07 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:59.211012 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f5277-f7c2-4c51-a20f-824c5c64dc07 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:59.211427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f5277-f7c2-4c51-a20f-824c5c64dc07 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:59.214008 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 707/1383] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:17:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:17:59.224156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0c04c-adf3-4af5-b287-a513182a4dce None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:59.224877 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0c04c-adf3-4af5-b287-a513182a4dce None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:59.225225 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0c04c-adf3-4af5-b287-a513182a4dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:59.315815 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-1ed0c04c-adf3-4af5-b287-a513182a4dce None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:17:59.317419 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1ed0c04c-adf3-4af5-b287-a513182a4dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:59.319522 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:59.448809 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 677/1384] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:17:59.492773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f5277-f7c2-4c51-a20f-824c5c64dc07 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:17:59.494259 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-990f5277-f7c2-4c51-a20f-824c5c64dc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:59.675024 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f5277-f7c2-4c51-a20f-824c5c64dc07 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:17:59.749981 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:17:59.814721 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e63b46-1957-4e0d-95f8-85cb490b87ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:17:59.815366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e63b46-1957-4e0d-95f8-85cb490b87ed service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:17:59.815654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e63b46-1957-4e0d-95f8-85cb490b87ed service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:17:59.815932 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e63b46-1957-4e0d-95f8-85cb490b87ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:17:59.817933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c2e63b46-1957-4e0d-95f8-85cb490b87ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:17:59.915954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e63b46-1957-4e0d-95f8-85cb490b87ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:17:59.917617 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e63b46-1957-4e0d-95f8-85cb490b87ed service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:17:59.938145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 708/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:18:02.217129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022245bd-eb78-4c22-af04-ec9e38e85e7b None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:02.217702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022245bd-eb78-4c22-af04-ec9e38e85e7b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:02.218069 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022245bd-eb78-4c22-af04-ec9e38e85e7b None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:02.220034 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 678/1386] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:18:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:02.226222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357e75a-be42-4e6d-9cee-a286534c8d2d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:02.226801 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357e75a-be42-4e6d-9cee-a286534c8d2d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:02.226801 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357e75a-be42-4e6d-9cee-a286534c8d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:02.302136 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3357e75a-be42-4e6d-9cee-a286534c8d2d None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:02.304040 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3357e75a-be42-4e6d-9cee-a286534c8d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:02.339603 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:02.453586 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 709/1387] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:02.499735 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022245bd-eb78-4c22-af04-ec9e38e85e7b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:02.501267 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-022245bd-eb78-4c22-af04-ec9e38e85e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:02.644015 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:02.661592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022245bd-eb78-4c22-af04-ec9e38e85e7b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:02.792615 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecf9db-3bf3-4ed1-b16a-993fd2a7425b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:02.793344 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecf9db-3bf3-4ed1-b16a-993fd2a7425b service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:02.793732 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecf9db-3bf3-4ed1-b16a-993fd2a7425b service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:02.794949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecf9db-3bf3-4ed1-b16a-993fd2a7425b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:02.797389 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-96ecf9db-3bf3-4ed1-b16a-993fd2a7425b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:02.905247 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ecf9db-3bf3-4ed1-b16a-993fd2a7425b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:02.907769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ecf9db-3bf3-4ed1-b16a-993fd2a7425b service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:02.915016 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:02.933280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 679/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:18:05.005140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf463c4a-0aaf-4e3a-9b93-845468c2d9ac None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:05.005675 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf463c4a-0aaf-4e3a-9b93-845468c2d9ac None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:05.005675 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf463c4a-0aaf-4e3a-9b93-845468c2d9ac None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:05.006950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 710/1389] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:05.012071 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd8d88-e64a-4f96-89dc-b6091e4974b3 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:05.012513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd8d88-e64a-4f96-89dc-b6091e4974b3 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:05.012660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd8d88-e64a-4f96-89dc-b6091e4974b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:05.084160 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-5ecd8d88-e64a-4f96-89dc-b6091e4974b3 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:05.085406 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5ecd8d88-e64a-4f96-89dc-b6091e4974b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:05.182586 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 680/1390] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:05.228866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf463c4a-0aaf-4e3a-9b93-845468c2d9ac None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:05.230560 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-bf463c4a-0aaf-4e3a-9b93-845468c2d9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:05.383555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf463c4a-0aaf-4e3a-9b93-845468c2d9ac None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:05.393141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:05.505981 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92c806-8c97-4219-a0d5-27faa4c99ab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:05.506818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92c806-8c97-4219-a0d5-27faa4c99ab0 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:05.507100 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92c806-8c97-4219-a0d5-27faa4c99ab0 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:05.507407 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92c806-8c97-4219-a0d5-27faa4c99ab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:05.509211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9f92c806-8c97-4219-a0d5-27faa4c99ab0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:05.606182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92c806-8c97-4219-a0d5-27faa4c99ab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:05.608202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92c806-8c97-4219-a0d5-27faa4c99ab0 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:05.627065 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 711/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:18:06.425203 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271f20b-5be8-4a5b-beb1-e618b188d856 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:06.425768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271f20b-5be8-4a5b-beb1-e618b188d856 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:06.425768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271f20b-5be8-4a5b-beb1-e618b188d856 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:06.427212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 681/1392] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:06.433597 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9942e-87d5-45b3-9d2c-a36013725ea3 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:06.434153 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9942e-87d5-45b3-9d2c-a36013725ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:06.434153 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9942e-87d5-45b3-9d2c-a36013725ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:06.451601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:06.505290 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-87c9942e-87d5-45b3-9d2c-a36013725ea3 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:06.506518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-87c9942e-87d5-45b3-9d2c-a36013725ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:06.609291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 712/1393] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:06.666962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df944018-4b38-4618-b435-0c756bd2ba54 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:06.667245 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df944018-4b38-4618-b435-0c756bd2ba54 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:06.667523 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df944018-4b38-4618-b435-0c756bd2ba54 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:06.669109 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 682/1394] 10.222.0.48 () {54 vars in 966 bytes} [Thu Aug 4 10:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:06.674537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f89da5-51a6-4097-b9d6-b73fff30c59b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:06.674831 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f89da5-51a6-4097-b9d6-b73fff30c59b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:06.675117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f89da5-51a6-4097-b9d6-b73fff30c59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:06.758303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-94f89da5-51a6-4097-b9d6-b73fff30c59b None None] MFA Rules not processed for user `0dc15e64c987488f812d1cdd0c82c7ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:06.759437 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-94f89da5-51a6-4097-b9d6-b73fff30c59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:06.800305 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:06.848325 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 713/1395] 10.222.0.48 () {58 vars in 1063 bytes} [Thu Aug 4 10:18:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:06.856271 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df944018-4b38-4618-b435-0c756bd2ba54 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:06.858473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-df944018-4b38-4618-b435-0c756bd2ba54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:06.939791 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:06.974215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df944018-4b38-4618-b435-0c756bd2ba54 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:07.065314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fd90d-3978-4ad8-9ba2-e45d7f9f9d04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc15e64c987488f812d1cdd0c82c7ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:07.065948 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fd90d-3978-4ad8-9ba2-e45d7f9f9d04 service glance] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:07.066226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fd90d-3978-4ad8-9ba2-e45d7f9f9d04 service glance] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:07.066497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fd90d-3978-4ad8-9ba2-e45d7f9f9d04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:07.068438 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d32fd90d-3978-4ad8-9ba2-e45d7f9f9d04 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:07.195857 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fd90d-3978-4ad8-9ba2-e45d7f9f9d04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:07.197342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fd90d-3978-4ad8-9ba2-e45d7f9f9d04 service glance] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:07.213231 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:07.224373 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 683/1396] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:18:07.719352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36640ec-3be0-4d33-ac37-a97c57698560 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:07.719884 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36640ec-3be0-4d33-ac37-a97c57698560 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:07.720007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36640ec-3be0-4d33-ac37-a97c57698560 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:07.721379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 714/1397] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:07.726804 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae37be-1dad-413a-9975-d991d6e16867 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:07.727198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae37be-1dad-413a-9975-d991d6e16867 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:07.727364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae37be-1dad-413a-9975-d991d6e16867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:07.796402 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a6ae37be-1dad-413a-9975-d991d6e16867 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:07.797652 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a6ae37be-1dad-413a-9975-d991d6e16867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:07.911528 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 684/1398] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:07.955701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36640ec-3be0-4d33-ac37-a97c57698560 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:07.957323 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b36640ec-3be0-4d33-ac37-a97c57698560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:07.998358 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631ad08-26b1-4fe3-a50a-eff20a7c6035 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:07.998680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631ad08-26b1-4fe3-a50a-eff20a7c6035 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:07.998967 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631ad08-26b1-4fe3-a50a-eff20a7c6035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:08.068641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-e631ad08-26b1-4fe3-a50a-eff20a7c6035 None None] MFA Rules not processed for user `306a5f4d7e0d44bd9a27145bd35a07fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:08.070038 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e631ad08-26b1-4fe3-a50a-eff20a7c6035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:08.103642 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:08.113223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36640ec-3be0-4d33-ac37-a97c57698560 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:08.155777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:08.165713 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 685/1399] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Aug 4 10:18:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:18:08.210379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d820fcd-2b62-4617-864b-a2eda59971d0 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:08.210798 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d820fcd-2b62-4617-864b-a2eda59971d0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:08.211230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d820fcd-2b62-4617-864b-a2eda59971d0 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:08.213261 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 686/1400] 10.222.0.48 () {54 vars in 943 bytes} [Thu Aug 4 10:18:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:18:08.219971 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843505d-b037-415b-bc9e-3a08f947750d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:08.220363 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843505d-b037-415b-bc9e-3a08f947750d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:08.220650 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843505d-b037-415b-bc9e-3a08f947750d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:08.234400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56857457-de12-48ca-975d-dbff98a8eb89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:08.235059 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56857457-de12-48ca-975d-dbff98a8eb89 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:08.235345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56857457-de12-48ca-975d-dbff98a8eb89 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:08.235623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56857457-de12-48ca-975d-dbff98a8eb89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:08.237317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-56857457-de12-48ca-975d-dbff98a8eb89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:08.300653 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-6843505d-b037-415b-bc9e-3a08f947750d None None] MFA Rules not processed for user `878797620be54b74a3e8582c78ba78d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:08.301888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6843505d-b037-415b-bc9e-3a08f947750d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:08.332822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56857457-de12-48ca-975d-dbff98a8eb89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:08.334701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56857457-de12-48ca-975d-dbff98a8eb89 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:08.353188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 715/1401] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:18:08.425733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 687/1402] 10.222.0.48 () {58 vars in 1040 bytes} [Thu Aug 4 10:18:08 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:18:08.429952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56857457-de12-48ca-975d-dbff98a8eb89 service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:08.431466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-56857457-de12-48ca-975d-dbff98a8eb89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:08.486555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:08.534648 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56857457-de12-48ca-975d-dbff98a8eb89 service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:08.652723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f83002-dc19-42fd-a223-560d37caf1ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878797620be54b74a3e8582c78ba78d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:08.653375 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f83002-dc19-42fd-a223-560d37caf1ea service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:08.653652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f83002-dc19-42fd-a223-560d37caf1ea service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:08.653936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f83002-dc19-42fd-a223-560d37caf1ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:08.655861 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-39f83002-dc19-42fd-a223-560d37caf1ea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:08.746592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:08.751191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f83002-dc19-42fd-a223-560d37caf1ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:08.752839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f83002-dc19-42fd-a223-560d37caf1ea service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:08.761121 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 716/1403] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Aug 4 10:18:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 10:18:10.474981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7779de8-40de-4497-8e62-4212b3606120 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:10.476014 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7779de8-40de-4497-8e62-4212b3606120 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:10.476644 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7779de8-40de-4497-8e62-4212b3606120 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:10.478832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 688/1404] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:18:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:10.484685 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d22564-5043-4b47-8daf-b47ebd103c35 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:10.485623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d22564-5043-4b47-8daf-b47ebd103c35 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:10.486099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d22564-5043-4b47-8daf-b47ebd103c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:10.578310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f7d22564-5043-4b47-8daf-b47ebd103c35 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:10.579741 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f7d22564-5043-4b47-8daf-b47ebd103c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:10.706251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 717/1405] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:18:10.752527 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7779de8-40de-4497-8e62-4212b3606120 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:10.754074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c7779de8-40de-4497-8e62-4212b3606120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:10.757010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:10.930038 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7779de8-40de-4497-8e62-4212b3606120 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:11.022202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:11.069812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89234690-088b-4962-bd2d-661943418ab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:11.070747 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89234690-088b-4962-bd2d-661943418ab8 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:11.071199 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89234690-088b-4962-bd2d-661943418ab8 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:11.071670 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89234690-088b-4962-bd2d-661943418ab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:11.073344 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-89234690-088b-4962-bd2d-661943418ab8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:11.176789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89234690-088b-4962-bd2d-661943418ab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:11.178399 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89234690-088b-4962-bd2d-661943418ab8 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:11.198955 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 689/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:18:13.267684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776548b-3c39-4f4f-a023-c9573bc8a59f None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:13.268285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776548b-3c39-4f4f-a023-c9573bc8a59f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:13.268285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776548b-3c39-4f4f-a023-c9573bc8a59f None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:13.269632 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 718/1407] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:13.274864 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f494c80-a41b-41e5-b2f2-5fc5ab80485b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:13.275329 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f494c80-a41b-41e5-b2f2-5fc5ab80485b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:13.275435 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f494c80-a41b-41e5-b2f2-5fc5ab80485b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:13.349111 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-2f494c80-a41b-41e5-b2f2-5fc5ab80485b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:13.350349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2f494c80-a41b-41e5-b2f2-5fc5ab80485b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:13.401432 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:13.474496 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 690/1408] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:13.524347 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776548b-3c39-4f4f-a023-c9573bc8a59f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:13.526171 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8776548b-3c39-4f4f-a023-c9573bc8a59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:13.613223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:13.704985 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776548b-3c39-4f4f-a023-c9573bc8a59f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:13.835915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293816de-ec0b-49c6-9508-8602f8b68577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:13.836601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293816de-ec0b-49c6-9508-8602f8b68577 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:13.836861 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293816de-ec0b-49c6-9508-8602f8b68577 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:13.837139 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293816de-ec0b-49c6-9508-8602f8b68577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:13.839081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-293816de-ec0b-49c6-9508-8602f8b68577 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:13.886876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:13.998516 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293816de-ec0b-49c6-9508-8602f8b68577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:14.000362 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293816de-ec0b-49c6-9508-8602f8b68577 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:14.030275 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 719/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:18:23.472600 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=26 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:24.021345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=30 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:31.348970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46377de-3f48-469f-a5f8-e7421717c035 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:31.349560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46377de-3f48-469f-a5f8-e7421717c035 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:31.349560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46377de-3f48-469f-a5f8-e7421717c035 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:31.350904 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 691/1410] 10.222.0.48 () {54 vars in 918 bytes} [Thu Aug 4 10:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:31.356345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002794e0-d9a1-4fb2-a289-f14a640dba91 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:31.356896 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002794e0-d9a1-4fb2-a289-f14a640dba91 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:31.357267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002794e0-d9a1-4fb2-a289-f14a640dba91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:31.435216 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-002794e0-d9a1-4fb2-a289-f14a640dba91 None None] MFA Rules not processed for user `0005b0c9582e430e9cb85704a4505bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:31.436509 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-002794e0-d9a1-4fb2-a289-f14a640dba91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:31.547701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 720/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Aug 4 10:18:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:31.563807 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85634247-aadf-4f17-af1c-03ef3b637096 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:31.564094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85634247-aadf-4f17-af1c-03ef3b637096 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:31.564405 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85634247-aadf-4f17-af1c-03ef3b637096 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:31.565758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 692/1412] 10.222.0.48 () {54 vars in 918 bytes} [Thu Aug 4 10:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:31.570898 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9364bfa-0932-46f0-a81e-f2cd8ec06c7c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:31.571188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9364bfa-0932-46f0-a81e-f2cd8ec06c7c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:31.571468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9364bfa-0932-46f0-a81e-f2cd8ec06c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:31.657425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:31.660291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a9364bfa-0932-46f0-a81e-f2cd8ec06c7c None None] MFA Rules not processed for user `592539924feb44ad8ea520d8539b6608`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:31.662114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a9364bfa-0932-46f0-a81e-f2cd8ec06c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:31.783599 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 721/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Aug 4 10:18:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:34.317494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da94613-cf1d-4767-99e1-10116f44ab20 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:34.318326 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da94613-cf1d-4767-99e1-10116f44ab20 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:34.318440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da94613-cf1d-4767-99e1-10116f44ab20 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:34.319801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 693/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 10:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:34.326227 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57d8e2-f31a-47a2-870f-61cb4d8bf158 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:34.326758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57d8e2-f31a-47a2-870f-61cb4d8bf158 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:34.327144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57d8e2-f31a-47a2-870f-61cb4d8bf158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:34.405647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1c57d8e2-f31a-47a2-870f-61cb4d8bf158 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:34.406863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1c57d8e2-f31a-47a2-870f-61cb4d8bf158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:34.466118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:34.509101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 722/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 10:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:34.552993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da94613-cf1d-4767-99e1-10116f44ab20 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:34.554708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5da94613-cf1d-4767-99e1-10116f44ab20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:34.719861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da94613-cf1d-4767-99e1-10116f44ab20 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:34.796418 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:34.837643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc187f28-0f26-4d9f-bf41-05a3498ee8b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:34.838270 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc187f28-0f26-4d9f-bf41-05a3498ee8b0 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:34.838553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc187f28-0f26-4d9f-bf41-05a3498ee8b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:34.838831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc187f28-0f26-4d9f-bf41-05a3498ee8b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:34.840739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-dc187f28-0f26-4d9f-bf41-05a3498ee8b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:34.935151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc187f28-0f26-4d9f-bf41-05a3498ee8b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:34.936719 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc187f28-0f26-4d9f-bf41-05a3498ee8b0 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:34.954953 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 694/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:18:35.870900 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f805b8-9187-4b18-8cea-f2366c9b3b0f None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:35.871447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f805b8-9187-4b18-8cea-f2366c9b3b0f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:35.871564 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f805b8-9187-4b18-8cea-f2366c9b3b0f None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:35.873043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 723/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 10:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:35.878387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14c93d-12bb-471c-8b8c-96c37a4ff95b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:35.878861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14c93d-12bb-471c-8b8c-96c37a4ff95b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:35.878974 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14c93d-12bb-471c-8b8c-96c37a4ff95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:35.956887 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7e14c93d-12bb-471c-8b8c-96c37a4ff95b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:35.958116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7e14c93d-12bb-471c-8b8c-96c37a4ff95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:35.986539 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:36.061312 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 695/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 10:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:36.218456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f805b8-9187-4b18-8cea-f2366c9b3b0f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:36.219966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b1f805b8-9187-4b18-8cea-f2366c9b3b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:36.371739 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f805b8-9187-4b18-8cea-f2366c9b3b0f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:36.412410 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:36.524728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7b2ce-34a2-461f-8f58-eb71662e2b13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:36.525556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7b2ce-34a2-461f-8f58-eb71662e2b13 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:36.525986 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7b2ce-34a2-461f-8f58-eb71662e2b13 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:36.526411 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7b2ce-34a2-461f-8f58-eb71662e2b13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:36.529125 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-18b7b2ce-34a2-461f-8f58-eb71662e2b13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:36.647197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7b2ce-34a2-461f-8f58-eb71662e2b13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:36.648858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7b2ce-34a2-461f-8f58-eb71662e2b13 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:36.667433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 724/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:18:37.570298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b632a-59e9-4b57-86c0-2bdd9e021170 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:37.570836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b632a-59e9-4b57-86c0-2bdd9e021170 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:37.570836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b632a-59e9-4b57-86c0-2bdd9e021170 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:37.572411 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 696/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 10:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:37.579006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915f5b7-737a-47a8-b01d-92dce6464b13 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:37.579433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915f5b7-737a-47a8-b01d-92dce6464b13 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:37.579600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915f5b7-737a-47a8-b01d-92dce6464b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:37.636341 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:37.660315 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1915f5b7-737a-47a8-b01d-92dce6464b13 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:37.661553 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1915f5b7-737a-47a8-b01d-92dce6464b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:37.759774 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 725/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 10:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:37.913987 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b632a-59e9-4b57-86c0-2bdd9e021170 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:37.915516 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ed3b632a-59e9-4b57-86c0-2bdd9e021170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:38.065892 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b632a-59e9-4b57-86c0-2bdd9e021170 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:38.078469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:38.182786 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd759383-30dc-4daa-ad04-3f6322870b75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:38.183415 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd759383-30dc-4daa-ad04-3f6322870b75 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:38.183698 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd759383-30dc-4daa-ad04-3f6322870b75 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:38.183978 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd759383-30dc-4daa-ad04-3f6322870b75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:38.186004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-bd759383-30dc-4daa-ad04-3f6322870b75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:38.277281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd759383-30dc-4daa-ad04-3f6322870b75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:38.279583 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd759383-30dc-4daa-ad04-3f6322870b75 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:38.298970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 697/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:18:39.175747 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2137142-25cb-4901-abcc-10f66359491d None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:39.176369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2137142-25cb-4901-abcc-10f66359491d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:39.176469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2137142-25cb-4901-abcc-10f66359491d None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:39.177852 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 726/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 10:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:39.182824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc3114-3377-4249-bc78-59f05b95823e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:39.183281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc3114-3377-4249-bc78-59f05b95823e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:39.183389 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc3114-3377-4249-bc78-59f05b95823e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:39.204327 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:39.262259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-19fc3114-3377-4249-bc78-59f05b95823e None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:39.264331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-19fc3114-3377-4249-bc78-59f05b95823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:39.364531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 698/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 10:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:39.518255 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2137142-25cb-4901-abcc-10f66359491d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:39.519813 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a2137142-25cb-4901-abcc-10f66359491d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:39.632929 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:39.671634 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2137142-25cb-4901-abcc-10f66359491d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:39.787570 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1f2e5-c860-427b-a977-ead6cef128df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:39.788134 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1f2e5-c860-427b-a977-ead6cef128df service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:39.788453 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1f2e5-c860-427b-a977-ead6cef128df service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:39.788733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1f2e5-c860-427b-a977-ead6cef128df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:39.790391 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-fca1f2e5-c860-427b-a977-ead6cef128df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:39.872548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:39.892045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1f2e5-c860-427b-a977-ead6cef128df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:39.892045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1f2e5-c860-427b-a977-ead6cef128df service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:39.909095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 727/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:18:40.788007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a088f82-9eab-4b14-be8a-9e20531f0112 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:40.788687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a088f82-9eab-4b14-be8a-9e20531f0112 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:40.788687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a088f82-9eab-4b14-be8a-9e20531f0112 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:40.789959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 699/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 10:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:18:40.794977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71299fc3-c545-4b97-b178-f20290c0f3ac None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:40.795452 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71299fc3-c545-4b97-b178-f20290c0f3ac None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:40.795549 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71299fc3-c545-4b97-b178-f20290c0f3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:40.875226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-71299fc3-c545-4b97-b178-f20290c0f3ac None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:40.876380 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-71299fc3-c545-4b97-b178-f20290c0f3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:40.975718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 728/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 10:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:41.128525 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a088f82-9eab-4b14-be8a-9e20531f0112 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:41.130001 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0a088f82-9eab-4b14-be8a-9e20531f0112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:41.215084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:41.278794 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a088f82-9eab-4b14-be8a-9e20531f0112 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:41.394789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ce869-6e32-40b8-a66a-0c8eb25f1102 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:41.395323 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ce869-6e32-40b8-a66a-0c8eb25f1102 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:41.395604 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ce869-6e32-40b8-a66a-0c8eb25f1102 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:41.395878 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ce869-6e32-40b8-a66a-0c8eb25f1102 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:41.397532 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8c3ce869-6e32-40b8-a66a-0c8eb25f1102 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:41.449318 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:41.492436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ce869-6e32-40b8-a66a-0c8eb25f1102 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:41.494065 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ce869-6e32-40b8-a66a-0c8eb25f1102 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:41.513684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 700/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:18:42.332490 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35d793-71d8-4004-8e6e-1ed569d57c9a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:42.333068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35d793-71d8-4004-8e6e-1ed569d57c9a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:42.333068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35d793-71d8-4004-8e6e-1ed569d57c9a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:42.334458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 729/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 10:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:42.339440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c3e31-bae3-4c68-9962-e059cbf5d9a9 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:42.339868 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c3e31-bae3-4c68-9962-e059cbf5d9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:42.339981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c3e31-bae3-4c68-9962-e059cbf5d9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:42.417824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d30c3e31-bae3-4c68-9962-e059cbf5d9a9 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:42.419663 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d30c3e31-bae3-4c68-9962-e059cbf5d9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:42.519523 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 701/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 10:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:42.673176 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35d793-71d8-4004-8e6e-1ed569d57c9a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:42.674707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-dd35d793-71d8-4004-8e6e-1ed569d57c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:42.725157 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:42.828150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35d793-71d8-4004-8e6e-1ed569d57c9a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:42.946340 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731129d-c513-41c2-9796-1680f25cdcc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:42.946882 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731129d-c513-41c2-9796-1680f25cdcc1 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:42.947167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731129d-c513-41c2-9796-1680f25cdcc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:42.947443 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731129d-c513-41c2-9796-1680f25cdcc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:42.949131 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2731129d-c513-41c2-9796-1680f25cdcc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:42.956399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:43.043813 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731129d-c513-41c2-9796-1680f25cdcc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:43.045543 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731129d-c513-41c2-9796-1680f25cdcc1 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:43.063498 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 730/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:18:43.899280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96912b-19bb-407a-99e3-fba628dc960e None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:43.899814 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96912b-19bb-407a-99e3-fba628dc960e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:43.899814 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96912b-19bb-407a-99e3-fba628dc960e None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:43.901150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 702/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 10:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:18:43.906788 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cea38-9104-48c2-8919-56647197679f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:43.907204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cea38-9104-48c2-8919-56647197679f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:43.907388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cea38-9104-48c2-8919-56647197679f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:43.987555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8b8cea38-9104-48c2-8919-56647197679f None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:43.988827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8b8cea38-9104-48c2-8919-56647197679f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:44.060601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:44.091533 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 731/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 10:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:44.248439 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96912b-19bb-407a-99e3-fba628dc960e None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:44.249916 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-db96912b-19bb-407a-99e3-fba628dc960e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:44.275269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:44.530959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96912b-19bb-407a-99e3-fba628dc960e None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:44.621552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:44.650346 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de68748-94fc-435d-bf91-8fe9555b188e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:44.651081 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de68748-94fc-435d-bf91-8fe9555b188e service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:44.651429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de68748-94fc-435d-bf91-8fe9555b188e service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:44.651730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de68748-94fc-435d-bf91-8fe9555b188e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:44.654396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5de68748-94fc-435d-bf91-8fe9555b188e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:44.750506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de68748-94fc-435d-bf91-8fe9555b188e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:44.752141 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de68748-94fc-435d-bf91-8fe9555b188e service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:44.772094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 703/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:18:45.592135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557ce53-f67a-4b18-9858-6d9619645d56 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:45.592794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557ce53-f67a-4b18-9858-6d9619645d56 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:45.592794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557ce53-f67a-4b18-9858-6d9619645d56 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:45.594064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 732/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 10:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:45.599443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a237c39-8211-4deb-898b-b93b050cbe3b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:45.599854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a237c39-8211-4deb-898b-b93b050cbe3b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:45.600010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a237c39-8211-4deb-898b-b93b050cbe3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:45.681803 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9a237c39-8211-4deb-898b-b93b050cbe3b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:45.683043 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9a237c39-8211-4deb-898b-b93b050cbe3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:45.728533 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:45.790515 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 704/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 10:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:45.941839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557ce53-f67a-4b18-9858-6d9619645d56 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:45.943660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f557ce53-f67a-4b18-9858-6d9619645d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:46.091724 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557ce53-f67a-4b18-9858-6d9619645d56 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:46.146664 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:46.209192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f50a87-a202-4664-a7f0-5e9aad098438 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:46.209819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f50a87-a202-4664-a7f0-5e9aad098438 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:46.210100 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f50a87-a202-4664-a7f0-5e9aad098438 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:46.210373 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f50a87-a202-4664-a7f0-5e9aad098438 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:46.212013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f1f50a87-a202-4664-a7f0-5e9aad098438 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:46.308347 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f50a87-a202-4664-a7f0-5e9aad098438 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:46.310537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f50a87-a202-4664-a7f0-5e9aad098438 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:46.329679 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 733/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:18:47.141572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aab306-82e5-460e-9c36-0d0e0d9926c5 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:47.142147 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aab306-82e5-460e-9c36-0d0e0d9926c5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:47.142147 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aab306-82e5-460e-9c36-0d0e0d9926c5 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:47.143481 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 705/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 10:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:47.148970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9570f-a9f3-4679-8925-26588306b2ca None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:47.149483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9570f-a9f3-4679-8925-26588306b2ca None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:47.149589 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9570f-a9f3-4679-8925-26588306b2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:47.228317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-ffa9570f-a9f3-4679-8925-26588306b2ca None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:47.229536 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ffa9570f-a9f3-4679-8925-26588306b2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:47.232383 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:47.333417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 734/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 10:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:47.488973 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aab306-82e5-460e-9c36-0d0e0d9926c5 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:47.490483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-13aab306-82e5-460e-9c36-0d0e0d9926c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:47.647015 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aab306-82e5-460e-9c36-0d0e0d9926c5 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:47.676813 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:47.770258 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fbd25-27bc-483d-9f42-4fb7a1a66a55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:47.770885 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fbd25-27bc-483d-9f42-4fb7a1a66a55 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:47.771174 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fbd25-27bc-483d-9f42-4fb7a1a66a55 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:47.771449 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fbd25-27bc-483d-9f42-4fb7a1a66a55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:47.773215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-de9fbd25-27bc-483d-9f42-4fb7a1a66a55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:47.870014 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fbd25-27bc-483d-9f42-4fb7a1a66a55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:47.871795 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fbd25-27bc-483d-9f42-4fb7a1a66a55 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:47.891139 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 706/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:18:49.790980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465e0d9-f548-4303-b05c-0a7ee887b84c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:49.791490 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465e0d9-f548-4303-b05c-0a7ee887b84c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:49.791490 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465e0d9-f548-4303-b05c-0a7ee887b84c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:49.792825 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 735/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 10:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:49.798813 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358e0fe-67c1-4925-943e-d1502862f4a9 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:49.799265 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358e0fe-67c1-4925-943e-d1502862f4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:49.799371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358e0fe-67c1-4925-943e-d1502862f4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:49.841505 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:49.867166 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-0358e0fe-67c1-4925-943e-d1502862f4a9 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:49.868410 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0358e0fe-67c1-4925-943e-d1502862f4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:49.966545 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 707/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 10:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:50.009064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465e0d9-f548-4303-b05c-0a7ee887b84c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:50.010754 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f465e0d9-f548-4303-b05c-0a7ee887b84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:50.119540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465e0d9-f548-4303-b05c-0a7ee887b84c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:50.150433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:50.191680 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05c42d-6bd5-40aa-86e0-c9f6af0da1c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:50.192325 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05c42d-6bd5-40aa-86e0-c9f6af0da1c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:50.192604 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05c42d-6bd5-40aa-86e0-c9f6af0da1c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:50.192874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05c42d-6bd5-40aa-86e0-c9f6af0da1c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:50.194740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-fb05c42d-6bd5-40aa-86e0-c9f6af0da1c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:50.301809 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05c42d-6bd5-40aa-86e0-c9f6af0da1c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:50.303256 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05c42d-6bd5-40aa-86e0-c9f6af0da1c6 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:50.321794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 736/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:18:52.520887 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9e52a-4200-4331-bfc1-b7ade18758f0 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:52.521424 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9e52a-4200-4331-bfc1-b7ade18758f0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:52.521424 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9e52a-4200-4331-bfc1-b7ade18758f0 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:52.522698 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 708/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 10:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:52.528482 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03040649-4b4e-426d-a861-edec6ea27b4b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:52.528982 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03040649-4b4e-426d-a861-edec6ea27b4b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:52.529152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03040649-4b4e-426d-a861-edec6ea27b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:52.607913 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-03040649-4b4e-426d-a861-edec6ea27b4b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:52.609170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-03040649-4b4e-426d-a861-edec6ea27b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:52.622248 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:52.710441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 737/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 10:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:52.751204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9e52a-4200-4331-bfc1-b7ade18758f0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:52.752758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-66b9e52a-4200-4331-bfc1-b7ade18758f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:52.855092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9e52a-4200-4331-bfc1-b7ade18758f0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:52.867780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:52.930011 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e3e28-d855-4abb-8a3c-24d15fc6cabd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:52.930661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e3e28-d855-4abb-8a3c-24d15fc6cabd service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:52.930936 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e3e28-d855-4abb-8a3c-24d15fc6cabd service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:52.931206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e3e28-d855-4abb-8a3c-24d15fc6cabd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:52.932836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1b0e3e28-d855-4abb-8a3c-24d15fc6cabd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:53.040443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e3e28-d855-4abb-8a3c-24d15fc6cabd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:53.041914 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e3e28-d855-4abb-8a3c-24d15fc6cabd service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:53.062485 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 709/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:18:55.534101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a4556-1874-414d-9543-8ede56ee5cd3 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:55.534683 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a4556-1874-414d-9543-8ede56ee5cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:55.534683 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a4556-1874-414d-9543-8ede56ee5cd3 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:55.536023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 738/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 10:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:55.541618 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0362f44-58fe-4bfb-888e-a2954ea62343 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:55.542047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0362f44-58fe-4bfb-888e-a2954ea62343 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:55.542221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0362f44-58fe-4bfb-888e-a2954ea62343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:55.594756 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:55.619120 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d0362f44-58fe-4bfb-888e-a2954ea62343 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:55.620381 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d0362f44-58fe-4bfb-888e-a2954ea62343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:55.725924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 710/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 10:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:55.766312 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a4556-1874-414d-9543-8ede56ee5cd3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:55.767856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-444a4556-1874-414d-9543-8ede56ee5cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:55.879647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a4556-1874-414d-9543-8ede56ee5cd3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:55.922243 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:55.959690 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4c721-cc94-4071-8e89-3a190df4f530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:55.960351 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4c721-cc94-4071-8e89-3a190df4f530 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:55.960634 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4c721-cc94-4071-8e89-3a190df4f530 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:55.960910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4c721-cc94-4071-8e89-3a190df4f530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:55.962532 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-72c4c721-cc94-4071-8e89-3a190df4f530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:56.072376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4c721-cc94-4071-8e89-3a190df4f530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:56.073828 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4c721-cc94-4071-8e89-3a190df4f530 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:56.093124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 739/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:18:58.242443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c47fb0-b7ea-4bab-bf85-36bc9e2b44e8 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:58.243042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c47fb0-b7ea-4bab-bf85-36bc9e2b44e8 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:58.243042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c47fb0-b7ea-4bab-bf85-36bc9e2b44e8 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:58.244415 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 711/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 10:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:18:58.251724 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53805c3-41eb-4988-ba37-42f616cf2ba0 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:58.252272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53805c3-41eb-4988-ba37-42f616cf2ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:58.252373 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53805c3-41eb-4988-ba37-42f616cf2ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:58.348940 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c53805c3-41eb-4988-ba37-42f616cf2ba0 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:18:58.350822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c53805c3-41eb-4988-ba37-42f616cf2ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:58.383909 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:58.480798 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 740/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 10:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:18:58.539304 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c47fb0-b7ea-4bab-bf85-36bc9e2b44e8 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:18:58.540914 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d7c47fb0-b7ea-4bab-bf85-36bc9e2b44e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:58.656191 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c47fb0-b7ea-4bab-bf85-36bc9e2b44e8 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:18:58.678883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:18:58.752087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568570f-cadc-4141-b140-33698c5bbc46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:18:58.752743 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568570f-cadc-4141-b140-33698c5bbc46 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:18:58.753036 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568570f-cadc-4141-b140-33698c5bbc46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:18:58.753300 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568570f-cadc-4141-b140-33698c5bbc46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:18:58.754956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0568570f-cadc-4141-b140-33698c5bbc46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:18:58.904412 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568570f-cadc-4141-b140-33698c5bbc46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:18:58.906571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568570f-cadc-4141-b140-33698c5bbc46 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:18:58.930536 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 712/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:19:01.085545 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ff323-9eda-44d4-83d3-b56e06a89705 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:01.086080 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ff323-9eda-44d4-83d3-b56e06a89705 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:01.086080 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ff323-9eda-44d4-83d3-b56e06a89705 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:01.087433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 741/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 10:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:19:01.093100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364822b-4670-4874-834c-a5a2eae9cf69 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:01.093539 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364822b-4670-4874-834c-a5a2eae9cf69 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:01.093696 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364822b-4670-4874-834c-a5a2eae9cf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:01.160411 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:01.163131 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7364822b-4670-4874-834c-a5a2eae9cf69 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:19:01.164904 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7364822b-4670-4874-834c-a5a2eae9cf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:01.263147 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 713/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 10:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:19:01.321729 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ff323-9eda-44d4-83d3-b56e06a89705 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:19:01.324312 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-554ff323-9eda-44d4-83d3-b56e06a89705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:01.430840 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ff323-9eda-44d4-83d3-b56e06a89705 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:19:01.480312 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:01.505691 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c75a8e-fc76-417f-9a8a-a3a096c4ced6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:19:01.506320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c75a8e-fc76-417f-9a8a-a3a096c4ced6 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:01.506602 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c75a8e-fc76-417f-9a8a-a3a096c4ced6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:01.506879 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c75a8e-fc76-417f-9a8a-a3a096c4ced6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:01.508570 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-30c75a8e-fc76-417f-9a8a-a3a096c4ced6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:01.624628 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c75a8e-fc76-417f-9a8a-a3a096c4ced6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:19:01.626095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c75a8e-fc76-417f-9a8a-a3a096c4ced6 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:19:01.646527 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 742/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:19:03.838337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b68aa-67c8-459a-afae-5e8cd69df0af None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:03.838891 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b68aa-67c8-459a-afae-5e8cd69df0af None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:03.838990 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b68aa-67c8-459a-afae-5e8cd69df0af None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:03.840359 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 714/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 10:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:19:03.847785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54600ae-7c36-41e3-9ff4-72c29bf375e7 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:03.848330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54600ae-7c36-41e3-9ff4-72c29bf375e7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:03.848441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54600ae-7c36-41e3-9ff4-72c29bf375e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:03.913699 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e54600ae-7c36-41e3-9ff4-72c29bf375e7 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:19:03.914834 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e54600ae-7c36-41e3-9ff4-72c29bf375e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:03.944784 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:04.018265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 743/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 10:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:19:04.058014 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b68aa-67c8-459a-afae-5e8cd69df0af None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:19:04.059583 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0e5b68aa-67c8-459a-afae-5e8cd69df0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:04.165525 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b68aa-67c8-459a-afae-5e8cd69df0af None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:19:04.193102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:04.238322 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4cabd-c220-4e3f-98f6-02a7578221a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:19:04.238917 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4cabd-c220-4e3f-98f6-02a7578221a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:04.239206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4cabd-c220-4e3f-98f6-02a7578221a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:04.239480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4cabd-c220-4e3f-98f6-02a7578221a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:04.242290 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c1c4cabd-c220-4e3f-98f6-02a7578221a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:04.361137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4cabd-c220-4e3f-98f6-02a7578221a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:19:04.362607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4cabd-c220-4e3f-98f6-02a7578221a7 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:19:04.380997 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 715/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:19:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:19:06.453756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cffbb1-77f9-4ed9-8bcc-bc5bbd21554f None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:06.454299 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cffbb1-77f9-4ed9-8bcc-bc5bbd21554f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:06.454299 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cffbb1-77f9-4ed9-8bcc-bc5bbd21554f None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:06.455641 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 744/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 10:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:19:06.461073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972169d-fdc7-49b8-b0b5-f5f3ad301c1b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:06.461499 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972169d-fdc7-49b8-b0b5-f5f3ad301c1b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:06.461656 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972169d-fdc7-49b8-b0b5-f5f3ad301c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:06.527018 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7972169d-fdc7-49b8-b0b5-f5f3ad301c1b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:19:06.528258 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7972169d-fdc7-49b8-b0b5-f5f3ad301c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:06.537431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:06.627913 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 716/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 10:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:19:06.666491 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cffbb1-77f9-4ed9-8bcc-bc5bbd21554f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:19:06.668021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-80cffbb1-77f9-4ed9-8bcc-bc5bbd21554f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:06.782553 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cffbb1-77f9-4ed9-8bcc-bc5bbd21554f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:19:06.845950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:06.865486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01d2bc-26fc-4209-acee-79c1e3f2d29b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:19:06.866116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01d2bc-26fc-4209-acee-79c1e3f2d29b service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:06.866399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01d2bc-26fc-4209-acee-79c1e3f2d29b service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:06.866676 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01d2bc-26fc-4209-acee-79c1e3f2d29b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:06.868375 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ab01d2bc-26fc-4209-acee-79c1e3f2d29b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:06.985487 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01d2bc-26fc-4209-acee-79c1e3f2d29b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:19:06.986970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01d2bc-26fc-4209-acee-79c1e3f2d29b service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:19:07.006928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 745/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:19:09.146840 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52308408-b8c6-4b0d-a48e-03d733b76d0e None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:09.147405 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52308408-b8c6-4b0d-a48e-03d733b76d0e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:09.147405 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52308408-b8c6-4b0d-a48e-03d733b76d0e None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:09.148834 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 717/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 10:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:19:09.154072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3645b0e-b572-44a3-9298-d07460e4b8f4 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:09.154483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3645b0e-b572-44a3-9298-d07460e4b8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:09.154825 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3645b0e-b572-44a3-9298-d07460e4b8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:09.220079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b3645b0e-b572-44a3-9298-d07460e4b8f4 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:19:09.221320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b3645b0e-b572-44a3-9298-d07460e4b8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:09.261248 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:09.334244 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 746/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 10:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:19:09.372740 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52308408-b8c6-4b0d-a48e-03d733b76d0e None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:19:09.375100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-52308408-b8c6-4b0d-a48e-03d733b76d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:09.479062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52308408-b8c6-4b0d-a48e-03d733b76d0e None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:19:09.518234 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:09.554882 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b6b38-4daf-474b-b6b2-738b01939fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:19:09.555502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b6b38-4daf-474b-b6b2-738b01939fbd service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:09.555784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b6b38-4daf-474b-b6b2-738b01939fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:09.556061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b6b38-4daf-474b-b6b2-738b01939fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:09.557722 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-528b6b38-4daf-474b-b6b2-738b01939fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:09.676263 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b6b38-4daf-474b-b6b2-738b01939fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:19:09.677709 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b6b38-4daf-474b-b6b2-738b01939fbd service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:19:09.698957 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 718/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:19:11.870898 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba73fb4-444d-4a1c-a322-d541bd39ecd3 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:11.871526 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba73fb4-444d-4a1c-a322-d541bd39ecd3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:11.871526 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba73fb4-444d-4a1c-a322-d541bd39ecd3 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:11.872895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 747/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 10:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:19:11.878791 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e1a40-5a25-4cd7-8f60-608121988916 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:11.879250 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e1a40-5a25-4cd7-8f60-608121988916 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:11.879369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e1a40-5a25-4cd7-8f60-608121988916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:11.945198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3b1e1a40-5a25-4cd7-8f60-608121988916 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:19:11.946401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3b1e1a40-5a25-4cd7-8f60-608121988916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:11.965684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:12.046119 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 719/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 10:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:19:12.083306 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba73fb4-444d-4a1c-a322-d541bd39ecd3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:19:12.084884 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-bba73fb4-444d-4a1c-a322-d541bd39ecd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:12.189725 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba73fb4-444d-4a1c-a322-d541bd39ecd3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:19:12.256328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:12.263501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cbf38-ed23-4ff9-9b9f-7ea85eccfd0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:19:12.264636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cbf38-ed23-4ff9-9b9f-7ea85eccfd0c service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:12.265034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cbf38-ed23-4ff9-9b9f-7ea85eccfd0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:12.265315 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cbf38-ed23-4ff9-9b9f-7ea85eccfd0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:12.266990 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-068cbf38-ed23-4ff9-9b9f-7ea85eccfd0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:12.389895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cbf38-ed23-4ff9-9b9f-7ea85eccfd0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:19:12.392105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cbf38-ed23-4ff9-9b9f-7ea85eccfd0c service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:19:12.411282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 748/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:19:14.432276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80045973-d72b-4540-8404-6b421fea113a None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:14.432846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80045973-d72b-4540-8404-6b421fea113a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:14.432846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80045973-d72b-4540-8404-6b421fea113a None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:14.434253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 720/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 10:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:19:14.440472 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad3d46-3655-409a-910b-bda0b9ff1f88 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:14.440922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad3d46-3655-409a-910b-bda0b9ff1f88 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:14.441023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad3d46-3655-409a-910b-bda0b9ff1f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:14.506649 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-57ad3d46-3655-409a-910b-bda0b9ff1f88 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:19:14.507860 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-57ad3d46-3655-409a-910b-bda0b9ff1f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:14.556495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:14.604955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 749/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 10:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:19:14.645014 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80045973-d72b-4540-8404-6b421fea113a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:19:14.646774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-80045973-d72b-4540-8404-6b421fea113a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:14.767243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80045973-d72b-4540-8404-6b421fea113a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:19:14.824500 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:14.855600 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579002a1-f432-4a6e-939a-55c7bbd590cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:19:14.856258 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579002a1-f432-4a6e-939a-55c7bbd590cd service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:14.856544 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579002a1-f432-4a6e-939a-55c7bbd590cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:14.856824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579002a1-f432-4a6e-939a-55c7bbd590cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:14.859042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-579002a1-f432-4a6e-939a-55c7bbd590cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:14.986344 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579002a1-f432-4a6e-939a-55c7bbd590cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:19:14.987777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579002a1-f432-4a6e-939a-55c7bbd590cd service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:19:15.005973 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 721/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:19:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:19:24.602739 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=22 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:25.003790 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=66 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:34.873418 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71025a-3052-4aca-a719-573d77634e47 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:34.873935 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71025a-3052-4aca-a719-573d77634e47 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:34.874080 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71025a-3052-4aca-a719-573d77634e47 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:34.875472 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 750/1471] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:19:34.880894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6387c5-5230-44a5-833f-ba311997aa6a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:34.881360 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6387c5-5230-44a5-833f-ba311997aa6a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:34.881518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6387c5-5230-44a5-833f-ba311997aa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:34.950275 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3e6387c5-5230-44a5-833f-ba311997aa6a None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:19:34.952377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3e6387c5-5230-44a5-833f-ba311997aa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:35.050198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 722/1472] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:19:35.135852 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322df989-9134-4699-a44e-81dd60ea2c94 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:35.136139 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322df989-9134-4699-a44e-81dd60ea2c94 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:35.136454 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322df989-9134-4699-a44e-81dd60ea2c94 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:35.137950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 751/1473] 10.222.0.48 () {54 vars in 966 bytes} [Thu Aug 4 10:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:19:35.143392 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca81c1-a0ea-48d8-9d30-242e1c7a30ba None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:35.143680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca81c1-a0ea-48d8-9d30-242e1c7a30ba None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:35.143956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca81c1-a0ea-48d8-9d30-242e1c7a30ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:35.220848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-07ca81c1-a0ea-48d8-9d30-242e1c7a30ba None None] MFA Rules not processed for user `0dc15e64c987488f812d1cdd0c82c7ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:19:35.222182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-07ca81c1-a0ea-48d8-9d30-242e1c7a30ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:35.244377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:35.300765 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 723/1474] 10.222.0.48 () {58 vars in 1063 bytes} [Thu Aug 4 10:19:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:19:35.308273 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322df989-9134-4699-a44e-81dd60ea2c94 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:19:35.309788 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-322df989-9134-4699-a44e-81dd60ea2c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:35.414894 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322df989-9134-4699-a44e-81dd60ea2c94 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:19:35.489183 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c33c5-0917-4f58-bcd7-1a63605be8fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc15e64c987488f812d1cdd0c82c7ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:19:35.489806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c33c5-0917-4f58-bcd7-1a63605be8fa service glance] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:35.490091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c33c5-0917-4f58-bcd7-1a63605be8fa service glance] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:35.490369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c33c5-0917-4f58-bcd7-1a63605be8fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:35.492045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-607c33c5-0917-4f58-bcd7-1a63605be8fa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:35.547433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:35.603007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c33c5-0917-4f58-bcd7-1a63605be8fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:19:35.604516 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c33c5-0917-4f58-bcd7-1a63605be8fa service glance] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:19:35.626123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 752/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:19:38.031922 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e10c6-7780-49f9-a1c0-2bc0e7aca97d None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:38.032494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e10c6-7780-49f9-a1c0-2bc0e7aca97d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:38.032615 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e10c6-7780-49f9-a1c0-2bc0e7aca97d None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:38.033929 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 724/1476] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:19:38.039164 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e3f3d-f8fc-42e9-a33d-35913dbe83f2 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:38.039599 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e3f3d-f8fc-42e9-a33d-35913dbe83f2 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:38.039731 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e3f3d-f8fc-42e9-a33d-35913dbe83f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:38.105922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e76e3f3d-f8fc-42e9-a33d-35913dbe83f2 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:19:38.107141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e76e3f3d-f8fc-42e9-a33d-35913dbe83f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:38.203233 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 753/1477] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:19:38.225719 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e10c6-7780-49f9-a1c0-2bc0e7aca97d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:19:38.227224 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d47e10c6-7780-49f9-a1c0-2bc0e7aca97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:38.357892 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e10c6-7780-49f9-a1c0-2bc0e7aca97d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:19:38.407507 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:38.454998 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98d3f9-ca39-4911-abe7-446e71a840d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:19:38.455626 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98d3f9-ca39-4911-abe7-446e71a840d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:38.455911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98d3f9-ca39-4911-abe7-446e71a840d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:38.456216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98d3f9-ca39-4911-abe7-446e71a840d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:38.456921 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98d3f9-ca39-4911-abe7-446e71a840d6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:19:38.458687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: WARNING py.warnings [None req-7b98d3f9-ca39-4911-abe7-446e71a840d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:19:38.458687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: warnings.warn(msg) Aug 04 10:19:38.458687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: Aug 04 10:19:38.459839 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98d3f9-ca39-4911-abe7-446e71a840d6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:19:38.480588 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 725/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Aug 4 10:19:38 2022] GET /identity/v3/projects => generated 2553 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:19:40.578736 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39816d-a06a-4cbd-9997-823d5d8d68ce None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:40.579328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39816d-a06a-4cbd-9997-823d5d8d68ce None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:40.579328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39816d-a06a-4cbd-9997-823d5d8d68ce None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:40.580740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 754/1479] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:19:40.586369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a00981-b819-4e45-a462-0dc9e7422e0c None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:40.586936 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a00981-b819-4e45-a462-0dc9e7422e0c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:40.586936 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a00981-b819-4e45-a462-0dc9e7422e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:40.681613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-f8a00981-b819-4e45-a462-0dc9e7422e0c None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:19:40.683299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f8a00981-b819-4e45-a462-0dc9e7422e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:40.825069 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 726/1480] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:19:40.875632 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39816d-a06a-4cbd-9997-823d5d8d68ce None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:19:40.878568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5e39816d-a06a-4cbd-9997-823d5d8d68ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:40.891220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:41.054880 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39816d-a06a-4cbd-9997-823d5d8d68ce None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:19:41.138429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:41.174396 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7e4f6-03f1-41bd-b066-34d8621bcf03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:19:41.175038 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7e4f6-03f1-41bd-b066-34d8621bcf03 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:41.175403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7e4f6-03f1-41bd-b066-34d8621bcf03 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:41.175684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7e4f6-03f1-41bd-b066-34d8621bcf03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:41.177445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-bfe7e4f6-03f1-41bd-b066-34d8621bcf03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:41.272610 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7e4f6-03f1-41bd-b066-34d8621bcf03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:19:41.274239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7e4f6-03f1-41bd-b066-34d8621bcf03 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:19:41.292412 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 755/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:19:43.544645 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac932a-cd9f-4b32-8204-2ca7679862ed None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:43.545822 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac932a-cd9f-4b32-8204-2ca7679862ed None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:43.545822 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac932a-cd9f-4b32-8204-2ca7679862ed None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:43.547081 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 727/1482] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:19:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:19:43.552473 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f71e54-44ae-45a7-9a45-b584e9c4b1d9 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:43.552921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f71e54-44ae-45a7-9a45-b584e9c4b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:43.553022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f71e54-44ae-45a7-9a45-b584e9c4b1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:43.622082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-67f71e54-44ae-45a7-9a45-b584e9c4b1d9 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:19:43.624405 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-67f71e54-44ae-45a7-9a45-b584e9c4b1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:43.672988 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:43.724326 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 756/1483] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:19:43.762744 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac932a-cd9f-4b32-8204-2ca7679862ed None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:19:43.764420 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-40ac932a-cd9f-4b32-8204-2ca7679862ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:43.792811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:43.881833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac932a-cd9f-4b32-8204-2ca7679862ed None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:19:43.956950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72663b9a-5a05-4799-a3b1-ba54dfd08a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:19:43.957575 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72663b9a-5a05-4799-a3b1-ba54dfd08a56 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:43.957858 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72663b9a-5a05-4799-a3b1-ba54dfd08a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:43.958135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72663b9a-5a05-4799-a3b1-ba54dfd08a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:43.959773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-72663b9a-5a05-4799-a3b1-ba54dfd08a56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:44.033891 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:44.069987 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72663b9a-5a05-4799-a3b1-ba54dfd08a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:19:44.071451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72663b9a-5a05-4799-a3b1-ba54dfd08a56 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:19:44.091421 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 728/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:19:46.328407 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b147c3-bfc8-4bce-b00e-3fd8119ae003 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:46.328982 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b147c3-bfc8-4bce-b00e-3fd8119ae003 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:46.328982 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b147c3-bfc8-4bce-b00e-3fd8119ae003 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:46.330311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 757/1485] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:19:46.335960 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818fadd-bb26-45bb-a724-cc8d072f1176 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:46.336476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818fadd-bb26-45bb-a724-cc8d072f1176 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:46.336579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818fadd-bb26-45bb-a724-cc8d072f1176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:46.405982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-f818fadd-bb26-45bb-a724-cc8d072f1176 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:19:46.407212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f818fadd-bb26-45bb-a724-cc8d072f1176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:46.505389 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 729/1486] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:19:46.543834 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b147c3-bfc8-4bce-b00e-3fd8119ae003 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:19:46.546317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-44b147c3-bfc8-4bce-b00e-3fd8119ae003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:46.658393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b147c3-bfc8-4bce-b00e-3fd8119ae003 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:19:46.732941 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:46.734674 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f52e2-cb6a-4b12-8e4c-8eb98bc476c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:19:46.735588 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f52e2-cb6a-4b12-8e4c-8eb98bc476c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:46.736147 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f52e2-cb6a-4b12-8e4c-8eb98bc476c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:46.736578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f52e2-cb6a-4b12-8e4c-8eb98bc476c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:46.738469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-459f52e2-cb6a-4b12-8e4c-8eb98bc476c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:46.867831 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f52e2-cb6a-4b12-8e4c-8eb98bc476c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:19:46.869340 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f52e2-cb6a-4b12-8e4c-8eb98bc476c1 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:19:46.895894 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 758/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:19:49.187953 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da76573-7318-4568-9190-fa3406ecedb0 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:49.188527 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da76573-7318-4568-9190-fa3406ecedb0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:49.188527 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da76573-7318-4568-9190-fa3406ecedb0 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:49.189914 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 730/1488] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:19:49.195653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4037348-ed6d-4262-9ef5-bf017d923bb8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:49.196127 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4037348-ed6d-4262-9ef5-bf017d923bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:49.196265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4037348-ed6d-4262-9ef5-bf017d923bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:49.273372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f4037348-ed6d-4262-9ef5-bf017d923bb8 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:19:49.274609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f4037348-ed6d-4262-9ef5-bf017d923bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:49.331564 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:49.384443 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 759/1489] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:19:49.436012 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da76573-7318-4568-9190-fa3406ecedb0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:19:49.439635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4da76573-7318-4568-9190-fa3406ecedb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:49.511488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:49.591950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da76573-7318-4568-9190-fa3406ecedb0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:19:49.679880 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b89439-eb73-4842-9e7b-6e3bf1d1a7eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:19:49.680560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b89439-eb73-4842-9e7b-6e3bf1d1a7eb service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:49.680844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b89439-eb73-4842-9e7b-6e3bf1d1a7eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:49.681126 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b89439-eb73-4842-9e7b-6e3bf1d1a7eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:49.682832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-55b89439-eb73-4842-9e7b-6e3bf1d1a7eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:49.775294 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:49.813070 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b89439-eb73-4842-9e7b-6e3bf1d1a7eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:19:49.814542 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b89439-eb73-4842-9e7b-6e3bf1d1a7eb service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:19:49.834394 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 731/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:19:52.208654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aae208-79d4-4b4d-9ea4-6d29cd7a6c2a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:52.209237 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aae208-79d4-4b4d-9ea4-6d29cd7a6c2a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:52.209363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aae208-79d4-4b4d-9ea4-6d29cd7a6c2a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:52.211794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 760/1491] 10.222.0.48 () {54 vars in 927 bytes} [Thu Aug 4 10:19:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:19:52.217360 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7305118-d12b-4801-b774-78a39f8334c8 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:52.218049 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7305118-d12b-4801-b774-78a39f8334c8 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:52.218394 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7305118-d12b-4801-b774-78a39f8334c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:52.301595 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d7305118-d12b-4801-b774-78a39f8334c8 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:19:52.302850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d7305118-d12b-4801-b774-78a39f8334c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:52.419134 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 732/1492] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Aug 4 10:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:19:52.465144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aae208-79d4-4b4d-9ea4-6d29cd7a6c2a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:19:52.466615 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-93aae208-79d4-4b4d-9ea4-6d29cd7a6c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:52.591269 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aae208-79d4-4b4d-9ea4-6d29cd7a6c2a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:19:52.688707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f3fec-bbdc-4a26-80ca-833d2ef6a51c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:19:52.689347 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f3fec-bbdc-4a26-80ca-833d2ef6a51c service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:19:52.689633 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f3fec-bbdc-4a26-80ca-833d2ef6a51c service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:19:52.689916 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f3fec-bbdc-4a26-80ca-833d2ef6a51c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:19:52.691691 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3d0f3fec-bbdc-4a26-80ca-833d2ef6a51c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:19:52.702342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:19:52.822055 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f3fec-bbdc-4a26-80ca-833d2ef6a51c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:19:52.823527 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f3fec-bbdc-4a26-80ca-833d2ef6a51c service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:19:52.843959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 761/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:19:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:20:02.417191 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=82 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:20:02.841253 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=50 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:21:12.134941 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ceb791-c462-48aa-8934-288692141779 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:21:12.136304 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ceb791-c462-48aa-8934-288692141779 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:21:12.136304 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ceb791-c462-48aa-8934-288692141779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:21:12.214761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-f8ceb791-c462-48aa-8934-288692141779 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:21:12.215992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f8ceb791-c462-48aa-8934-288692141779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:21:12.314133 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 733/1494] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:21:12.324071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623d61c-3246-4822-a72b-8bfbb336e0bc None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:21:12.324604 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623d61c-3246-4822-a72b-8bfbb336e0bc None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:21:12.324787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623d61c-3246-4822-a72b-8bfbb336e0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:21:12.401734 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8623d61c-3246-4822-a72b-8bfbb336e0bc None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:21:12.402903 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8623d61c-3246-4822-a72b-8bfbb336e0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:21:12.504808 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 762/1495] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:21:12.509461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ceb791-c462-48aa-8934-288692141779 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:21:12.511391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f8ceb791-c462-48aa-8934-288692141779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:21:12.522751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ceb791-c462-48aa-8934-288692141779 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:21:12.584825 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:21:12.618761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c12be-18d7-455a-af5b-abf6a9916038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:21:12.620288 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c12be-18d7-455a-af5b-abf6a9916038 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:21:12.620571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c12be-18d7-455a-af5b-abf6a9916038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:21:12.620846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c12be-18d7-455a-af5b-abf6a9916038 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:21:12.621551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c12be-18d7-455a-af5b-abf6a9916038 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:21:12.621859 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c12be-18d7-455a-af5b-abf6a9916038 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:21:12.622898 dv-cinder-826608-8-smb devstack@keystone.service[80116]: WARNING py.warnings [None req-d81c12be-18d7-455a-af5b-abf6a9916038 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:21:12.622898 dv-cinder-826608-8-smb devstack@keystone.service[80116]: warnings.warn(msg) Aug 04 10:21:12.622898 dv-cinder-826608-8-smb devstack@keystone.service[80116]: Aug 04 10:21:12.623788 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c12be-18d7-455a-af5b-abf6a9916038 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:21:12.635922 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 734/1496] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:21:12.644365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623d61c-3246-4822-a72b-8bfbb336e0bc None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:21:12.654370 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623d61c-3246-4822-a72b-8bfbb336e0bc None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:21:12.716886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:21:12.751505 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c627f-946f-4c6e-b68d-7f4da21301f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:21:12.752129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c627f-946f-4c6e-b68d-7f4da21301f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:21:12.752446 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c627f-946f-4c6e-b68d-7f4da21301f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:21:12.752726 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c627f-946f-4c6e-b68d-7f4da21301f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:21:12.753389 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c627f-946f-4c6e-b68d-7f4da21301f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:21:12.755133 dv-cinder-826608-8-smb devstack@keystone.service[80117]: WARNING py.warnings [None req-5b0c627f-946f-4c6e-b68d-7f4da21301f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:21:12.755133 dv-cinder-826608-8-smb devstack@keystone.service[80117]: warnings.warn(msg) Aug 04 10:21:12.755133 dv-cinder-826608-8-smb devstack@keystone.service[80117]: Aug 04 10:21:12.756364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c627f-946f-4c6e-b68d-7f4da21301f6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:21:12.814360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 763/1497] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:21:12 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:21:12.818700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c12be-18d7-455a-af5b-abf6a9916038 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:21:12.820589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d81c12be-18d7-455a-af5b-abf6a9916038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:21:12.855640 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c12be-18d7-455a-af5b-abf6a9916038 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:21:12.949810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218061d-d501-4b63-8b23-03138545eb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:21:12.950342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218061d-d501-4b63-8b23-03138545eb4f admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:21:12.950624 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218061d-d501-4b63-8b23-03138545eb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:21:12.950897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218061d-d501-4b63-8b23-03138545eb4f admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:21:12.951563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218061d-d501-4b63-8b23-03138545eb4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:21:12.952601 dv-cinder-826608-8-smb devstack@keystone.service[80116]: WARNING py.warnings [None req-d218061d-d501-4b63-8b23-03138545eb4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:21:12.952601 dv-cinder-826608-8-smb devstack@keystone.service[80116]: warnings.warn(msg) Aug 04 10:21:12.952601 dv-cinder-826608-8-smb devstack@keystone.service[80116]: Aug 04 10:21:12.953810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218061d-d501-4b63-8b23-03138545eb4f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:21:12.996712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 735/1498] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:21:12 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:21:13.001126 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c627f-946f-4c6e-b68d-7f4da21301f6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:21:13.002769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5b0c627f-946f-4c6e-b68d-7f4da21301f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:21:13.064466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c627f-946f-4c6e-b68d-7f4da21301f6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:21:13.145485 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:21:13.158111 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fe38e-160d-4e69-8d34-1bc67d3011f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:21:13.158733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fe38e-160d-4e69-8d34-1bc67d3011f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:21:13.159011 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fe38e-160d-4e69-8d34-1bc67d3011f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:21:13.159285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fe38e-160d-4e69-8d34-1bc67d3011f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:21:13.159975 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fe38e-160d-4e69-8d34-1bc67d3011f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:21:13.161033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: WARNING py.warnings [None req-183fe38e-160d-4e69-8d34-1bc67d3011f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:21:13.161033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: warnings.warn(msg) Aug 04 10:21:13.161033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: Aug 04 10:21:13.161924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fe38e-160d-4e69-8d34-1bc67d3011f9 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:21:13.174471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 764/1499] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:21:13.178655 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218061d-d501-4b63-8b23-03138545eb4f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:21:13.180194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d218061d-d501-4b63-8b23-03138545eb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:21:13.192597 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218061d-d501-4b63-8b23-03138545eb4f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:21:13.218619 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:21:13.288507 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c8af3-5e07-4d0c-800e-ea71cb6cf19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:21:13.289129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c8af3-5e07-4d0c-800e-ea71cb6cf19b admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:21:13.289409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c8af3-5e07-4d0c-800e-ea71cb6cf19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:21:13.289676 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c8af3-5e07-4d0c-800e-ea71cb6cf19b admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:21:13.290366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c8af3-5e07-4d0c-800e-ea71cb6cf19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:21:13.291489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: WARNING py.warnings [None req-7f9c8af3-5e07-4d0c-800e-ea71cb6cf19b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:21:13.291489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: warnings.warn(msg) Aug 04 10:21:13.291489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: Aug 04 10:21:13.292620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c8af3-5e07-4d0c-800e-ea71cb6cf19b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:21:13.304969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 736/1500] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:21:13.309807 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fe38e-160d-4e69-8d34-1bc67d3011f9 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:21:13.311348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-183fe38e-160d-4e69-8d34-1bc67d3011f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:21:13.344713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fe38e-160d-4e69-8d34-1bc67d3011f9 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:21:13.441062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae1a22-e3cf-4984-91ca-4026b1505076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:21:13.441748 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae1a22-e3cf-4984-91ca-4026b1505076 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:21:13.442027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae1a22-e3cf-4984-91ca-4026b1505076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:21:13.442302 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae1a22-e3cf-4984-91ca-4026b1505076 admin admin] PATH_INFO: `/v3/projects/6fb7c90c85aa4ab7a4e03e7d0a373bef/users/044865b77835454c93b58acc9088172c/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:21:13.465139 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae1a22-e3cf-4984-91ca-4026b1505076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb7c90c85aa4ab7a4e03e7d0a373bef, user_id=044865b77835454c93b58acc9088172c, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:21:13.466179 dv-cinder-826608-8-smb devstack@keystone.service[80117]: WARNING py.warnings [None req-2eae1a22-e3cf-4984-91ca-4026b1505076 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:21:13.466179 dv-cinder-826608-8-smb devstack@keystone.service[80117]: warnings.warn(msg) Aug 04 10:21:13.466179 dv-cinder-826608-8-smb devstack@keystone.service[80117]: Aug 04 10:21:13.468161 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae1a22-e3cf-4984-91ca-4026b1505076 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:21:13.492493 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 765/1501] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:21:13 2022] PUT /identity/v3/projects/6fb7c90c85aa4ab7a4e03e7d0a373bef/users/044865b77835454c93b58acc9088172c/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:21:13.505398 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586034bf-0c71-4dcd-a4c7-3f642f9ed7ed None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:21:13.505688 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586034bf-0c71-4dcd-a4c7-3f642f9ed7ed None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:21:13.505971 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586034bf-0c71-4dcd-a4c7-3f642f9ed7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:21:13.565353 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-586034bf-0c71-4dcd-a4c7-3f642f9ed7ed None None] MFA Rules not processed for user `044865b77835454c93b58acc9088172c`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:21:13.566572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-586034bf-0c71-4dcd-a4c7-3f642f9ed7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:21:13.648612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 737/1502] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:21:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:21:13.662135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232150e0-0f6f-412a-a6d5-6d6c12f49180 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:21:13.662462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232150e0-0f6f-412a-a6d5-6d6c12f49180 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:21:13.662745 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232150e0-0f6f-412a-a6d5-6d6c12f49180 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:21:13.664097 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 766/1503] 10.222.0.48 () {54 vars in 964 bytes} [Thu Aug 4 10:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:21:13.669824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdb2d7-8ccc-4aa1-8783-6acf2fdad098 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:21:13.670118 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdb2d7-8ccc-4aa1-8783-6acf2fdad098 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:21:13.670400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdb2d7-8ccc-4aa1-8783-6acf2fdad098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:21:13.702813 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:21:13.748957 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-41bdb2d7-8ccc-4aa1-8783-6acf2fdad098 None None] MFA Rules not processed for user `180731bbc26c4681965dfd9cf0c1f063`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:21:13.750127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-41bdb2d7-8ccc-4aa1-8783-6acf2fdad098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:21:13.830700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 738/1504] 10.222.0.48 () {58 vars in 1061 bytes} [Thu Aug 4 10:21:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:21:13.838625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232150e0-0f6f-412a-a6d5-6d6c12f49180 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:21:13.840933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-232150e0-0f6f-412a-a6d5-6d6c12f49180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:21:13.892463 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:21:13.949703 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232150e0-0f6f-412a-a6d5-6d6c12f49180 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:21:14.023071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507ceb6-9dce-4a6e-8dae-40e220c9712c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:21:14.023608 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507ceb6-9dce-4a6e-8dae-40e220c9712c service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:21:14.023909 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507ceb6-9dce-4a6e-8dae-40e220c9712c service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:21:14.024194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507ceb6-9dce-4a6e-8dae-40e220c9712c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:21:14.026524 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e507ceb6-9dce-4a6e-8dae-40e220c9712c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:21:14.126381 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507ceb6-9dce-4a6e-8dae-40e220c9712c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:21:14.127846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507ceb6-9dce-4a6e-8dae-40e220c9712c service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:21:14.131383 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:21:14.146786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 767/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:21:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:21:14.192649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f037a03-ca3e-4671-908a-e2c4851ccc1f None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:21:14.193068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f037a03-ca3e-4671-908a-e2c4851ccc1f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:21:14.193308 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f037a03-ca3e-4671-908a-e2c4851ccc1f None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:21:14.194892 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 739/1506] 10.222.0.48 () {52 vars in 830 bytes} [Thu Aug 4 10:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:21:14.198580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507ceb6-9dce-4a6e-8dae-40e220c9712c service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:21:14.199798 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e507ceb6-9dce-4a6e-8dae-40e220c9712c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:21:14.302006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507ceb6-9dce-4a6e-8dae-40e220c9712c service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:21:14.398645 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347ea93-d196-4870-a37e-2d28a01ab66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:21:14.399446 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347ea93-d196-4870-a37e-2d28a01ab66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:21:14.399559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347ea93-d196-4870-a37e-2d28a01ab66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:21:14.399834 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347ea93-d196-4870-a37e-2d28a01ab66a admin admin] PATH_INFO: `/v3/users/044865b77835454c93b58acc9088172c` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:21:14.412356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347ea93-d196-4870-a37e-2d28a01ab66a admin admin] RBAC: Authorizing `identity:delete_user(user_id=044865b77835454c93b58acc9088172c)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:21:14.413392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: WARNING py.warnings [None req-f347ea93-d196-4870-a37e-2d28a01ab66a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:21:14.413392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: warnings.warn(msg) Aug 04 10:21:14.413392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: Aug 04 10:21:14.414624 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347ea93-d196-4870-a37e-2d28a01ab66a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:21:14.425150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:21:14.483358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f347ea93-d196-4870-a37e-2d28a01ab66a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '044865b77835454c93b58acc9088172c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:21:14.483906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f347ea93-d196-4870-a37e-2d28a01ab66a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '044865b77835454c93b58acc9088172c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:21:14.498569 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f347ea93-d196-4870-a37e-2d28a01ab66a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '044865b77835454c93b58acc9088172c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:21:14.499020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f347ea93-d196-4870-a37e-2d28a01ab66a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '044865b77835454c93b58acc9088172c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:21:14.521677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f347ea93-d196-4870-a37e-2d28a01ab66a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '044865b77835454c93b58acc9088172c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:21:14.536369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 768/1507] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:21:14 2022] DELETE /identity/v3/users/044865b77835454c93b58acc9088172c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:21:14.540856 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d64a8-17c7-42fc-932a-dd622c3dad0a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:21:14.541658 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d64a8-17c7-42fc-932a-dd622c3dad0a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:21:14.542124 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d64a8-17c7-42fc-932a-dd622c3dad0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:21:14.601157 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3c2d64a8-17c7-42fc-932a-dd622c3dad0a None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:21:14.602376 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3c2d64a8-17c7-42fc-932a-dd622c3dad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:21:14.684853 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:21:14.699198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 740/1508] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:21:14.708857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347ea93-d196-4870-a37e-2d28a01ab66a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:21:14.710076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f347ea93-d196-4870-a37e-2d28a01ab66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:21:14.811078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347ea93-d196-4870-a37e-2d28a01ab66a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:21:14.870121 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:21:14.891240 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5b3df-df27-4943-9679-2009e1b36261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:21:14.891876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5b3df-df27-4943-9679-2009e1b36261 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:21:14.892156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5b3df-df27-4943-9679-2009e1b36261 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:21:14.892459 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5b3df-df27-4943-9679-2009e1b36261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:21:14.894121 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0dd5b3df-df27-4943-9679-2009e1b36261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:21:15.001088 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5b3df-df27-4943-9679-2009e1b36261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:21:15.002530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5b3df-df27-4943-9679-2009e1b36261 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:21:15.021441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 769/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:21:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:21:15.373551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d64a8-17c7-42fc-932a-dd622c3dad0a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:21:15.374927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3c2d64a8-17c7-42fc-932a-dd622c3dad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:21:15.386846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d64a8-17c7-42fc-932a-dd622c3dad0a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:21:15.490803 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c3fef-d84b-4f7a-ab54-6afeaeaa11a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:21:15.491458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c3fef-d84b-4f7a-ab54-6afeaeaa11a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:21:15.491745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c3fef-d84b-4f7a-ab54-6afeaeaa11a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:21:15.492026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c3fef-d84b-4f7a-ab54-6afeaeaa11a2 admin admin] PATH_INFO: `/v3/projects/6fb7c90c85aa4ab7a4e03e7d0a373bef` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:21:15.502250 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c3fef-d84b-4f7a-ab54-6afeaeaa11a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb7c90c85aa4ab7a4e03e7d0a373bef)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:21:15.503281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: WARNING py.warnings [None req-ef5c3fef-d84b-4f7a-ab54-6afeaeaa11a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:21:15.503281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: warnings.warn(msg) Aug 04 10:21:15.503281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: Aug 04 10:21:15.504522 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c3fef-d84b-4f7a-ab54-6afeaeaa11a2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:21:15.563945 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ef5c3fef-d84b-4f7a-ab54-6afeaeaa11a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb7c90c85aa4ab7a4e03e7d0a373bef', 'request_id': 'req-ef5c3fef-d84b-4f7a-ab54-6afeaeaa11a2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:21:15.577258 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ef5c3fef-d84b-4f7a-ab54-6afeaeaa11a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb7c90c85aa4ab7a4e03e7d0a373bef', 'request_id': 'req-ef5c3fef-d84b-4f7a-ab54-6afeaeaa11a2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:21:15.586006 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ef5c3fef-d84b-4f7a-ab54-6afeaeaa11a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb7c90c85aa4ab7a4e03e7d0a373bef', 'request_id': 'req-ef5c3fef-d84b-4f7a-ab54-6afeaeaa11a2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:21:15.609960 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ef5c3fef-d84b-4f7a-ab54-6afeaeaa11a2 admin admin] The token cache is being invalidate because project 6fb7c90c85aa4ab7a4e03e7d0a373bef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:21:15.610255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ef5c3fef-d84b-4f7a-ab54-6afeaeaa11a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:21:15.610689 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ef5c3fef-d84b-4f7a-ab54-6afeaeaa11a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:21:15.612160 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 741/1510] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:21:15 2022] DELETE /identity/v3/projects/6fb7c90c85aa4ab7a4e03e7d0a373bef => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:21:25.019241 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=62 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:21:25.607880 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:23:00.314880 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3d45d-3092-4316-95b5-77daf3172f96 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:00.315499 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3d45d-3092-4316-95b5-77daf3172f96 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:00.315499 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3d45d-3092-4316-95b5-77daf3172f96 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:00.316814 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 770/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 10:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:23:00.321958 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18849bce-34f5-4284-a437-9b1133650252 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:00.322434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18849bce-34f5-4284-a437-9b1133650252 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:00.322538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18849bce-34f5-4284-a437-9b1133650252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:00.404910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-18849bce-34f5-4284-a437-9b1133650252 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:23:00.406196 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-18849bce-34f5-4284-a437-9b1133650252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:23:00.513623 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 742/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 10:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:23:00.673853 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3d45d-3092-4316-95b5-77daf3172f96 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:23:00.676019 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c5f3d45d-3092-4316-95b5-77daf3172f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:23:00.799350 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3d45d-3092-4316-95b5-77daf3172f96 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:23:00.805118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f5ae6-257f-4c13-8446-2b9e41dffbd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:23:00.805752 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f5ae6-257f-4c13-8446-2b9e41dffbd5 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:00.806038 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f5ae6-257f-4c13-8446-2b9e41dffbd5 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:00.806339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f5ae6-257f-4c13-8446-2b9e41dffbd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:00.815182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f5ae6-257f-4c13-8446-2b9e41dffbd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:23:00.816849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f5ae6-257f-4c13-8446-2b9e41dffbd5 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:23:00.827279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 771/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:23:01.675889 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d77301-1331-4e3a-8e2c-0e1a9f8dab1a None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:01.676539 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d77301-1331-4e3a-8e2c-0e1a9f8dab1a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:01.676539 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d77301-1331-4e3a-8e2c-0e1a9f8dab1a None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:01.678031 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 743/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 10:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:23:01.682858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1375104-6e77-475b-8fa8-f32df0b49448 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:01.683567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1375104-6e77-475b-8fa8-f32df0b49448 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:01.683567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1375104-6e77-475b-8fa8-f32df0b49448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:01.704661 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f1375104-6e77-475b-8fa8-f32df0b49448 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:23:01.705882 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f1375104-6e77-475b-8fa8-f32df0b49448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:23:01.715229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 772/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 10:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:23:01.874437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d77301-1331-4e3a-8e2c-0e1a9f8dab1a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:23:01.889989 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d77301-1331-4e3a-8e2c-0e1a9f8dab1a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:23:01.895919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f82e47-0965-4b4c-bec9-24b1aade63e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:23:01.897300 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f82e47-0965-4b4c-bec9-24b1aade63e5 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:01.897576 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f82e47-0965-4b4c-bec9-24b1aade63e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:01.897864 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f82e47-0965-4b4c-bec9-24b1aade63e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:01.906854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f82e47-0965-4b4c-bec9-24b1aade63e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:23:01.908583 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f82e47-0965-4b4c-bec9-24b1aade63e5 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:23:01.919425 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 744/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:23:02.430824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310106b-c600-446f-b900-9e63d2f24b48 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:02.431116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310106b-c600-446f-b900-9e63d2f24b48 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:02.431399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310106b-c600-446f-b900-9e63d2f24b48 None None] PATH_INFO: `/v3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:02.432729 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 773/1517] 10.222.0.109 () {54 vars in 926 bytes} [Thu Aug 4 10:23:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:23:02.453610 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb103db4-13c3-40b3-b889-ee632d982644 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:02.453906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb103db4-13c3-40b3-b889-ee632d982644 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:02.454184 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb103db4-13c3-40b3-b889-ee632d982644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:02.513857 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-cb103db4-13c3-40b3-b889-ee632d982644 None None] MFA Rules not processed for user `0005b0c9582e430e9cb85704a4505bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:23:02.515074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cb103db4-13c3-40b3-b889-ee632d982644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:23:02.532035 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:23:02.594083 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 745/1518] 10.222.0.109 () {58 vars in 1016 bytes} [Thu Aug 4 10:23:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:23:11.699498 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=56 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:23:12.152593 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa9b38-a00e-4c27-b3c2-9f2ba3e96602 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:12.152807 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa9b38-a00e-4c27-b3c2-9f2ba3e96602 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:12.153084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa9b38-a00e-4c27-b3c2-9f2ba3e96602 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:12.154439 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 774/1519] 10.222.0.48 () {54 vars in 961 bytes} [Thu Aug 4 10:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:23:12.159680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ce488-bc59-48e6-88aa-c12f1d9f223e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:12.160226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ce488-bc59-48e6-88aa-c12f1d9f223e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:12.160343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ce488-bc59-48e6-88aa-c12f1d9f223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:12.180708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-464ce488-bc59-48e6-88aa-c12f1d9f223e None None] MFA Rules not processed for user `0005b0c9582e430e9cb85704a4505bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:23:12.181938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-464ce488-bc59-48e6-88aa-c12f1d9f223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:23:12.190967 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 746/1520] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Aug 4 10:23:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:23:12.199352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa9b38-a00e-4c27-b3c2-9f2ba3e96602 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:23:12.214277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa9b38-a00e-4c27-b3c2-9f2ba3e96602 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:23:12.220390 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1099dd-1f71-4a98-afc2-461abda63193 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0005b0c9582e430e9cb85704a4505bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:23:12.221034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1099dd-1f71-4a98-afc2-461abda63193 service placement] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:12.221321 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1099dd-1f71-4a98-afc2-461abda63193 service placement] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:12.221601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1099dd-1f71-4a98-afc2-461abda63193 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:12.230891 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1099dd-1f71-4a98-afc2-461abda63193 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:23:12.232565 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1099dd-1f71-4a98-afc2-461abda63193 service placement] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:23:12.243061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 775/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:23:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:23:13.136355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b7103-4295-4101-bd55-bf9b4b10c0be None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:13.136562 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b7103-4295-4101-bd55-bf9b4b10c0be None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:13.136833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b7103-4295-4101-bd55-bf9b4b10c0be None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:13.138221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 747/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 10:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:23:13.143142 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a187df8-8dfc-494a-9e61-d16ac5fb7869 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:13.143635 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a187df8-8dfc-494a-9e61-d16ac5fb7869 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:13.143741 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a187df8-8dfc-494a-9e61-d16ac5fb7869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:13.163765 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6a187df8-8dfc-494a-9e61-d16ac5fb7869 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:23:13.164989 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6a187df8-8dfc-494a-9e61-d16ac5fb7869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:23:13.172866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 776/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 10:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:23:13.330795 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b7103-4295-4101-bd55-bf9b4b10c0be None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:23:13.347311 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b7103-4295-4101-bd55-bf9b4b10c0be None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:23:13.352947 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393faff-85b7-4f95-91ea-d86f657280eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:23:13.353546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393faff-85b7-4f95-91ea-d86f657280eb service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:13.353832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393faff-85b7-4f95-91ea-d86f657280eb service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:13.354112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393faff-85b7-4f95-91ea-d86f657280eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:13.362235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393faff-85b7-4f95-91ea-d86f657280eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:23:13.363826 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393faff-85b7-4f95-91ea-d86f657280eb service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:23:13.374010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 748/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:23:14.218269 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0c2dc-e586-4304-ab5b-396b7a366bde None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:14.218822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0c2dc-e586-4304-ab5b-396b7a366bde None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:14.218822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0c2dc-e586-4304-ab5b-396b7a366bde None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:14.220209 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 777/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 10:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:23:14.225572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69cd69-1231-410e-93d1-62780ca9553f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:14.225857 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69cd69-1231-410e-93d1-62780ca9553f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:14.226131 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69cd69-1231-410e-93d1-62780ca9553f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:14.246272 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ae69cd69-1231-410e-93d1-62780ca9553f None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:23:14.247476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ae69cd69-1231-410e-93d1-62780ca9553f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:23:14.255379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 749/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 10:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:23:14.413173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0c2dc-e586-4304-ab5b-396b7a366bde None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:23:14.428429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0c2dc-e586-4304-ab5b-396b7a366bde None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:23:14.433962 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037c5cd-80cf-4c46-83b9-2daa39dfe685 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:23:14.434582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037c5cd-80cf-4c46-83b9-2daa39dfe685 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:14.434867 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037c5cd-80cf-4c46-83b9-2daa39dfe685 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:14.435143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037c5cd-80cf-4c46-83b9-2daa39dfe685 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:14.443626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037c5cd-80cf-4c46-83b9-2daa39dfe685 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:23:14.445366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037c5cd-80cf-4c46-83b9-2daa39dfe685 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:23:14.454907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 778/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:23:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:23:18.548585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea926fa-7deb-4844-a8f1-539be1e8c87e None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:18.549222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea926fa-7deb-4844-a8f1-539be1e8c87e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:18.549222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea926fa-7deb-4844-a8f1-539be1e8c87e None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:18.550488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 750/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 10:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:23:18.556022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa72e47-7f2e-449f-9b00-83a3b202c7e7 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:18.556483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa72e47-7f2e-449f-9b00-83a3b202c7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:18.556623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa72e47-7f2e-449f-9b00-83a3b202c7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:18.576343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2fa72e47-7f2e-449f-9b00-83a3b202c7e7 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:23:18.577559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2fa72e47-7f2e-449f-9b00-83a3b202c7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:23:18.586507 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 779/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 10:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:23:18.664144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea926fa-7deb-4844-a8f1-539be1e8c87e None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:23:18.665908 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3ea926fa-7deb-4844-a8f1-539be1e8c87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:23:18.745474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea926fa-7deb-4844-a8f1-539be1e8c87e None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:23:18.749124 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694abeb7-ec5d-40cc-9613-caa72fb62b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:23:18.749749 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694abeb7-ec5d-40cc-9613-caa72fb62b14 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:18.750036 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694abeb7-ec5d-40cc-9613-caa72fb62b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:18.750317 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694abeb7-ec5d-40cc-9613-caa72fb62b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:18.759692 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694abeb7-ec5d-40cc-9613-caa72fb62b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:23:18.761153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694abeb7-ec5d-40cc-9613-caa72fb62b14 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:23:18.770712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 751/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:23:20.817409 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df789d-05fd-4213-9d59-ad131c65e088 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:20.818511 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df789d-05fd-4213-9d59-ad131c65e088 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:20.818636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df789d-05fd-4213-9d59-ad131c65e088 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:20.820288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 780/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 10:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:23:20.825501 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3ce0b-b051-43b1-bc19-65b7ac7e0d8b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:20.825964 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3ce0b-b051-43b1-bc19-65b7ac7e0d8b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:20.826081 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3ce0b-b051-43b1-bc19-65b7ac7e0d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:20.845308 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-47c3ce0b-b051-43b1-bc19-65b7ac7e0d8b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:23:20.846511 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-47c3ce0b-b051-43b1-bc19-65b7ac7e0d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:23:20.854383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 752/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:23:20.891951 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df789d-05fd-4213-9d59-ad131c65e088 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:23:20.903015 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df789d-05fd-4213-9d59-ad131c65e088 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:23:20.906554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da4b7f-f3e3-4978-a5a7-0ffd9345b356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:23:20.907169 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da4b7f-f3e3-4978-a5a7-0ffd9345b356 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:20.907453 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da4b7f-f3e3-4978-a5a7-0ffd9345b356 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:20.907743 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da4b7f-f3e3-4978-a5a7-0ffd9345b356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:20.917009 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da4b7f-f3e3-4978-a5a7-0ffd9345b356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:23:20.918455 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da4b7f-f3e3-4978-a5a7-0ffd9345b356 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:23:20.928694 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 781/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:23:24.702272 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de350ba8-bf14-43d1-a4e3-96bb6bfd0760 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:24.702837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de350ba8-bf14-43d1-a4e3-96bb6bfd0760 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:24.702837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de350ba8-bf14-43d1-a4e3-96bb6bfd0760 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:24.704256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 753/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 10:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:23:24.710550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c815df-8297-4a4f-85e4-ca5fdb43e5bb None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:24.711114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c815df-8297-4a4f-85e4-ca5fdb43e5bb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:24.711114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c815df-8297-4a4f-85e4-ca5fdb43e5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:24.731194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-75c815df-8297-4a4f-85e4-ca5fdb43e5bb None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:23:24.732449 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-75c815df-8297-4a4f-85e4-ca5fdb43e5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:23:24.740497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 782/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 10:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:23:25.049206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de350ba8-bf14-43d1-a4e3-96bb6bfd0760 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:23:25.050912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-de350ba8-bf14-43d1-a4e3-96bb6bfd0760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:23:25.118505 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:23:25.132904 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de350ba8-bf14-43d1-a4e3-96bb6bfd0760 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:23:25.136575 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3ba66-8f39-4aa4-8012-6ae31ebe600f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:23:25.137210 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3ba66-8f39-4aa4-8012-6ae31ebe600f service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:25.137493 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3ba66-8f39-4aa4-8012-6ae31ebe600f service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:25.137771 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3ba66-8f39-4aa4-8012-6ae31ebe600f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:25.147752 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3ba66-8f39-4aa4-8012-6ae31ebe600f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:23:25.149240 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3ba66-8f39-4aa4-8012-6ae31ebe600f service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:23:25.158859 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 754/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:23:27.214790 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693358c7-be30-4217-93f5-d6da9c7b81e9 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:27.215379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693358c7-be30-4217-93f5-d6da9c7b81e9 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:27.215379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693358c7-be30-4217-93f5-d6da9c7b81e9 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:27.216738 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 783/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 10:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:23:27.221968 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6761023-1c57-440c-a8d9-81b08395f482 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:27.222431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6761023-1c57-440c-a8d9-81b08395f482 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:27.222535 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6761023-1c57-440c-a8d9-81b08395f482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:27.241709 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d6761023-1c57-440c-a8d9-81b08395f482 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:23:27.242931 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d6761023-1c57-440c-a8d9-81b08395f482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:23:27.250852 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 755/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 10:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:23:27.559642 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693358c7-be30-4217-93f5-d6da9c7b81e9 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:23:27.561362 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-693358c7-be30-4217-93f5-d6da9c7b81e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:23:27.575029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693358c7-be30-4217-93f5-d6da9c7b81e9 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:23:27.578605 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c7f31-9a39-41bb-a121-f934a8d0291e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:23:27.579214 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c7f31-9a39-41bb-a121-f934a8d0291e service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:23:27.579507 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c7f31-9a39-41bb-a121-f934a8d0291e service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:23:27.579783 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c7f31-9a39-41bb-a121-f934a8d0291e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:23:27.588724 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c7f31-9a39-41bb-a121-f934a8d0291e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:23:27.590145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c7f31-9a39-41bb-a121-f934a8d0291e service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:23:27.600324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 784/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:23:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:23:37.236518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=11 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:23:37.595751 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=33 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:05.613928 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92393fc3-ada8-462a-94b2-f151ac2ad694 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:05.619266 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92393fc3-ada8-462a-94b2-f151ac2ad694 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:05.619266 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92393fc3-ada8-462a-94b2-f151ac2ad694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:05.643517 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-92393fc3-ada8-462a-94b2-f151ac2ad694 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:05.645758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-92393fc3-ada8-462a-94b2-f151ac2ad694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:05.659298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 756/1540] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:25:05.670317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e75c0c-3fb9-477b-99fb-aba7cb449180 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:05.670908 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e75c0c-3fb9-477b-99fb-aba7cb449180 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:05.671337 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e75c0c-3fb9-477b-99fb-aba7cb449180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:05.729274 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d3e75c0c-3fb9-477b-99fb-aba7cb449180 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:05.731348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d3e75c0c-3fb9-477b-99fb-aba7cb449180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:05.749347 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 785/1541] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:25:05.753641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92393fc3-ada8-462a-94b2-f151ac2ad694 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:05.770126 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92393fc3-ada8-462a-94b2-f151ac2ad694 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:05.781999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefff3eb-0bc6-48ed-bd9d-234841ec6a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:05.782652 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefff3eb-0bc6-48ed-bd9d-234841ec6a51 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:05.782939 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefff3eb-0bc6-48ed-bd9d-234841ec6a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:05.783217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefff3eb-0bc6-48ed-bd9d-234841ec6a51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:05.783934 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefff3eb-0bc6-48ed-bd9d-234841ec6a51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:25:05.784329 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefff3eb-0bc6-48ed-bd9d-234841ec6a51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:05.786410 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefff3eb-0bc6-48ed-bd9d-234841ec6a51 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:05.787703 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373838d-2155-4ce7-a4df-99d5d942807d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:05.788440 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373838d-2155-4ce7-a4df-99d5d942807d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:05.789858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373838d-2155-4ce7-a4df-99d5d942807d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:05.845151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 757/1542] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:25:05.845379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2373838d-2155-4ce7-a4df-99d5d942807d None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:05.846448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2373838d-2155-4ce7-a4df-99d5d942807d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:05.861246 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefff3eb-0bc6-48ed-bd9d-234841ec6a51 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:05.869686 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 786/1543] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:05.882326 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c16d22-7876-4f5d-a79d-15b229f6b4f3 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:05.882682 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c16d22-7876-4f5d-a79d-15b229f6b4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:05.883009 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c16d22-7876-4f5d-a79d-15b229f6b4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:05.892481 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefff3eb-0bc6-48ed-bd9d-234841ec6a51 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:05.911071 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf247d-99c2-48d8-9d91-525dffc587dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:05.912697 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf247d-99c2-48d8-9d91-525dffc587dd admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:05.913210 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf247d-99c2-48d8-9d91-525dffc587dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:05.913939 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf247d-99c2-48d8-9d91-525dffc587dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:05.915340 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf247d-99c2-48d8-9d91-525dffc587dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:05.921382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: WARNING py.warnings [None req-12bf247d-99c2-48d8-9d91-525dffc587dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:25:05.921382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: warnings.warn(msg) Aug 04 10:25:05.921382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: Aug 04 10:25:05.923261 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-53c16d22-7876-4f5d-a79d-15b229f6b4f3 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:05.923940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf247d-99c2-48d8-9d91-525dffc587dd admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:05.924533 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-53c16d22-7876-4f5d-a79d-15b229f6b4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:05.950372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 787/1544] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:25:05.955557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c16d22-7876-4f5d-a79d-15b229f6b4f3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:05.971086 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c16d22-7876-4f5d-a79d-15b229f6b4f3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:05.987857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5af34-179f-490c-8049-b0375b01114d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:05.988535 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5af34-179f-490c-8049-b0375b01114d admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:05.988820 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5af34-179f-490c-8049-b0375b01114d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:05.989099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5af34-179f-490c-8049-b0375b01114d admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:05.989810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5af34-179f-490c-8049-b0375b01114d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:25:05.990156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5af34-179f-490c-8049-b0375b01114d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:05.991369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: WARNING py.warnings [None req-d4a5af34-179f-490c-8049-b0375b01114d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:25:05.991369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: warnings.warn(msg) Aug 04 10:25:05.991369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: Aug 04 10:25:05.992446 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5af34-179f-490c-8049-b0375b01114d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:06.016246 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 788/1545] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:25:06.026143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5af34-179f-490c-8049-b0375b01114d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:06.044952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5af34-179f-490c-8049-b0375b01114d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:06.056693 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc4437-ed83-4294-84e7-92074385e6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:06.057341 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc4437-ed83-4294-84e7-92074385e6da admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.057626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc4437-ed83-4294-84e7-92074385e6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.057893 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc4437-ed83-4294-84e7-92074385e6da admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:06.058727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc4437-ed83-4294-84e7-92074385e6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:06.060917 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 758/1546] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:05 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:06.062471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc4437-ed83-4294-84e7-92074385e6da admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:06.067208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf247d-99c2-48d8-9d91-525dffc587dd admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:06.116833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 789/1547] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:06 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:25:06.121463 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc4437-ed83-4294-84e7-92074385e6da admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:06.258758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc4437-ed83-4294-84e7-92074385e6da admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:06.278217 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8eb92-a53e-4890-8b98-c20efa8e74c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:06.279417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8eb92-a53e-4890-8b98-c20efa8e74c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.279879 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8eb92-a53e-4890-8b98-c20efa8e74c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.280392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8eb92-a53e-4890-8b98-c20efa8e74c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:06.281643 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8eb92-a53e-4890-8b98-c20efa8e74c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:06.283662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: WARNING py.warnings [None req-99b8eb92-a53e-4890-8b98-c20efa8e74c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:25:06.283662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: warnings.warn(msg) Aug 04 10:25:06.283662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: Aug 04 10:25:06.286551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8eb92-a53e-4890-8b98-c20efa8e74c7 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:06.306666 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf247d-99c2-48d8-9d91-525dffc587dd admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:06.323507 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90235b-f139-44c5-90c4-cbcd7bc07bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:06.324629 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90235b-f139-44c5-90c4-cbcd7bc07bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.325089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90235b-f139-44c5-90c4-cbcd7bc07bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.325517 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90235b-f139-44c5-90c4-cbcd7bc07bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:06.326641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90235b-f139-44c5-90c4-cbcd7bc07bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:06.330166 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90235b-f139-44c5-90c4-cbcd7bc07bb6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:06.352415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 790/1548] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:06 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:25:06.357403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8eb92-a53e-4890-8b98-c20efa8e74c7 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:06.387893 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8eb92-a53e-4890-8b98-c20efa8e74c7 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:06.399888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 759/1549] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:06 2022] POST /identity/v3/users => generated 287 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:06.406283 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f92ac-2425-4d83-941c-53b29f885375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:06.406540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5962a-fd53-4bad-88eb-620f317385f9 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.406804 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5962a-fd53-4bad-88eb-620f317385f9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.407251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f92ac-2425-4d83-941c-53b29f885375 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.407380 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5962a-fd53-4bad-88eb-620f317385f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:06.407703 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f92ac-2425-4d83-941c-53b29f885375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.408139 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f92ac-2425-4d83-941c-53b29f885375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:06.409663 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f92ac-2425-4d83-941c-53b29f885375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:06.413780 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f92ac-2425-4d83-941c-53b29f885375 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:06.446785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 791/1550] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:06.448275 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f92ac-2425-4d83-941c-53b29f885375 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:06.466206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-28f5962a-fd53-4bad-88eb-620f317385f9 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:06.472318 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-28f5962a-fd53-4bad-88eb-620f317385f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:06.475384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f92ac-2425-4d83-941c-53b29f885375 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:06.485527 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5ba92-15ba-4278-8709-0ff2dd843b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:06.486528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5ba92-15ba-4278-8709-0ff2dd843b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.487036 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5ba92-15ba-4278-8709-0ff2dd843b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.487612 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5ba92-15ba-4278-8709-0ff2dd843b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:06.493777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5ba92-15ba-4278-8709-0ff2dd843b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:06.495721 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5ba92-15ba-4278-8709-0ff2dd843b9d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:06.503843 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 760/1551] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:06.505497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5962a-fd53-4bad-88eb-620f317385f9 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:06.524257 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 792/1552] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:06.525994 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8babf6-e5af-43ca-b00f-44bd47cf2136 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.526511 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8babf6-e5af-43ca-b00f-44bd47cf2136 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.527006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8babf6-e5af-43ca-b00f-44bd47cf2136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:06.541049 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5962a-fd53-4bad-88eb-620f317385f9 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:06.572470 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eea974-8d56-4664-aaef-8c2fee7d5587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:06.573522 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eea974-8d56-4664-aaef-8c2fee7d5587 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.574024 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eea974-8d56-4664-aaef-8c2fee7d5587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.574522 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eea974-8d56-4664-aaef-8c2fee7d5587 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:06.574903 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-ce8babf6-e5af-43ca-b00f-44bd47cf2136 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:06.575817 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eea974-8d56-4664-aaef-8c2fee7d5587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:06.576132 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ce8babf6-e5af-43ca-b00f-44bd47cf2136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:06.578625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eea974-8d56-4664-aaef-8c2fee7d5587 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:06.595467 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 793/1553] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:06.596840 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03173fe7-9051-4004-b01d-9680f4e8eaac None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.597129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03173fe7-9051-4004-b01d-9680f4e8eaac None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.597409 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03173fe7-9051-4004-b01d-9680f4e8eaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:06.606518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 761/1554] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:06.607210 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eea974-8d56-4664-aaef-8c2fee7d5587 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:06.636126 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eea974-8d56-4664-aaef-8c2fee7d5587 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:06.641332 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-03173fe7-9051-4004-b01d-9680f4e8eaac None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:06.644261 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-03173fe7-9051-4004-b01d-9680f4e8eaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:06.650582 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571bc7c-447b-48d1-8628-3a15b4aae4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:06.651227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571bc7c-447b-48d1-8628-3a15b4aae4ba admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.651561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571bc7c-447b-48d1-8628-3a15b4aae4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.651843 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571bc7c-447b-48d1-8628-3a15b4aae4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:06.653534 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571bc7c-447b-48d1-8628-3a15b4aae4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:06.655170 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571bc7c-447b-48d1-8628-3a15b4aae4ba admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:06.669334 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 794/1555] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:06.678091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76dd8a-fe10-4a24-8a98-bbcd27061250 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.678791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76dd8a-fe10-4a24-8a98-bbcd27061250 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.678791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76dd8a-fe10-4a24-8a98-bbcd27061250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:06.689437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 762/1556] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:06.691275 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90c5a6-f006-4e1e-91d3-8e1b7118c971 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.691574 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90c5a6-f006-4e1e-91d3-8e1b7118c971 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.692833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90c5a6-f006-4e1e-91d3-8e1b7118c971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:06.724643 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3e76dd8a-fe10-4a24-8a98-bbcd27061250 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:06.725973 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3e76dd8a-fe10-4a24-8a98-bbcd27061250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:06.728916 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3f90c5a6-f006-4e1e-91d3-8e1b7118c971 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:06.730155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3f90c5a6-f006-4e1e-91d3-8e1b7118c971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:06.734494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 795/1557] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:06.735296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76dd8a-fe10-4a24-8a98-bbcd27061250 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:06.738708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 763/1558] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:06.741653 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90c5a6-f006-4e1e-91d3-8e1b7118c971 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:06.746913 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76dd8a-fe10-4a24-8a98-bbcd27061250 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:06.751668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bed825-4531-4797-8dc0-edd0f8e52463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:06.752390 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bed825-4531-4797-8dc0-edd0f8e52463 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.752678 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bed825-4531-4797-8dc0-edd0f8e52463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.752855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90c5a6-f006-4e1e-91d3-8e1b7118c971 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:06.752974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bed825-4531-4797-8dc0-edd0f8e52463 admin admin] PATH_INFO: `/v3/projects/b79275ad36b64341bcd8fd4f3fcfb3de/users/93e3f08697b14594af221fcc1773e592/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:06.759357 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bf7db-63d7-4d4d-a0d2-4052d2f8bcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:06.759982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bf7db-63d7-4d4d-a0d2-4052d2f8bcfa admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.760302 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bf7db-63d7-4d4d-a0d2-4052d2f8bcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.760581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bf7db-63d7-4d4d-a0d2-4052d2f8bcfa admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:06.761306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bf7db-63d7-4d4d-a0d2-4052d2f8bcfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:25:06.761620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bf7db-63d7-4d4d-a0d2-4052d2f8bcfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:06.763218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bf7db-63d7-4d4d-a0d2-4052d2f8bcfa admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:06.769674 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bed825-4531-4797-8dc0-edd0f8e52463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79275ad36b64341bcd8fd4f3fcfb3de, user_id=93e3f08697b14594af221fcc1773e592, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:06.773484 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bed825-4531-4797-8dc0-edd0f8e52463 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:06.777151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 764/1559] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:25:06.779063 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bf7db-63d7-4d4d-a0d2-4052d2f8bcfa admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:06.795801 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 796/1560] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:06 2022] PUT /identity/v3/projects/b79275ad36b64341bcd8fd4f3fcfb3de/users/93e3f08697b14594af221fcc1773e592/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:06.795801 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ed718-fe7d-42e5-8f0a-71a6eb75f179 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.795801 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ed718-fe7d-42e5-8f0a-71a6eb75f179 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.795801 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ed718-fe7d-42e5-8f0a-71a6eb75f179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:06.798486 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bf7db-63d7-4d4d-a0d2-4052d2f8bcfa admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:06.815270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-369ed718-fe7d-42e5-8f0a-71a6eb75f179 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:06.816552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-369ed718-fe7d-42e5-8f0a-71a6eb75f179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:06.843743 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:06.855940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:06.868472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b3e0e-f701-47e9-95f8-2511359a319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:06.869246 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b3e0e-f701-47e9-95f8-2511359a319e admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.869561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b3e0e-f701-47e9-95f8-2511359a319e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.869872 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b3e0e-f701-47e9-95f8-2511359a319e admin admin] PATH_INFO: `/v3/projects/b609a282793b44d4b4b472872723497c/users/a3c23e69a445419ba9024fe991bbf821/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:06.885923 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b3e0e-f701-47e9-95f8-2511359a319e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b609a282793b44d4b4b472872723497c, user_id=a3c23e69a445419ba9024fe991bbf821, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:06.887167 dv-cinder-826608-8-smb devstack@keystone.service[80116]: WARNING py.warnings [None req-5d8b3e0e-f701-47e9-95f8-2511359a319e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:25:06.887167 dv-cinder-826608-8-smb devstack@keystone.service[80116]: warnings.warn(msg) Aug 04 10:25:06.887167 dv-cinder-826608-8-smb devstack@keystone.service[80116]: Aug 04 10:25:06.887937 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 797/1561] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:06.889212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b3e0e-f701-47e9-95f8-2511359a319e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:06.889699 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ac4ec-7828-4feb-b5cf-162f5cdfd16f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.889986 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ac4ec-7828-4feb-b5cf-162f5cdfd16f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.890268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ac4ec-7828-4feb-b5cf-162f5cdfd16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:06.906803 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 765/1562] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:06 2022] PUT /identity/v3/projects/b609a282793b44d4b4b472872723497c/users/a3c23e69a445419ba9024fe991bbf821/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:06.909768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e7532-7a1d-493d-9105-130a09dd963b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.910649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e7532-7a1d-493d-9105-130a09dd963b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.911322 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e7532-7a1d-493d-9105-130a09dd963b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:06.914796 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-215ac4ec-7828-4feb-b5cf-162f5cdfd16f None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:06.916009 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-215ac4ec-7828-4feb-b5cf-162f5cdfd16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:06.942078 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-585e7532-7a1d-493d-9105-130a09dd963b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:06.944121 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-585e7532-7a1d-493d-9105-130a09dd963b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:06.984585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 798/1563] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:06.985890 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8c714-71eb-4c6c-886d-33d404a38c58 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:06.986151 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8c714-71eb-4c6c-886d-33d404a38c58 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:06.986488 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8c714-71eb-4c6c-886d-33d404a38c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.008110 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-20b8c714-71eb-4c6c-886d-33d404a38c58 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:07.009379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-20b8c714-71eb-4c6c-886d-33d404a38c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:07.010952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 766/1564] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:07.011793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e7532-7a1d-493d-9105-130a09dd963b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:07.019128 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 799/1565] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:07.020470 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31916a62-1806-4122-9c96-44f4a1d4c32b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.020756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31916a62-1806-4122-9c96-44f4a1d4c32b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.021133 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31916a62-1806-4122-9c96-44f4a1d4c32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.028003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e7532-7a1d-493d-9105-130a09dd963b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:07.033412 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fa657-26de-4045-9d40-9ef973a96dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:07.034092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fa657-26de-4045-9d40-9ef973a96dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.034377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fa657-26de-4045-9d40-9ef973a96dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.034656 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fa657-26de-4045-9d40-9ef973a96dc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.035358 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fa657-26de-4045-9d40-9ef973a96dc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:25:07.035668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fa657-26de-4045-9d40-9ef973a96dc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:07.037976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fa657-26de-4045-9d40-9ef973a96dc3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:07.042507 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-31916a62-1806-4122-9c96-44f4a1d4c32b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:07.043758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-31916a62-1806-4122-9c96-44f4a1d4c32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:07.050206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 767/1566] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:25:07.050933 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fa657-26de-4045-9d40-9ef973a96dc3 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:07.055316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 800/1567] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:07.055316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3a14d-feaf-4ca1-8c12-8e636a050895 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.055316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3a14d-feaf-4ca1-8c12-8e636a050895 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.055316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3a14d-feaf-4ca1-8c12-8e636a050895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.070967 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fa657-26de-4045-9d40-9ef973a96dc3 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:07.075791 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f804c5b-1c10-4dee-99df-e7205f61f404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:07.076464 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f804c5b-1c10-4dee-99df-e7205f61f404 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.076747 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f804c5b-1c10-4dee-99df-e7205f61f404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.077025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f804c5b-1c10-4dee-99df-e7205f61f404 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.077693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f804c5b-1c10-4dee-99df-e7205f61f404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:07.079595 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f804c5b-1c10-4dee-99df-e7205f61f404 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:07.082182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-61d3a14d-feaf-4ca1-8c12-8e636a050895 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:07.084507 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-61d3a14d-feaf-4ca1-8c12-8e636a050895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:07.094870 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 801/1568] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:07.098822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7231b9-d25e-4a32-a0fa-50c07da5d279 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.100354 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7231b9-d25e-4a32-a0fa-50c07da5d279 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.100522 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7231b9-d25e-4a32-a0fa-50c07da5d279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.116575 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 768/1569] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:07 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:07.118033 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54fe2f-ea3b-4000-b45f-2cae5d598db0 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.118229 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54fe2f-ea3b-4000-b45f-2cae5d598db0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.118506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54fe2f-ea3b-4000-b45f-2cae5d598db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.138650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5f7231b9-d25e-4a32-a0fa-50c07da5d279 None None] MFA Rules not processed for user `a3c23e69a445419ba9024fe991bbf821`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:07.140568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5f7231b9-d25e-4a32-a0fa-50c07da5d279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:07.142795 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9b54fe2f-ea3b-4000-b45f-2cae5d598db0 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:07.144051 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9b54fe2f-ea3b-4000-b45f-2cae5d598db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:07.218456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 802/1570] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:07.219641 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53af51-7ddc-49ee-9545-2eacb2355b02 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.219930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53af51-7ddc-49ee-9545-2eacb2355b02 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.220230 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53af51-7ddc-49ee-9545-2eacb2355b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.230318 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 769/1571] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:07.230318 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54fe2f-ea3b-4000-b45f-2cae5d598db0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:07.237850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54fe2f-ea3b-4000-b45f-2cae5d598db0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:07.244483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95248299-2c77-44ce-8df7-fd4a8ece6e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:07.245749 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95248299-2c77-44ce-8df7-fd4a8ece6e97 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.245958 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95248299-2c77-44ce-8df7-fd4a8ece6e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.246350 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95248299-2c77-44ce-8df7-fd4a8ece6e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.247318 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95248299-2c77-44ce-8df7-fd4a8ece6e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:25:07.247520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95248299-2c77-44ce-8df7-fd4a8ece6e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:07.249279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95248299-2c77-44ce-8df7-fd4a8ece6e97 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:07.254188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-fa53af51-7ddc-49ee-9545-2eacb2355b02 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:07.255528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-fa53af51-7ddc-49ee-9545-2eacb2355b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:07.267013 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 770/1572] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:25:07.267788 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95248299-2c77-44ce-8df7-fd4a8ece6e97 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:07.272701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 803/1573] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:07.273837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53af51-7ddc-49ee-9545-2eacb2355b02 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:07.281938 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-fa53af51-7ddc-49ee-9545-2eacb2355b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:07.292400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95248299-2c77-44ce-8df7-fd4a8ece6e97 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:07.299374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c7ee7-2655-42de-9686-40f3837ea978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:07.300029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c7ee7-2655-42de-9686-40f3837ea978 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.300359 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c7ee7-2655-42de-9686-40f3837ea978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.300640 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c7ee7-2655-42de-9686-40f3837ea978 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.301333 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c7ee7-2655-42de-9686-40f3837ea978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:07.307503 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c7ee7-2655-42de-9686-40f3837ea978 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:07.331874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:07.346842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 771/1574] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:07 2022] POST /identity/v3/projects => generated 377 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:07.348510 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c7ee7-2655-42de-9686-40f3837ea978 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:07.357527 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:07.378318 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53af51-7ddc-49ee-9545-2eacb2355b02 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:07.433279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c7ee7-2655-42de-9686-40f3837ea978 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:07.438699 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee620dc-9cbd-47e1-a9a9-331065c33836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:07.439008 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73702ad1-8adf-4506-b925-fc9ba801271f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:07.439335 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee620dc-9cbd-47e1-a9a9-331065c33836 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.439622 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee620dc-9cbd-47e1-a9a9-331065c33836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.439753 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73702ad1-8adf-4506-b925-fc9ba801271f service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.439902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee620dc-9cbd-47e1-a9a9-331065c33836 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.440035 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73702ad1-8adf-4506-b925-fc9ba801271f service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.440222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73702ad1-8adf-4506-b925-fc9ba801271f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.441003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee620dc-9cbd-47e1-a9a9-331065c33836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:25:07.441591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee620dc-9cbd-47e1-a9a9-331065c33836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:07.444039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee620dc-9cbd-47e1-a9a9-331065c33836 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:07.455284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73702ad1-8adf-4506-b925-fc9ba801271f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:07.456839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73702ad1-8adf-4506-b925-fc9ba801271f service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:07.466451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 772/1575] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:25:07.466451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee620dc-9cbd-47e1-a9a9-331065c33836 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:07.473595 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 804/1576] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:07.475812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee620dc-9cbd-47e1-a9a9-331065c33836 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:07.481849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73702ad1-8adf-4506-b925-fc9ba801271f service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:07.486938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef3aaf-ed70-48b9-9c1b-694c74a45ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:07.488085 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef3aaf-ed70-48b9-9c1b-694c74a45ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.488720 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef3aaf-ed70-48b9-9c1b-694c74a45ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.489303 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef3aaf-ed70-48b9-9c1b-694c74a45ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.490783 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef3aaf-ed70-48b9-9c1b-694c74a45ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:07.492999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef3aaf-ed70-48b9-9c1b-694c74a45ab6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:07.495642 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73702ad1-8adf-4506-b925-fc9ba801271f service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:07.502505 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595dde7-7909-40d0-b9dd-ceeb787c2ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:07.503096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595dde7-7909-40d0-b9dd-ceeb787c2ccb admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.503673 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595dde7-7909-40d0-b9dd-ceeb787c2ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.504690 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595dde7-7909-40d0-b9dd-ceeb787c2ccb admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.507245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595dde7-7909-40d0-b9dd-ceeb787c2ccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:25:07.507654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595dde7-7909-40d0-b9dd-ceeb787c2ccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:07.510319 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595dde7-7909-40d0-b9dd-ceeb787c2ccb admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:07.522274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 773/1577] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:07 2022] POST /identity/v3/users => generated 287 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:07.528289 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 805/1578] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:25:07.528289 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595dde7-7909-40d0-b9dd-ceeb787c2ccb admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:07.529001 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a7c5a-5782-450e-acbb-d20ca6fdf784 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.529663 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a7c5a-5782-450e-acbb-d20ca6fdf784 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.530281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a7c5a-5782-450e-acbb-d20ca6fdf784 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.536776 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 774/1579] 10.222.0.48 () {54 vars in 962 bytes} [Thu Aug 4 10:25:07 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:25:07.539178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a7c5a-5782-450e-acbb-d20ca6fdf784 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:07.543043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595dde7-7909-40d0-b9dd-ceeb787c2ccb admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:07.549438 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a910c4f-351b-483e-a549-06c1dddab247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:07.550477 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a910c4f-351b-483e-a549-06c1dddab247 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.551100 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a910c4f-351b-483e-a549-06c1dddab247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.551283 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a910c4f-351b-483e-a549-06c1dddab247 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.552032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a910c4f-351b-483e-a549-06c1dddab247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:25:07.552469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a910c4f-351b-483e-a549-06c1dddab247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:07.555157 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a910c4f-351b-483e-a549-06c1dddab247 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:07.562391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a7c5a-5782-450e-acbb-d20ca6fdf784 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:07.569340 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1eb19-1b75-4c97-b1b8-02b24ad7ca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:07.570776 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1eb19-1b75-4c97-b1b8-02b24ad7ca56 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.571190 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1eb19-1b75-4c97-b1b8-02b24ad7ca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.571549 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1eb19-1b75-4c97-b1b8-02b24ad7ca56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.572707 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1eb19-1b75-4c97-b1b8-02b24ad7ca56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:07.574386 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1eb19-1b75-4c97-b1b8-02b24ad7ca56 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:07.580234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 806/1580] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:25:07.580234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a910c4f-351b-483e-a549-06c1dddab247 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:07.594058 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a910c4f-351b-483e-a549-06c1dddab247 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:07.600957 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4955f-8175-41c8-84f0-295efb7dd259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:07.601693 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4955f-8175-41c8-84f0-295efb7dd259 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.602062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4955f-8175-41c8-84f0-295efb7dd259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.602342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4955f-8175-41c8-84f0-295efb7dd259 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.603708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4955f-8175-41c8-84f0-295efb7dd259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:07.607315 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4955f-8175-41c8-84f0-295efb7dd259 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:07.616462 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 775/1581] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:07 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:07.617760 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1eb19-1b75-4c97-b1b8-02b24ad7ca56 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:07.650238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 807/1582] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:07 2022] POST /identity/v3/users => generated 289 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:07.650238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4955f-8175-41c8-84f0-295efb7dd259 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:07.663557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4955f-8175-41c8-84f0-295efb7dd259 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:07.703645 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1eb19-1b75-4c97-b1b8-02b24ad7ca56 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:07.710348 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e307c60-3406-4e7b-a2b4-bc2e2756cce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:07.711219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e307c60-3406-4e7b-a2b4-bc2e2756cce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.711569 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e307c60-3406-4e7b-a2b4-bc2e2756cce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.712358 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e307c60-3406-4e7b-a2b4-bc2e2756cce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.712829 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e307c60-3406-4e7b-a2b4-bc2e2756cce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:07.715492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e307c60-3406-4e7b-a2b4-bc2e2756cce1 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:07.736583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb06a53-e941-4b68-a1db-a187e89def3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:07.737572 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb06a53-e941-4b68-a1db-a187e89def3b admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.738144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb06a53-e941-4b68-a1db-a187e89def3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.738474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb06a53-e941-4b68-a1db-a187e89def3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.739568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb06a53-e941-4b68-a1db-a187e89def3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:07.742075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb06a53-e941-4b68-a1db-a187e89def3b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:07.756259 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 808/1583] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:07.756541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb06a53-e941-4b68-a1db-a187e89def3b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:07.766642 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 776/1584] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:07 2022] POST /identity/v3/projects => generated 391 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:07.768116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb06a53-e941-4b68-a1db-a187e89def3b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:07.768574 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334adf4-5b4c-4d6f-82c7-07bf7f75aeb2 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.769141 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334adf4-5b4c-4d6f-82c7-07bf7f75aeb2 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.769572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334adf4-5b4c-4d6f-82c7-07bf7f75aeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.831168 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:07.832400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4334adf4-5b4c-4d6f-82c7-07bf7f75aeb2 None None] MFA Rules not processed for user `592539924feb44ad8ea520d8539b6608`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:07.834383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4334adf4-5b4c-4d6f-82c7-07bf7f75aeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:07.858505 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854911b7-0add-48ac-a321-ae914ad740e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:07.860184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854911b7-0add-48ac-a321-ae914ad740e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:07.860650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854911b7-0add-48ac-a321-ae914ad740e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:07.861036 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854911b7-0add-48ac-a321-ae914ad740e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:07.862203 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854911b7-0add-48ac-a321-ae914ad740e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:07.865240 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854911b7-0add-48ac-a321-ae914ad740e7 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:07.871483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:07.922986 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 809/1585] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:07 2022] POST /identity/v3/projects => generated 357 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:07.922986 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854911b7-0add-48ac-a321-ae914ad740e7 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:07.935525 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 777/1586] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Aug 4 10:25:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:07.936664 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334adf4-5b4c-4d6f-82c7-07bf7f75aeb2 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:07.949712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334adf4-5b4c-4d6f-82c7-07bf7f75aeb2 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.008690 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854911b7-0add-48ac-a321-ae914ad740e7 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.014293 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2923e66-a807-4fdd-8d79-ee27991d615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.014993 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2923e66-a807-4fdd-8d79-ee27991d615c admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.015277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2923e66-a807-4fdd-8d79-ee27991d615c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.015555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2923e66-a807-4fdd-8d79-ee27991d615c admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.016517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2923e66-a807-4fdd-8d79-ee27991d615c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.018714 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2923e66-a807-4fdd-8d79-ee27991d615c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.040992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9916e-586d-4ff9-9ae5-71d097ee4f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.041844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9916e-586d-4ff9-9ae5-71d097ee4f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.042330 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9916e-586d-4ff9-9ae5-71d097ee4f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.042745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9916e-586d-4ff9-9ae5-71d097ee4f6e admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.043678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9916e-586d-4ff9-9ae5-71d097ee4f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.045780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9916e-586d-4ff9-9ae5-71d097ee4f6e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.056313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 810/1587] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:07 2022] POST /identity/v3/projects => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:08.056974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2923e66-a807-4fdd-8d79-ee27991d615c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:08.074201 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 778/1588] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:07 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:08.075066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9916e-586d-4ff9-9ae5-71d097ee4f6e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:08.089273 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9916e-586d-4ff9-9ae5-71d097ee4f6e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.150364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2923e66-a807-4fdd-8d79-ee27991d615c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.158267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37120e-9c86-4f3b-8a14-f9afdea3fe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.159534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37120e-9c86-4f3b-8a14-f9afdea3fe56 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.160117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37120e-9c86-4f3b-8a14-f9afdea3fe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.160940 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37120e-9c86-4f3b-8a14-f9afdea3fe56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.162303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37120e-9c86-4f3b-8a14-f9afdea3fe56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.163985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c6e3f-022c-4d55-8a78-69d9fd3232db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.164657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c6e3f-022c-4d55-8a78-69d9fd3232db admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.164939 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c6e3f-022c-4d55-8a78-69d9fd3232db admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.165212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c6e3f-022c-4d55-8a78-69d9fd3232db admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.166012 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c6e3f-022c-4d55-8a78-69d9fd3232db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.166125 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37120e-9c86-4f3b-8a14-f9afdea3fe56 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.167706 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c6e3f-022c-4d55-8a78-69d9fd3232db admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.180258 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 811/1589] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:08.181547 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37120e-9c86-4f3b-8a14-f9afdea3fe56 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:08.187322 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 779/1590] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:08.187322 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c6e3f-022c-4d55-8a78-69d9fd3232db admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:08.196076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37120e-9c86-4f3b-8a14-f9afdea3fe56 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.200471 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c6e3f-022c-4d55-8a78-69d9fd3232db admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.201405 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b841fc-1de1-4103-93f0-f724821e19b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.202144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b841fc-1de1-4103-93f0-f724821e19b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.202481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b841fc-1de1-4103-93f0-f724821e19b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.202832 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b841fc-1de1-4103-93f0-f724821e19b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.203774 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b841fc-1de1-4103-93f0-f724821e19b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.206047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b841fc-1de1-4103-93f0-f724821e19b9 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.206860 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9f07b-1d2e-4e35-a40a-f997455e0a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.208111 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9f07b-1d2e-4e35-a40a-f997455e0a63 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.208429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9f07b-1d2e-4e35-a40a-f997455e0a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.208736 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9f07b-1d2e-4e35-a40a-f997455e0a63 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.210054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9f07b-1d2e-4e35-a40a-f997455e0a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.212436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9f07b-1d2e-4e35-a40a-f997455e0a63 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.234086 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 812/1591] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:08 2022] POST /identity/v3/users => generated 296 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:08.235078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b841fc-1de1-4103-93f0-f724821e19b9 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:08.249934 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 780/1592] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:08 2022] POST /identity/v3/users => generated 279 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:08.251118 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9f07b-1d2e-4e35-a40a-f997455e0a63 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:08.263398 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9f07b-1d2e-4e35-a40a-f997455e0a63 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.268799 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ced9c-b64c-4dc5-903b-8b3f8de21689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.269451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ced9c-b64c-4dc5-903b-8b3f8de21689 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.269735 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ced9c-b64c-4dc5-903b-8b3f8de21689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.269996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ced9c-b64c-4dc5-903b-8b3f8de21689 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.270663 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ced9c-b64c-4dc5-903b-8b3f8de21689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.274652 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ced9c-b64c-4dc5-903b-8b3f8de21689 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.279999 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:08.310214 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 781/1593] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:08 2022] POST /identity/v3/users => generated 284 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:08.313257 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ced9c-b64c-4dc5-903b-8b3f8de21689 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:08.326799 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ced9c-b64c-4dc5-903b-8b3f8de21689 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.327389 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b841fc-1de1-4103-93f0-f724821e19b9 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.332778 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4605ad-7815-4de8-9e5b-4212267bec78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.333508 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4605ad-7815-4de8-9e5b-4212267bec78 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.334425 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4605ad-7815-4de8-9e5b-4212267bec78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.334953 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4605ad-7815-4de8-9e5b-4212267bec78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.335774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4605ad-7815-4de8-9e5b-4212267bec78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.336141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f79f04-bb57-4b87-b118-fe4d8c992d7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.336786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f79f04-bb57-4b87-b118-fe4d8c992d7c service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.337075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f79f04-bb57-4b87-b118-fe4d8c992d7c service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.337484 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4605ad-7815-4de8-9e5b-4212267bec78 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.337602 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f79f04-bb57-4b87-b118-fe4d8c992d7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.349188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 782/1594] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:08.350107 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4605ad-7815-4de8-9e5b-4212267bec78 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:08.362907 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:08.369896 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4605ad-7815-4de8-9e5b-4212267bec78 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.375379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe424b-8eb2-496c-8518-5d41b259f613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.376417 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe424b-8eb2-496c-8518-5d41b259f613 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.376804 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe424b-8eb2-496c-8518-5d41b259f613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.377216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe424b-8eb2-496c-8518-5d41b259f613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.378011 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe424b-8eb2-496c-8518-5d41b259f613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.379737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe424b-8eb2-496c-8518-5d41b259f613 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.394360 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 783/1595] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:08.394360 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe424b-8eb2-496c-8518-5d41b259f613 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:08.405956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe424b-8eb2-496c-8518-5d41b259f613 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.411447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51f32c-78c1-40aa-9469-fc68cbe9821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.412736 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f32c-78c1-40aa-9469-fc68cbe9821b admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.413020 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f32c-78c1-40aa-9469-fc68cbe9821b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.413834 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f32c-78c1-40aa-9469-fc68cbe9821b admin admin] PATH_INFO: `/v3/projects/51ed8706fbfb4b37ad908fba9d6df98b/users/9226c32c3a6e4e3cbb453c722c4e45f7/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.430827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51f32c-78c1-40aa-9469-fc68cbe9821b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ed8706fbfb4b37ad908fba9d6df98b, user_id=9226c32c3a6e4e3cbb453c722c4e45f7, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.434207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51f32c-78c1-40aa-9469-fc68cbe9821b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.441979 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f79f04-bb57-4b87-b118-fe4d8c992d7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.445096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f79f04-bb57-4b87-b118-fe4d8c992d7c service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.467878 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 784/1596] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:08 2022] PUT /identity/v3/projects/51ed8706fbfb4b37ad908fba9d6df98b/users/9226c32c3a6e4e3cbb453c722c4e45f7/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:08.467878 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51f32c-78c1-40aa-9469-fc68cbe9821b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:08.468249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 813/1597] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:08.468249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f79f04-bb57-4b87-b118-fe4d8c992d7c service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:08.478845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f79f04-bb57-4b87-b118-fe4d8c992d7c service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.621433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51f32c-78c1-40aa-9469-fc68cbe9821b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.624476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610ead3-6e8b-4b53-8da8-eb55d181e759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.625227 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610ead3-6e8b-4b53-8da8-eb55d181e759 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.625521 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610ead3-6e8b-4b53-8da8-eb55d181e759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.625796 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610ead3-6e8b-4b53-8da8-eb55d181e759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.628388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610ead3-6e8b-4b53-8da8-eb55d181e759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.628388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610ead3-6e8b-4b53-8da8-eb55d181e759 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.631797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4627d-7535-4b49-887b-d686188e0b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.632774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4627d-7535-4b49-887b-d686188e0b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.633271 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4627d-7535-4b49-887b-d686188e0b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.633753 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4627d-7535-4b49-887b-d686188e0b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.634823 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4627d-7535-4b49-887b-d686188e0b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.636840 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4627d-7535-4b49-887b-d686188e0b59 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.640442 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 814/1598] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:08.641518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610ead3-6e8b-4b53-8da8-eb55d181e759 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:08.651833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 785/1599] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:08.653041 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4627d-7535-4b49-887b-d686188e0b59 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:08.654189 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610ead3-6e8b-4b53-8da8-eb55d181e759 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.660675 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4055852-435d-4a48-9726-0fa8aa972808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.661649 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4055852-435d-4a48-9726-0fa8aa972808 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.662775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4055852-435d-4a48-9726-0fa8aa972808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.663273 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4055852-435d-4a48-9726-0fa8aa972808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.664125 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4055852-435d-4a48-9726-0fa8aa972808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.666050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4055852-435d-4a48-9726-0fa8aa972808 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.666636 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4627d-7535-4b49-887b-d686188e0b59 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.671952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97d0d3-1115-4d2d-940d-5ec6b19f183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.672762 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97d0d3-1115-4d2d-940d-5ec6b19f183f admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.673242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97d0d3-1115-4d2d-940d-5ec6b19f183f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.673618 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97d0d3-1115-4d2d-940d-5ec6b19f183f admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.674445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97d0d3-1115-4d2d-940d-5ec6b19f183f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.676264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97d0d3-1115-4d2d-940d-5ec6b19f183f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.680749 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 815/1600] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:08.681852 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4055852-435d-4a48-9726-0fa8aa972808 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:08.692604 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 786/1601] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:08.693414 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4055852-435d-4a48-9726-0fa8aa972808 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.694082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd0dab-d156-4df5-9d31-4a737de5b265 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.694380 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd0dab-d156-4df5-9d31-4a737de5b265 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.698647 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd0dab-d156-4df5-9d31-4a737de5b265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.699515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c4007-47d1-4fb8-af8f-cd11bf2f1641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.700438 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c4007-47d1-4fb8-af8f-cd11bf2f1641 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.700865 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c4007-47d1-4fb8-af8f-cd11bf2f1641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.701434 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c4007-47d1-4fb8-af8f-cd11bf2f1641 admin admin] PATH_INFO: `/v3/projects/19f6eb44b4b24d82bfe97d3e8cce3bd7/users/a7faaaa36a964813b0d9ec887fabb6ee/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.718809 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c4007-47d1-4fb8-af8f-cd11bf2f1641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f6eb44b4b24d82bfe97d3e8cce3bd7, user_id=a7faaaa36a964813b0d9ec887fabb6ee, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.722336 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c4007-47d1-4fb8-af8f-cd11bf2f1641 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.739629 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 816/1602] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:08 2022] PUT /identity/v3/projects/19f6eb44b4b24d82bfe97d3e8cce3bd7/users/a7faaaa36a964813b0d9ec887fabb6ee/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:08.742249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c4007-47d1-4fb8-af8f-cd11bf2f1641 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:08.756375 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4ebd0dab-d156-4df5-9d31-4a737de5b265 None None] MFA Rules not processed for user `9226c32c3a6e4e3cbb453c722c4e45f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:08.757758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4ebd0dab-d156-4df5-9d31-4a737de5b265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:08.807004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:08.856937 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c4007-47d1-4fb8-af8f-cd11bf2f1641 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.864127 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c26fa5-e479-42d9-8e1a-183b3b943978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.865780 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c26fa5-e479-42d9-8e1a-183b3b943978 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.866029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c26fa5-e479-42d9-8e1a-183b3b943978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.866472 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c26fa5-e479-42d9-8e1a-183b3b943978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.867248 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c26fa5-e479-42d9-8e1a-183b3b943978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.869771 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 787/1603] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:08.869895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c26fa5-e479-42d9-8e1a-183b3b943978 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.870781 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd0dab-d156-4df5-9d31-4a737de5b265 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:08.887813 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd0dab-d156-4df5-9d31-4a737de5b265 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.893615 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 817/1604] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:08.894473 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c26fa5-e479-42d9-8e1a-183b3b943978 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:08.895116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2176f8a-c22b-4af1-8232-50489b91b4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.896002 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2176f8a-c22b-4af1-8232-50489b91b4fe admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.897492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2176f8a-c22b-4af1-8232-50489b91b4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.898021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2176f8a-c22b-4af1-8232-50489b91b4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.899094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2176f8a-c22b-4af1-8232-50489b91b4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.901417 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2176f8a-c22b-4af1-8232-50489b91b4fe admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.916870 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c26fa5-e479-42d9-8e1a-183b3b943978 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.919903 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 788/1605] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:08.921432 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2176f8a-c22b-4af1-8232-50489b91b4fe admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:08.922402 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542430f-272c-4c01-94ab-5b9a8c39ef33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.923283 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542430f-272c-4c01-94ab-5b9a8c39ef33 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.924468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542430f-272c-4c01-94ab-5b9a8c39ef33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.924626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542430f-272c-4c01-94ab-5b9a8c39ef33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.925325 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542430f-272c-4c01-94ab-5b9a8c39ef33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.926956 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542430f-272c-4c01-94ab-5b9a8c39ef33 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.938900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2176f8a-c22b-4af1-8232-50489b91b4fe admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:08.944813 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e2095-2ac2-491f-a641-001e590e0e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:08.946187 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e2095-2ac2-491f-a641-001e590e0e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.946415 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e2095-2ac2-491f-a641-001e590e0e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.946948 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e2095-2ac2-491f-a641-001e590e0e6c admin admin] PATH_INFO: `/v3/projects/7cb6e1dedbd64a55881d27de23dad656/users/2b418a6b7893417cbcecd1db92b11b40/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.947068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 818/1606] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:08.948566 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada412ff-4815-42b2-9187-95c02b6623bf None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:08.948776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada412ff-4815-42b2-9187-95c02b6623bf None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:08.949058 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada412ff-4815-42b2-9187-95c02b6623bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:08.969144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e2095-2ac2-491f-a641-001e590e0e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb6e1dedbd64a55881d27de23dad656, user_id=2b418a6b7893417cbcecd1db92b11b40, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:08.972209 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e2095-2ac2-491f-a641-001e590e0e6c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:08.981640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-ada412ff-4815-42b2-9187-95c02b6623bf None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:08.982936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ada412ff-4815-42b2-9187-95c02b6623bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:08.999422 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 789/1607] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:08 2022] PUT /identity/v3/projects/7cb6e1dedbd64a55881d27de23dad656/users/2b418a6b7893417cbcecd1db92b11b40/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:09.001730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896330f-d714-4886-8954-59b8bf9e849f None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:09.002022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896330f-d714-4886-8954-59b8bf9e849f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:09.002297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896330f-d714-4886-8954-59b8bf9e849f None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:09.004472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 790/1608] 10.222.0.48 () {54 vars in 912 bytes} [Thu Aug 4 10:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:25:09.005769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde09bd-dd1f-4ab6-8424-9cbc30b697c8 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:09.006391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde09bd-dd1f-4ab6-8424-9cbc30b697c8 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:09.006889 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde09bd-dd1f-4ab6-8424-9cbc30b697c8 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:09.008904 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 791/1609] 10.222.0.48 () {54 vars in 962 bytes} [Thu Aug 4 10:25:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:25:09.014385 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde09bd-dd1f-4ab6-8424-9cbc30b697c8 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:09.032413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:09.069673 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 819/1610] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:09.080469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada412ff-4815-42b2-9187-95c02b6623bf None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:09.094322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada412ff-4815-42b2-9187-95c02b6623bf None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:09.100745 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525498e-5e2e-4ac4-a8fb-81cec9f86bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:09.101446 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525498e-5e2e-4ac4-a8fb-81cec9f86bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:09.101731 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525498e-5e2e-4ac4-a8fb-81cec9f86bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:09.102006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525498e-5e2e-4ac4-a8fb-81cec9f86bd5 admin admin] PATH_INFO: `/v3/projects/1793eb7200be449f9c38aa58debccdaa/users/9c26da44165845babfb18a1c6ae51d06/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:09.113250 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde09bd-dd1f-4ab6-8424-9cbc30b697c8 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:09.121210 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525498e-5e2e-4ac4-a8fb-81cec9f86bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1793eb7200be449f9c38aa58debccdaa, user_id=9c26da44165845babfb18a1c6ae51d06, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:09.124010 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525498e-5e2e-4ac4-a8fb-81cec9f86bd5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:09.124324 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a9472-71e5-42d2-a9db-5a8546306147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:09.126082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a9472-71e5-42d2-a9db-5a8546306147 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:09.126527 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a9472-71e5-42d2-a9db-5a8546306147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:09.127769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a9472-71e5-42d2-a9db-5a8546306147 admin admin] PATH_INFO: `/v3/projects/e545683f92824f5394855c0e08cb9f8e/users/570e82c285d942b28805a42ae24ca935/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:09.148289 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 820/1611] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:09 2022] PUT /identity/v3/projects/1793eb7200be449f9c38aa58debccdaa/users/9c26da44165845babfb18a1c6ae51d06/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:09.148289 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525498e-5e2e-4ac4-a8fb-81cec9f86bd5 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:09.154744 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a9472-71e5-42d2-a9db-5a8546306147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e545683f92824f5394855c0e08cb9f8e, user_id=570e82c285d942b28805a42ae24ca935, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:09.160009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a9472-71e5-42d2-a9db-5a8546306147 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:09.182494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 792/1612] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:09 2022] PUT /identity/v3/projects/e545683f92824f5394855c0e08cb9f8e/users/570e82c285d942b28805a42ae24ca935/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:09.184623 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65731cdd-032a-4268-85c0-606afb84d724 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:09.185095 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65731cdd-032a-4268-85c0-606afb84d724 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:09.185523 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65731cdd-032a-4268-85c0-606afb84d724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:09.217258 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-65731cdd-032a-4268-85c0-606afb84d724 None None] MFA Rules not processed for user `592539924feb44ad8ea520d8539b6608`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:09.219546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-65731cdd-032a-4268-85c0-606afb84d724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:09.244964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525498e-5e2e-4ac4-a8fb-81cec9f86bd5 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:09.304662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:09.333894 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190da95-806e-4485-890b-f391ac14dc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:09.335189 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190da95-806e-4485-890b-f391ac14dc85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:09.335683 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190da95-806e-4485-890b-f391ac14dc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:09.336037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190da95-806e-4485-890b-f391ac14dc85 admin admin] PATH_INFO: `/v3/projects/25ed0e6479074312880a98cacc630a98/users/732b215394e44dc9a77a257a7f35de0c/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:09.346334 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 793/1613] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Aug 4 10:25:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:09.347979 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109f0d8-828e-4892-b58e-7ce5313328a0 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:09.348298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109f0d8-828e-4892-b58e-7ce5313328a0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:09.348575 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109f0d8-828e-4892-b58e-7ce5313328a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:09.370908 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190da95-806e-4485-890b-f391ac14dc85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25ed0e6479074312880a98cacc630a98, user_id=732b215394e44dc9a77a257a7f35de0c, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:09.373868 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190da95-806e-4485-890b-f391ac14dc85 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:09.387349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-0109f0d8-828e-4892-b58e-7ce5313328a0 None None] MFA Rules not processed for user `2b418a6b7893417cbcecd1db92b11b40`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:09.388623 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0109f0d8-828e-4892-b58e-7ce5313328a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:09.391076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 821/1614] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:09 2022] PUT /identity/v3/projects/25ed0e6479074312880a98cacc630a98/users/732b215394e44dc9a77a257a7f35de0c/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:09.392600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b15ea0-a8e4-4210-91b8-d28aba953a81 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:09.392954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b15ea0-a8e4-4210-91b8-d28aba953a81 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:09.393304 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b15ea0-a8e4-4210-91b8-d28aba953a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:09.414657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-43b15ea0-a8e4-4210-91b8-d28aba953a81 None None] MFA Rules not processed for user `592539924feb44ad8ea520d8539b6608`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:09.416082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-43b15ea0-a8e4-4210-91b8-d28aba953a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:09.495450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 794/1615] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:09.497236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109f0d8-828e-4892-b58e-7ce5313328a0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:09.512375 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:09.517655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 822/1616] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Aug 4 10:25:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:09.519363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f401816-3b72-487b-84b9-3f446e6753ac None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:09.519996 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f401816-3b72-487b-84b9-3f446e6753ac None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:09.520479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f401816-3b72-487b-84b9-3f446e6753ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:09.616084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2f401816-3b72-487b-84b9-3f446e6753ac None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:09.616084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2f401816-3b72-487b-84b9-3f446e6753ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:09.635233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109f0d8-828e-4892-b58e-7ce5313328a0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:09.644431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3a2b7-3cbe-46f8-aaab-de5d7ce17fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:09.647190 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3a2b7-3cbe-46f8-aaab-de5d7ce17fee service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:09.648618 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3a2b7-3cbe-46f8-aaab-de5d7ce17fee service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:09.648618 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3a2b7-3cbe-46f8-aaab-de5d7ce17fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:09.669185 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 823/1617] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:09.670587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aeb37-ba82-4965-82c4-8eaea575d71b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:09.670876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aeb37-ba82-4965-82c4-8eaea575d71b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:09.671638 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aeb37-ba82-4965-82c4-8eaea575d71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:09.720558 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-704aeb37-ba82-4965-82c4-8eaea575d71b None None] MFA Rules not processed for user `570e82c285d942b28805a42ae24ca935`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:09.721786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-704aeb37-ba82-4965-82c4-8eaea575d71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:09.726864 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3a2b7-3cbe-46f8-aaab-de5d7ce17fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:09.728379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3a2b7-3cbe-46f8-aaab-de5d7ce17fee service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:09.740577 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 795/1618] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:09.740935 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3a2b7-3cbe-46f8-aaab-de5d7ce17fee service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:09.789093 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:09.820846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 824/1619] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:09.822334 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70746a-97be-4050-b5b3-30dc35357828 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:09.822626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70746a-97be-4050-b5b3-30dc35357828 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:09.822908 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70746a-97be-4050-b5b3-30dc35357828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:09.830534 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3a2b7-3cbe-46f8-aaab-de5d7ce17fee service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:09.837925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29eff9-c209-4d49-99f9-ae051ac26b87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:09.838819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29eff9-c209-4d49-99f9-ae051ac26b87 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:09.839898 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29eff9-c209-4d49-99f9-ae051ac26b87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:09.840401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29eff9-c209-4d49-99f9-ae051ac26b87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:09.855614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29eff9-c209-4d49-99f9-ae051ac26b87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:09.857403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29eff9-c209-4d49-99f9-ae051ac26b87 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:09.861519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-cd70746a-97be-4050-b5b3-30dc35357828 None None] MFA Rules not processed for user `732b215394e44dc9a77a257a7f35de0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:09.862972 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-cd70746a-97be-4050-b5b3-30dc35357828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:09.872130 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 796/1620] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:09.873404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29eff9-c209-4d49-99f9-ae051ac26b87 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:09.886772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29eff9-c209-4d49-99f9-ae051ac26b87 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:09.892338 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077d842-268a-47e7-9dd2-1a0f18ce4412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:09.893300 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077d842-268a-47e7-9dd2-1a0f18ce4412 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:09.893831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077d842-268a-47e7-9dd2-1a0f18ce4412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:09.894339 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077d842-268a-47e7-9dd2-1a0f18ce4412 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:09.895176 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077d842-268a-47e7-9dd2-1a0f18ce4412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:09.898528 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077d842-268a-47e7-9dd2-1a0f18ce4412 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:09.949251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 797/1621] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:09 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:09.949251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077d842-268a-47e7-9dd2-1a0f18ce4412 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:09.961584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 825/1622] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:09.963580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70746a-97be-4050-b5b3-30dc35357828 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:09.977518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70746a-97be-4050-b5b3-30dc35357828 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:10.063611 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cfd5d-55ab-49cc-a42b-00d32fe3906a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:10.064542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cfd5d-55ab-49cc-a42b-00d32fe3906a service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:10.064831 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cfd5d-55ab-49cc-a42b-00d32fe3906a service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:10.065110 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cfd5d-55ab-49cc-a42b-00d32fe3906a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:10.077243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:10.159680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077d842-268a-47e7-9dd2-1a0f18ce4412 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:10.172969 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cfd5d-55ab-49cc-a42b-00d32fe3906a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:10.173941 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc2893-1954-4031-857b-dbd4de4fac57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:10.174595 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc2893-1954-4031-857b-dbd4de4fac57 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:10.175047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc2893-1954-4031-857b-dbd4de4fac57 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:10.175259 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cfd5d-55ab-49cc-a42b-00d32fe3906a service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:10.175375 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc2893-1954-4031-857b-dbd4de4fac57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:10.207830 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 826/1623] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:10.209861 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cfd5d-55ab-49cc-a42b-00d32fe3906a service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:10.222405 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cfd5d-55ab-49cc-a42b-00d32fe3906a service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:10.230516 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd000974-f594-4690-9aa3-97a30eb42006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:10.232243 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd000974-f594-4690-9aa3-97a30eb42006 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:10.232835 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd000974-f594-4690-9aa3-97a30eb42006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:10.233273 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd000974-f594-4690-9aa3-97a30eb42006 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:10.234298 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd000974-f594-4690-9aa3-97a30eb42006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:10.236647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd000974-f594-4690-9aa3-97a30eb42006 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:10.314877 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 827/1624] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:10 2022] POST /identity/v3/projects => generated 357 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:10.318759 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd000974-f594-4690-9aa3-97a30eb42006 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:10.329226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc2893-1954-4031-857b-dbd4de4fac57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:10.333233 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:10.338895 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc2893-1954-4031-857b-dbd4de4fac57 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:10.371175 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 798/1625] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:10.373662 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc2893-1954-4031-857b-dbd4de4fac57 service nova] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:10.489353 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd000974-f594-4690-9aa3-97a30eb42006 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:10.502461 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d8af3-7cbc-4df6-b82e-a965e7ba5c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:10.504200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d8af3-7cbc-4df6-b82e-a965e7ba5c70 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:10.504840 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d8af3-7cbc-4df6-b82e-a965e7ba5c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:10.505332 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d8af3-7cbc-4df6-b82e-a965e7ba5c70 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:10.507032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d8af3-7cbc-4df6-b82e-a965e7ba5c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:10.523224 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d8af3-7cbc-4df6-b82e-a965e7ba5c70 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:10.544944 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc2893-1954-4031-857b-dbd4de4fac57 service nova] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:10.583131 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 828/1626] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:10 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:10.583131 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d8af3-7cbc-4df6-b82e-a965e7ba5c70 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:10.634779 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d8af3-7cbc-4df6-b82e-a965e7ba5c70 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:10.640112 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e4a27-d095-4691-b10b-3e3899534a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:10.640777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e4a27-d095-4691-b10b-3e3899534a82 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:10.641065 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e4a27-d095-4691-b10b-3e3899534a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:10.641343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e4a27-d095-4691-b10b-3e3899534a82 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:10.642017 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e4a27-d095-4691-b10b-3e3899534a82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:10.644193 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e4a27-d095-4691-b10b-3e3899534a82 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:10.694683 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 829/1627] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:10 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:10.695884 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e4a27-d095-4691-b10b-3e3899534a82 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:10.710197 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f10d0-4b5b-4f60-aa11-59bdaf334cb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:10.710926 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f10d0-4b5b-4f60-aa11-59bdaf334cb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:10.711268 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f10d0-4b5b-4f60-aa11-59bdaf334cb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:10.711550 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f10d0-4b5b-4f60-aa11-59bdaf334cb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:10.719803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e4a27-d095-4691-b10b-3e3899534a82 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:10.737783 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e59e1d-8b5c-4648-9f5a-1cb3d9582d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:10.738418 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e59e1d-8b5c-4648-9f5a-1cb3d9582d67 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:10.738696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e59e1d-8b5c-4648-9f5a-1cb3d9582d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:10.738976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e59e1d-8b5c-4648-9f5a-1cb3d9582d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:10.739684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e59e1d-8b5c-4648-9f5a-1cb3d9582d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:10.741758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e59e1d-8b5c-4648-9f5a-1cb3d9582d67 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:10.762448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 830/1628] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:10.763528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e59e1d-8b5c-4648-9f5a-1cb3d9582d67 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:10.788802 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e59e1d-8b5c-4648-9f5a-1cb3d9582d67 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:10.809639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabd4ce-b344-4746-bf58-78722551a844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:10.810358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabd4ce-b344-4746-bf58-78722551a844 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:10.810545 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabd4ce-b344-4746-bf58-78722551a844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:10.810830 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabd4ce-b344-4746-bf58-78722551a844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:10.811570 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabd4ce-b344-4746-bf58-78722551a844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:10.813416 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabd4ce-b344-4746-bf58-78722551a844 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:10.836908 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:10.865926 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f10d0-4b5b-4f60-aa11-59bdaf334cb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:10.874327 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f10d0-4b5b-4f60-aa11-59bdaf334cb2 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:10.875210 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 831/1629] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:10.876269 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabd4ce-b344-4746-bf58-78722551a844 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:10.914637 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 799/1630] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:10.919102 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabd4ce-b344-4746-bf58-78722551a844 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:10.926374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f10d0-4b5b-4f60-aa11-59bdaf334cb2 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:10.941810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e7188-77e6-42a8-8ba4-50039d7c8f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:10.942523 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e7188-77e6-42a8-8ba4-50039d7c8f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:10.943092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e7188-77e6-42a8-8ba4-50039d7c8f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:10.943388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e7188-77e6-42a8-8ba4-50039d7c8f39 admin admin] PATH_INFO: `/v3/projects/f42ed03f60ad40b68766d09461ad5f35/users/04ad045d8e4343f7b8512ff3e87b1de2/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:10.971794 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f10d0-4b5b-4f60-aa11-59bdaf334cb2 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:10.978307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ae2be-7aef-4f53-8fc5-d7d3626a11ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:10.979130 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ae2be-7aef-4f53-8fc5-d7d3626a11ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:10.979511 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ae2be-7aef-4f53-8fc5-d7d3626a11ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:10.979887 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ae2be-7aef-4f53-8fc5-d7d3626a11ce admin admin] PATH_INFO: `/v3/projects/9f88bc6e07ae461098be8b020e5065cf/users/83b06c2583104a1dbad766a6efc7da89/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:10.999799 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ae2be-7aef-4f53-8fc5-d7d3626a11ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f88bc6e07ae461098be8b020e5065cf, user_id=83b06c2583104a1dbad766a6efc7da89, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:11.007514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ae2be-7aef-4f53-8fc5-d7d3626a11ce admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:11.013143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e7188-77e6-42a8-8ba4-50039d7c8f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42ed03f60ad40b68766d09461ad5f35, user_id=04ad045d8e4343f7b8512ff3e87b1de2, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:11.015884 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e7188-77e6-42a8-8ba4-50039d7c8f39 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:11.041520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 800/1631] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:10 2022] PUT /identity/v3/projects/9f88bc6e07ae461098be8b020e5065cf/users/83b06c2583104a1dbad766a6efc7da89/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:11.045800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ae2be-7aef-4f53-8fc5-d7d3626a11ce admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:11.074421 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 832/1632] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:10 2022] PUT /identity/v3/projects/f42ed03f60ad40b68766d09461ad5f35/users/04ad045d8e4343f7b8512ff3e87b1de2/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:11.075937 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5870-0b50-47bc-a054-77f6bdaf3075 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:11.076255 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5870-0b50-47bc-a054-77f6bdaf3075 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:11.076538 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5870-0b50-47bc-a054-77f6bdaf3075 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:11.087132 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 833/1633] 10.222.0.48 () {54 vars in 912 bytes} [Thu Aug 4 10:25:11 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:25:11.087132 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec5870-0b50-47bc-a054-77f6bdaf3075 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:11.233148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ae2be-7aef-4f53-8fc5-d7d3626a11ce admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:11.336462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec5870-0b50-47bc-a054-77f6bdaf3075 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:11.363207 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9d48d-f6ba-4f90-b2a3-45c9dd3d6dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:11.363864 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9d48d-f6ba-4f90-b2a3-45c9dd3d6dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:11.364264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9d48d-f6ba-4f90-b2a3-45c9dd3d6dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:11.364449 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9d48d-f6ba-4f90-b2a3-45c9dd3d6dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:11.365198 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9d48d-f6ba-4f90-b2a3-45c9dd3d6dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:11.366848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9d48d-f6ba-4f90-b2a3-45c9dd3d6dd3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:11.383072 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af4ee4-54dd-4f77-bdf0-4f481a596e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:11.384295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af4ee4-54dd-4f77-bdf0-4f481a596e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:11.384758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af4ee4-54dd-4f77-bdf0-4f481a596e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:11.385210 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af4ee4-54dd-4f77-bdf0-4f481a596e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:11.387025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af4ee4-54dd-4f77-bdf0-4f481a596e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:11.397360 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af4ee4-54dd-4f77-bdf0-4f481a596e47 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:11.406437 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 834/1634] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:11.406437 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8753c-7d8f-4e78-be14-159fe1385ecf None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:11.406437 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8753c-7d8f-4e78-be14-159fe1385ecf None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:11.407540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8753c-7d8f-4e78-be14-159fe1385ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:11.442611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 801/1635] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:11.444844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af4ee4-54dd-4f77-bdf0-4f481a596e47 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:11.461676 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-69c8753c-7d8f-4e78-be14-159fe1385ecf None None] MFA Rules not processed for user `592539924feb44ad8ea520d8539b6608`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:11.462920 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-69c8753c-7d8f-4e78-be14-159fe1385ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:11.468350 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af4ee4-54dd-4f77-bdf0-4f481a596e47 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:11.497136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d5d34-aafe-4775-9f89-21d0c99bd030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:11.498104 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d5d34-aafe-4775-9f89-21d0c99bd030 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:11.498506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d5d34-aafe-4775-9f89-21d0c99bd030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:11.498888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d5d34-aafe-4775-9f89-21d0c99bd030 admin admin] PATH_INFO: `/v3/projects/f42ed03f60ad40b68766d09461ad5f35/users/04ad045d8e4343f7b8512ff3e87b1de2/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:11.502186 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d5d34-aafe-4775-9f89-21d0c99bd030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42ed03f60ad40b68766d09461ad5f35, user_id=04ad045d8e4343f7b8512ff3e87b1de2, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:11.508998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:11.510403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d5d34-aafe-4775-9f89-21d0c99bd030 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:11.538284 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 802/1636] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:11 2022] PUT /identity/v3/projects/f42ed03f60ad40b68766d09461ad5f35/users/04ad045d8e4343f7b8512ff3e87b1de2/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:11.542547 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d5d34-aafe-4775-9f89-21d0c99bd030 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:11.637665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 835/1637] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Aug 4 10:25:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:11.639318 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821dc93-41d6-4692-b447-dc49fc4d2843 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:11.641930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821dc93-41d6-4692-b447-dc49fc4d2843 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:11.642347 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821dc93-41d6-4692-b447-dc49fc4d2843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:11.720712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7821dc93-41d6-4692-b447-dc49fc4d2843 None None] MFA Rules not processed for user `04ad045d8e4343f7b8512ff3e87b1de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:11.722045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7821dc93-41d6-4692-b447-dc49fc4d2843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:11.737068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:11.759910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d5d34-aafe-4775-9f89-21d0c99bd030 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:11.783303 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66979e-580a-43ff-ac94-4014a4ca0939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:11.784031 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66979e-580a-43ff-ac94-4014a4ca0939 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:11.784379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66979e-580a-43ff-ac94-4014a4ca0939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:11.784730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66979e-580a-43ff-ac94-4014a4ca0939 admin admin] PATH_INFO: `/v3/projects/9f88bc6e07ae461098be8b020e5065cf/users/83b06c2583104a1dbad766a6efc7da89/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:11.793658 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66979e-580a-43ff-ac94-4014a4ca0939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f88bc6e07ae461098be8b020e5065cf, user_id=83b06c2583104a1dbad766a6efc7da89, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:11.796586 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66979e-580a-43ff-ac94-4014a4ca0939 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:11.838226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 803/1638] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:11 2022] PUT /identity/v3/projects/9f88bc6e07ae461098be8b020e5065cf/users/83b06c2583104a1dbad766a6efc7da89/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:11.852026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66979e-580a-43ff-ac94-4014a4ca0939 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:11.887912 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 836/1639] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:11.891168 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426fe20-aa69-456a-9f35-398b363261cc None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:11.893852 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426fe20-aa69-456a-9f35-398b363261cc None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:11.894650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426fe20-aa69-456a-9f35-398b363261cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:11.970192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-9426fe20-aa69-456a-9f35-398b363261cc None None] MFA Rules not processed for user `83b06c2583104a1dbad766a6efc7da89`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:11.977152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9426fe20-aa69-456a-9f35-398b363261cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:11.983913 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66979e-580a-43ff-ac94-4014a4ca0939 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:11.988820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5975b-a7c3-434e-b5b7-9d0dc40a2c1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:11.989800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5975b-a7c3-434e-b5b7-9d0dc40a2c1a service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:11.992123 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5975b-a7c3-434e-b5b7-9d0dc40a2c1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:11.993295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5975b-a7c3-434e-b5b7-9d0dc40a2c1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:12.190733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 837/1640] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:12.191725 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426fe20-aa69-456a-9f35-398b363261cc None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:12.218389 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426fe20-aa69-456a-9f35-398b363261cc None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:12.238267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02d2f8-a830-476f-ad24-15866cd5a001 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:12.239342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02d2f8-a830-476f-ad24-15866cd5a001 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:12.239638 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02d2f8-a830-476f-ad24-15866cd5a001 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:12.241748 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02d2f8-a830-476f-ad24-15866cd5a001 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:12.242556 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5975b-a7c3-434e-b5b7-9d0dc40a2c1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:12.246272 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5975b-a7c3-434e-b5b7-9d0dc40a2c1a service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:12.281575 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 804/1641] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:12.322597 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:12.418553 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02d2f8-a830-476f-ad24-15866cd5a001 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:12.420038 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02d2f8-a830-476f-ad24-15866cd5a001 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:12.450971 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 838/1642] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:12.508011 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5975b-a7c3-434e-b5b7-9d0dc40a2c1a service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:12.519493 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5975b-a7c3-434e-b5b7-9d0dc40a2c1a service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:12.531617 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3a5a1-2046-422c-ab5b-6e0cc1580e5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:12.532507 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3a5a1-2046-422c-ab5b-6e0cc1580e5a service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:12.533044 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3a5a1-2046-422c-ab5b-6e0cc1580e5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:12.533423 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3a5a1-2046-422c-ab5b-6e0cc1580e5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:12.564325 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3a5a1-2046-422c-ab5b-6e0cc1580e5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:12.565836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3a5a1-2046-422c-ab5b-6e0cc1580e5a service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:12.606237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 805/1643] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:12 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:12.827982 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02d2f8-a830-476f-ad24-15866cd5a001 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:12.829025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3a5a1-2046-422c-ab5b-6e0cc1580e5a service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:12.855483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02d2f8-a830-476f-ad24-15866cd5a001 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:12.863532 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d96ce2-42b6-46ba-87a5-e85d414cf48d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:12.864126 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d96ce2-42b6-46ba-87a5-e85d414cf48d service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:12.864471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d96ce2-42b6-46ba-87a5-e85d414cf48d service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:12.865829 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d96ce2-42b6-46ba-87a5-e85d414cf48d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:13.014522 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d96ce2-42b6-46ba-87a5-e85d414cf48d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:13.018029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d96ce2-42b6-46ba-87a5-e85d414cf48d service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:13.031516 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3a5a1-2046-422c-ab5b-6e0cc1580e5a service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:13.045500 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 839/1644] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:13.048822 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d099f3-b8ca-4c73-9cb0-e8447d39d3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:13.051265 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d099f3-b8ca-4c73-9cb0-e8447d39d3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:13.051802 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d099f3-b8ca-4c73-9cb0-e8447d39d3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:13.052145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d099f3-b8ca-4c73-9cb0-e8447d39d3f6 admin admin] PATH_INFO: `/v3/users/9226c32c3a6e4e3cbb453c722c4e45f7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:13.055291 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d099f3-b8ca-4c73-9cb0-e8447d39d3f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9226c32c3a6e4e3cbb453c722c4e45f7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:13.060869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: WARNING py.warnings [None req-97d099f3-b8ca-4c73-9cb0-e8447d39d3f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:25:13.060869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: warnings.warn(msg) Aug 04 10:25:13.060869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: Aug 04 10:25:13.062956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d099f3-b8ca-4c73-9cb0-e8447d39d3f6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:13.083762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d96ce2-42b6-46ba-87a5-e85d414cf48d service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:13.099142 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d96ce2-42b6-46ba-87a5-e85d414cf48d service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:13.109326 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359de3a0-b8fc-4fa6-8c59-c33bc2a218b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:13.110064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359de3a0-b8fc-4fa6-8c59-c33bc2a218b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:13.110674 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359de3a0-b8fc-4fa6-8c59-c33bc2a218b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:13.111171 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359de3a0-b8fc-4fa6-8c59-c33bc2a218b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:13.159616 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:13.238289 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-97d099f3-b8ca-4c73-9cb0-e8447d39d3f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9226c32c3a6e4e3cbb453c722c4e45f7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:13.240003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-97d099f3-b8ca-4c73-9cb0-e8447d39d3f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9226c32c3a6e4e3cbb453c722c4e45f7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:13.267303 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-97d099f3-b8ca-4c73-9cb0-e8447d39d3f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9226c32c3a6e4e3cbb453c722c4e45f7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:13.279788 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359de3a0-b8fc-4fa6-8c59-c33bc2a218b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:13.281483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359de3a0-b8fc-4fa6-8c59-c33bc2a218b9 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:13.311033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 840/1645] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:13.320014 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-97d099f3-b8ca-4c73-9cb0-e8447d39d3f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9226c32c3a6e4e3cbb453c722c4e45f7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:13.336133 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-97d099f3-b8ca-4c73-9cb0-e8447d39d3f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9226c32c3a6e4e3cbb453c722c4e45f7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:13.349454 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 806/1646] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:25:12 2022] DELETE /identity/v3/users/9226c32c3a6e4e3cbb453c722c4e45f7 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:13.354556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b657b83-bff4-4349-8ba7-b52dc2959680 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:13.355394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b657b83-bff4-4349-8ba7-b52dc2959680 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:13.355685 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b657b83-bff4-4349-8ba7-b52dc2959680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:13.405399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2b657b83-bff4-4349-8ba7-b52dc2959680 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:13.406676 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2b657b83-bff4-4349-8ba7-b52dc2959680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:13.515388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d099f3-b8ca-4c73-9cb0-e8447d39d3f6 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:13.516196 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-97d099f3-b8ca-4c73-9cb0-e8447d39d3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:13.567871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:13.589947 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 841/1647] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:13.611200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b657b83-bff4-4349-8ba7-b52dc2959680 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:13.613396 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2b657b83-bff4-4349-8ba7-b52dc2959680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:13.791187 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d099f3-b8ca-4c73-9cb0-e8447d39d3f6 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:13.797991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b657b83-bff4-4349-8ba7-b52dc2959680 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:13.807073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bde28-c195-4e06-91cc-820b5ebae042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:13.807994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bde28-c195-4e06-91cc-820b5ebae042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:13.808552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bde28-c195-4e06-91cc-820b5ebae042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:13.809019 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bde28-c195-4e06-91cc-820b5ebae042 admin admin] PATH_INFO: `/v3/users/a3c23e69a445419ba9024fe991bbf821` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:13.811217 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b4739-09d5-4e3e-bf0a-faf5aa01f721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:13.811712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0bde28-c195-4e06-91cc-820b5ebae042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c23e69a445419ba9024fe991bbf821)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:13.811868 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b4739-09d5-4e3e-bf0a-faf5aa01f721 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:13.812152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b4739-09d5-4e3e-bf0a-faf5aa01f721 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:13.812502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b4739-09d5-4e3e-bf0a-faf5aa01f721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:13.815716 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0bde28-c195-4e06-91cc-820b5ebae042 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:13.837890 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b4739-09d5-4e3e-bf0a-faf5aa01f721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:13.840143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b4739-09d5-4e3e-bf0a-faf5aa01f721 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:13.879263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 842/1648] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:13.935173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1f0bde28-c195-4e06-91cc-820b5ebae042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c23e69a445419ba9024fe991bbf821'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:13.936228 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1f0bde28-c195-4e06-91cc-820b5ebae042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c23e69a445419ba9024fe991bbf821'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:13.954403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1f0bde28-c195-4e06-91cc-820b5ebae042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c23e69a445419ba9024fe991bbf821'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:13.988704 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1f0bde28-c195-4e06-91cc-820b5ebae042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c23e69a445419ba9024fe991bbf821'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:14.012978 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1f0bde28-c195-4e06-91cc-820b5ebae042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c23e69a445419ba9024fe991bbf821'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:14.023754 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 807/1649] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:25:13 2022] DELETE /identity/v3/users/a3c23e69a445419ba9024fe991bbf821 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:25:14.028239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d787b61-f13d-48f0-b765-7ba7b5b0a784 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:14.028803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d787b61-f13d-48f0-b765-7ba7b5b0a784 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:14.028803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d787b61-f13d-48f0-b765-7ba7b5b0a784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:14.069868 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2d787b61-f13d-48f0-b765-7ba7b5b0a784 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:14.071435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2d787b61-f13d-48f0-b765-7ba7b5b0a784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:14.233677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 843/1650] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:14.284403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bde28-c195-4e06-91cc-820b5ebae042 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:14.293106 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1f0bde28-c195-4e06-91cc-820b5ebae042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:14.342055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:14.488424 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bde28-c195-4e06-91cc-820b5ebae042 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:14.499485 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adc434-f8a6-4065-bb5e-4606468e638e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:14.500156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adc434-f8a6-4065-bb5e-4606468e638e service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:14.500474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adc434-f8a6-4065-bb5e-4606468e638e service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:14.500759 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adc434-f8a6-4065-bb5e-4606468e638e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:14.542312 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03adc434-f8a6-4065-bb5e-4606468e638e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:14.544222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03adc434-f8a6-4065-bb5e-4606468e638e service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:14.568187 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 808/1651] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:16.291312 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d787b61-f13d-48f0-b765-7ba7b5b0a784 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:16.294582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2d787b61-f13d-48f0-b765-7ba7b5b0a784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:16.321282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d787b61-f13d-48f0-b765-7ba7b5b0a784 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:16.341073 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1553060-1190-4e6f-a1ff-2e75d2f7d260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:16.342391 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1553060-1190-4e6f-a1ff-2e75d2f7d260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:16.344968 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1553060-1190-4e6f-a1ff-2e75d2f7d260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:16.345496 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1553060-1190-4e6f-a1ff-2e75d2f7d260 admin admin] PATH_INFO: `/v3/projects/51ed8706fbfb4b37ad908fba9d6df98b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:16.348204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1553060-1190-4e6f-a1ff-2e75d2f7d260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ed8706fbfb4b37ad908fba9d6df98b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:16.351579 dv-cinder-826608-8-smb devstack@keystone.service[80117]: WARNING py.warnings [None req-f1553060-1190-4e6f-a1ff-2e75d2f7d260 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:25:16.351579 dv-cinder-826608-8-smb devstack@keystone.service[80117]: warnings.warn(msg) Aug 04 10:25:16.351579 dv-cinder-826608-8-smb devstack@keystone.service[80117]: Aug 04 10:25:16.353616 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1553060-1190-4e6f-a1ff-2e75d2f7d260 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:16.524950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f1553060-1190-4e6f-a1ff-2e75d2f7d260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ed8706fbfb4b37ad908fba9d6df98b', 'request_id': 'req-f1553060-1190-4e6f-a1ff-2e75d2f7d260'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:16.569876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f1553060-1190-4e6f-a1ff-2e75d2f7d260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ed8706fbfb4b37ad908fba9d6df98b', 'request_id': 'req-f1553060-1190-4e6f-a1ff-2e75d2f7d260'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:16.597823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f1553060-1190-4e6f-a1ff-2e75d2f7d260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ed8706fbfb4b37ad908fba9d6df98b', 'request_id': 'req-f1553060-1190-4e6f-a1ff-2e75d2f7d260'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:16.618963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adc434-f8a6-4065-bb5e-4606468e638e service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:16.621034 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-03adc434-f8a6-4065-bb5e-4606468e638e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:16.633943 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f1553060-1190-4e6f-a1ff-2e75d2f7d260 admin admin] The token cache is being invalidate because project 51ed8706fbfb4b37ad908fba9d6df98b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:25:16.634748 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f1553060-1190-4e6f-a1ff-2e75d2f7d260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:16.638320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f1553060-1190-4e6f-a1ff-2e75d2f7d260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:16.647206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adc434-f8a6-4065-bb5e-4606468e638e service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:16.651005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 844/1652] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:25:16 2022] DELETE /identity/v3/projects/51ed8706fbfb4b37ad908fba9d6df98b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:16.669281 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0395e9e-d7fb-4294-b042-32a8242f90ce None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:16.669572 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0395e9e-d7fb-4294-b042-32a8242f90ce None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:16.671744 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0395e9e-d7fb-4294-b042-32a8242f90ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:16.755199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e0395e9e-d7fb-4294-b042-32a8242f90ce None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:16.758430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e0395e9e-d7fb-4294-b042-32a8242f90ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:16.845575 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b450f2-6272-4bb1-846a-d90d30b68411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:16.846456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b450f2-6272-4bb1-846a-d90d30b68411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:16.847310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b450f2-6272-4bb1-846a-d90d30b68411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:16.848515 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b450f2-6272-4bb1-846a-d90d30b68411 admin admin] PATH_INFO: `/v3/projects/b609a282793b44d4b4b472872723497c` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:16.853512 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b450f2-6272-4bb1-846a-d90d30b68411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b609a282793b44d4b4b472872723497c)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:16.859620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b450f2-6272-4bb1-846a-d90d30b68411 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:16.862400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:17.016970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-45b450f2-6272-4bb1-846a-d90d30b68411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b609a282793b44d4b4b472872723497c', 'request_id': 'req-45b450f2-6272-4bb1-846a-d90d30b68411'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:17.036324 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-45b450f2-6272-4bb1-846a-d90d30b68411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b609a282793b44d4b4b472872723497c', 'request_id': 'req-45b450f2-6272-4bb1-846a-d90d30b68411'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:17.054665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 845/1653] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:25:17.057782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a599-cf4c-496c-9148-05799cfd956b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:17.058229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a599-cf4c-496c-9148-05799cfd956b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:17.058518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a599-cf4c-496c-9148-05799cfd956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:17.065954 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-45b450f2-6272-4bb1-846a-d90d30b68411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b609a282793b44d4b4b472872723497c', 'request_id': 'req-45b450f2-6272-4bb1-846a-d90d30b68411'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:17.087563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-45b450f2-6272-4bb1-846a-d90d30b68411 admin admin] The token cache is being invalidate because project b609a282793b44d4b4b472872723497c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:25:17.087875 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-45b450f2-6272-4bb1-846a-d90d30b68411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:17.089727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-ddb9a599-cf4c-496c-9148-05799cfd956b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:17.090611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-45b450f2-6272-4bb1-846a-d90d30b68411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:17.091182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ddb9a599-cf4c-496c-9148-05799cfd956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:17.094200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 809/1654] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:25:16 2022] DELETE /identity/v3/projects/b609a282793b44d4b4b472872723497c => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:17.098923 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35299cdf-615b-47b2-b681-d6dd181fa5b0 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:17.100084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35299cdf-615b-47b2-b681-d6dd181fa5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:17.100240 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35299cdf-615b-47b2-b681-d6dd181fa5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:17.164135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-35299cdf-615b-47b2-b681-d6dd181fa5b0 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:17.165658 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-35299cdf-615b-47b2-b681-d6dd181fa5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:17.299878 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 846/1655] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:17.307126 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9a599-cf4c-496c-9148-05799cfd956b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:17.335294 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9a599-cf4c-496c-9148-05799cfd956b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:17.338823 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:17.354781 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14208fc0-ad1a-430e-83a5-0b6e8a1178ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:17.357204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14208fc0-ad1a-430e-83a5-0b6e8a1178ca admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:17.358047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14208fc0-ad1a-430e-83a5-0b6e8a1178ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:17.359068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14208fc0-ad1a-430e-83a5-0b6e8a1178ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:17.362617 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14208fc0-ad1a-430e-83a5-0b6e8a1178ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:25:17.363226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14208fc0-ad1a-430e-83a5-0b6e8a1178ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:17.370387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14208fc0-ad1a-430e-83a5-0b6e8a1178ca admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:17.393910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 810/1656] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:25:17.404119 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abbbf3-2627-4975-a1f4-e8536bcfe9a3 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:17.404437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abbbf3-2627-4975-a1f4-e8536bcfe9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:17.406110 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abbbf3-2627-4975-a1f4-e8536bcfe9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:17.411546 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 847/1657] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:25:17.417198 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14208fc0-ad1a-430e-83a5-0b6e8a1178ca admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:17.436233 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14208fc0-ad1a-430e-83a5-0b6e8a1178ca admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:17.457700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4691b-9b1d-45d9-8c9c-d8bf2be11631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:17.458545 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4691b-9b1d-45d9-8c9c-d8bf2be11631 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:17.459163 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4691b-9b1d-45d9-8c9c-d8bf2be11631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:17.460362 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4691b-9b1d-45d9-8c9c-d8bf2be11631 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:17.461265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4691b-9b1d-45d9-8c9c-d8bf2be11631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:17.463434 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4691b-9b1d-45d9-8c9c-d8bf2be11631 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:17.492386 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d6abbbf3-2627-4975-a1f4-e8536bcfe9a3 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:17.495680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d6abbbf3-2627-4975-a1f4-e8536bcfe9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:17.531295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 811/1658] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:17.531492 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 848/1659] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:17 2022] POST /identity/v3/projects => generated 397 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:17.531584 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abbbf3-2627-4975-a1f4-e8536bcfe9a3 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:17.533680 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4691b-9b1d-45d9-8c9c-d8bf2be11631 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:17.566954 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abbbf3-2627-4975-a1f4-e8536bcfe9a3 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:17.661244 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4691b-9b1d-45d9-8c9c-d8bf2be11631 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:17.675775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c6274-5bad-4b8d-9494-a3a547a83ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:17.676698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c6274-5bad-4b8d-9494-a3a547a83ead admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:17.676976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c6274-5bad-4b8d-9494-a3a547a83ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:17.677318 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c6274-5bad-4b8d-9494-a3a547a83ead admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:17.678416 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c6274-5bad-4b8d-9494-a3a547a83ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:17.682939 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c6274-5bad-4b8d-9494-a3a547a83ead admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:17.701138 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f091a0-d0e4-443e-b1e1-6c521a6b9613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:17.701852 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f091a0-d0e4-443e-b1e1-6c521a6b9613 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:17.702197 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f091a0-d0e4-443e-b1e1-6c521a6b9613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:17.702659 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f091a0-d0e4-443e-b1e1-6c521a6b9613 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:17.703399 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f091a0-d0e4-443e-b1e1-6c521a6b9613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:25:17.703710 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f091a0-d0e4-443e-b1e1-6c521a6b9613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:17.705377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f091a0-d0e4-443e-b1e1-6c521a6b9613 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:17.729574 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 812/1660] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:25:17.734799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 849/1661] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:17 2022] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:17.734949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f091a0-d0e4-443e-b1e1-6c521a6b9613 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:17.735872 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c6274-5bad-4b8d-9494-a3a547a83ead admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:17.757798 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f091a0-d0e4-443e-b1e1-6c521a6b9613 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:17.762195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c6274-5bad-4b8d-9494-a3a547a83ead admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:17.771832 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b81237-ce5e-43fd-987f-5dda9855681b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:17.772860 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c1b48-33b1-49e1-aa5b-e9870813292c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:17.773277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b81237-ce5e-43fd-987f-5dda9855681b admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:17.773500 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c1b48-33b1-49e1-aa5b-e9870813292c admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:17.773603 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b81237-ce5e-43fd-987f-5dda9855681b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:17.773791 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c1b48-33b1-49e1-aa5b-e9870813292c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:17.773984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b81237-ce5e-43fd-987f-5dda9855681b admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:17.774206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c1b48-33b1-49e1-aa5b-e9870813292c admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:17.775542 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c1b48-33b1-49e1-aa5b-e9870813292c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:17.775711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b81237-ce5e-43fd-987f-5dda9855681b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:17.777905 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b81237-ce5e-43fd-987f-5dda9855681b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:17.784660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c1b48-33b1-49e1-aa5b-e9870813292c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:17.807653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 850/1662] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:17.812278 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b81237-ce5e-43fd-987f-5dda9855681b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:17.836690 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b81237-ce5e-43fd-987f-5dda9855681b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:17.855143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a96774-5f45-4f94-b3b5-df7ba614116a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:17.857081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a96774-5f45-4f94-b3b5-df7ba614116a admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:17.857081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a96774-5f45-4f94-b3b5-df7ba614116a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:17.857081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a96774-5f45-4f94-b3b5-df7ba614116a admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:17.857411 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a96774-5f45-4f94-b3b5-df7ba614116a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:17.859703 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a96774-5f45-4f94-b3b5-df7ba614116a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:17.863947 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:17.872306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 813/1663] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:17 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:17.887046 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c1b48-33b1-49e1-aa5b-e9870813292c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:17.891702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 851/1664] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:17.892722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a96774-5f45-4f94-b3b5-df7ba614116a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:17.914423 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a96774-5f45-4f94-b3b5-df7ba614116a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:18.085793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c1b48-33b1-49e1-aa5b-e9870813292c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:18.087207 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760d4e6-b916-417c-91cd-369b1e9db11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:18.088005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760d4e6-b916-417c-91cd-369b1e9db11f admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:18.088317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760d4e6-b916-417c-91cd-369b1e9db11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:18.088598 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760d4e6-b916-417c-91cd-369b1e9db11f admin admin] PATH_INFO: `/v3/projects/e52c6eba88264157ab65a4176bdfe868/users/5586a966bd204ddc9139db86eb11398f/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:18.127393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c278a3-2681-4aa9-a064-71857e26edf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:18.128117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c278a3-2681-4aa9-a064-71857e26edf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:18.128433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c278a3-2681-4aa9-a064-71857e26edf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:18.128717 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c278a3-2681-4aa9-a064-71857e26edf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:18.129398 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c278a3-2681-4aa9-a064-71857e26edf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:18.141929 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c278a3-2681-4aa9-a064-71857e26edf3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:18.172872 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760d4e6-b916-417c-91cd-369b1e9db11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52c6eba88264157ab65a4176bdfe868, user_id=5586a966bd204ddc9139db86eb11398f, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:18.184296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760d4e6-b916-417c-91cd-369b1e9db11f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:18.220504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 852/1665] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:17 2022] PUT /identity/v3/projects/e52c6eba88264157ab65a4176bdfe868/users/5586a966bd204ddc9139db86eb11398f/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:18.226777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eee790-e509-4e43-9a1e-72831221b61d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:18.227064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eee790-e509-4e43-9a1e-72831221b61d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:18.227924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eee790-e509-4e43-9a1e-72831221b61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:18.228042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 814/1666] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:17 2022] POST /identity/v3/users => generated 291 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:18.234474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c278a3-2681-4aa9-a064-71857e26edf3 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:18.260148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c278a3-2681-4aa9-a064-71857e26edf3 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:18.291531 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-42eee790-e509-4e43-9a1e-72831221b61d None None] MFA Rules not processed for user `5586a966bd204ddc9139db86eb11398f`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:18.292867 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-42eee790-e509-4e43-9a1e-72831221b61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:18.356529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:18.432906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fbd84-c07f-4083-95c6-c4fc8711758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:18.433555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fbd84-c07f-4083-95c6-c4fc8711758a admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:18.433839 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fbd84-c07f-4083-95c6-c4fc8711758a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:18.434116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fbd84-c07f-4083-95c6-c4fc8711758a admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:18.434830 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fbd84-c07f-4083-95c6-c4fc8711758a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:18.436480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fbd84-c07f-4083-95c6-c4fc8711758a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:18.467140 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 815/1667] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:18.471551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fbd84-c07f-4083-95c6-c4fc8711758a admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:18.482318 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 853/1668] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:18 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:18.484085 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eee790-e509-4e43-9a1e-72831221b61d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:18.495356 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fbd84-c07f-4083-95c6-c4fc8711758a admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:18.505048 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eee790-e509-4e43-9a1e-72831221b61d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:18.509430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc14e9-6097-4617-908a-84b2e7f6cfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:18.509917 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc14e9-6097-4617-908a-84b2e7f6cfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:18.510200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc14e9-6097-4617-908a-84b2e7f6cfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:18.510478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc14e9-6097-4617-908a-84b2e7f6cfc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:18.511183 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc14e9-6097-4617-908a-84b2e7f6cfc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:18.512832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc14e9-6097-4617-908a-84b2e7f6cfc3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:18.522597 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eac38b-ff2f-48d3-a665-5ca52a42399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:18.524268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eac38b-ff2f-48d3-a665-5ca52a42399c admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:18.525034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eac38b-ff2f-48d3-a665-5ca52a42399c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:18.526231 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eac38b-ff2f-48d3-a665-5ca52a42399c admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:18.527599 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eac38b-ff2f-48d3-a665-5ca52a42399c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:18.532541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eac38b-ff2f-48d3-a665-5ca52a42399c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:18.556859 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 816/1669] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:25:18.560115 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc14e9-6097-4617-908a-84b2e7f6cfc3 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:18.584847 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc14e9-6097-4617-908a-84b2e7f6cfc3 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:18.604154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 854/1670] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:18 2022] POST /identity/v3/projects => generated 399 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:18.605402 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4550f1a-a846-4120-b6ca-d38bf1b757c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:18.605833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eac38b-ff2f-48d3-a665-5ca52a42399c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:18.606807 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4550f1a-a846-4120-b6ca-d38bf1b757c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:18.607055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4550f1a-a846-4120-b6ca-d38bf1b757c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:18.607359 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4550f1a-a846-4120-b6ca-d38bf1b757c2 admin admin] PATH_INFO: `/v3/projects/31e9e1de94594e9699f5c64e9f09e8f3/users/2be2ebcbfa754cbfa2b3f6354d7b1117/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:18.636793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4550f1a-a846-4120-b6ca-d38bf1b757c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e9e1de94594e9699f5c64e9f09e8f3, user_id=2be2ebcbfa754cbfa2b3f6354d7b1117, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:18.639746 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4550f1a-a846-4120-b6ca-d38bf1b757c2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:18.670165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 817/1671] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:18 2022] PUT /identity/v3/projects/31e9e1de94594e9699f5c64e9f09e8f3/users/2be2ebcbfa754cbfa2b3f6354d7b1117/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:18.682570 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a4d96-7b4b-44d4-9494-18876d31b7a4 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:18.682864 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a4d96-7b4b-44d4-9494-18876d31b7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:18.683149 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a4d96-7b4b-44d4-9494-18876d31b7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:18.727876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:18.745473 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eac38b-ff2f-48d3-a665-5ca52a42399c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:18.787248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4f3a4d96-7b4b-44d4-9494-18876d31b7a4 None None] MFA Rules not processed for user `2be2ebcbfa754cbfa2b3f6354d7b1117`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:18.788779 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4f3a4d96-7b4b-44d4-9494-18876d31b7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:18.879429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a1921-8941-4b7b-9f23-35c6a6b8b8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:18.880085 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a1921-8941-4b7b-9f23-35c6a6b8b8cc admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:18.880487 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a1921-8941-4b7b-9f23-35c6a6b8b8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:18.881809 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a1921-8941-4b7b-9f23-35c6a6b8b8cc admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:18.882508 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a1921-8941-4b7b-9f23-35c6a6b8b8cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:18.885354 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a1921-8941-4b7b-9f23-35c6a6b8b8cc admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:18.919172 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 818/1672] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:25:18.923666 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a4d96-7b4b-44d4-9494-18876d31b7a4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:18.939330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 855/1673] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:18 2022] POST /identity/v3/users => generated 306 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:25:18.944783 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a1921-8941-4b7b-9f23-35c6a6b8b8cc admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:18.950030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a4d96-7b4b-44d4-9494-18876d31b7a4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:18.961586 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c82bc-30a3-4397-affc-9f88229fe023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:18.962241 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c82bc-30a3-4397-affc-9f88229fe023 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:18.962527 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c82bc-30a3-4397-affc-9f88229fe023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:18.962832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c82bc-30a3-4397-affc-9f88229fe023 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:18.963759 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c82bc-30a3-4397-affc-9f88229fe023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:18.965763 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c82bc-30a3-4397-affc-9f88229fe023 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:18.978868 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a1921-8941-4b7b-9f23-35c6a6b8b8cc admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:18.993758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abca694-4854-4d06-92d3-e1c5327d3c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:18.994624 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abca694-4854-4d06-92d3-e1c5327d3c01 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:18.994972 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abca694-4854-4d06-92d3-e1c5327d3c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:18.995255 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abca694-4854-4d06-92d3-e1c5327d3c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:18.996117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abca694-4854-4d06-92d3-e1c5327d3c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:18.999709 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abca694-4854-4d06-92d3-e1c5327d3c01 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:19.032483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 856/1674] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:19.035715 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abca694-4854-4d06-92d3-e1c5327d3c01 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:19.060061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abca694-4854-4d06-92d3-e1c5327d3c01 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:19.074552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f5319-67fa-428d-b1df-405388c16ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:19.075294 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f5319-67fa-428d-b1df-405388c16ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:19.075580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f5319-67fa-428d-b1df-405388c16ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:19.075940 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f5319-67fa-428d-b1df-405388c16ad2 admin admin] PATH_INFO: `/v3/projects/9e8189ba8ec84279af90e285297a4ac3/users/480e979f66df40b7bff2a9a7e8c94b07/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:19.078489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 819/1675] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:18 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:19.083027 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c82bc-30a3-4397-affc-9f88229fe023 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:19.124533 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f5319-67fa-428d-b1df-405388c16ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8189ba8ec84279af90e285297a4ac3, user_id=480e979f66df40b7bff2a9a7e8c94b07, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:19.127642 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f5319-67fa-428d-b1df-405388c16ad2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:19.173999 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 857/1676] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:19 2022] PUT /identity/v3/projects/9e8189ba8ec84279af90e285297a4ac3/users/480e979f66df40b7bff2a9a7e8c94b07/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:25:19.179254 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f5319-67fa-428d-b1df-405388c16ad2 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:19.336055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c82bc-30a3-4397-affc-9f88229fe023 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:19.435996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:19.445854 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f5319-67fa-428d-b1df-405388c16ad2 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:19.459474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48d42b-08f7-4cce-814b-e6bd69d4f083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:19.461163 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48d42b-08f7-4cce-814b-e6bd69d4f083 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:19.461892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48d42b-08f7-4cce-814b-e6bd69d4f083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:19.461892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48d42b-08f7-4cce-814b-e6bd69d4f083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:19.463922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48d42b-08f7-4cce-814b-e6bd69d4f083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:19.465886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48d42b-08f7-4cce-814b-e6bd69d4f083 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:19.527296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 858/1677] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:19.531558 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48d42b-08f7-4cce-814b-e6bd69d4f083 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:19.565292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48d42b-08f7-4cce-814b-e6bd69d4f083 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:19.594243 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4f2f0-e266-44ca-b71f-bc41cd97b553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:19.595241 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4f2f0-e266-44ca-b71f-bc41cd97b553 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:19.595666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4f2f0-e266-44ca-b71f-bc41cd97b553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:19.596112 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4f2f0-e266-44ca-b71f-bc41cd97b553 admin admin] PATH_INFO: `/v3/projects/9e8189ba8ec84279af90e285297a4ac3/users/480e979f66df40b7bff2a9a7e8c94b07/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:19.597584 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91418ebc-dbdc-46c1-8d40-2b3afa6eaf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:19.598238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91418ebc-dbdc-46c1-8d40-2b3afa6eaf25 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:19.598521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91418ebc-dbdc-46c1-8d40-2b3afa6eaf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:19.598803 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91418ebc-dbdc-46c1-8d40-2b3afa6eaf25 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:19.600128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91418ebc-dbdc-46c1-8d40-2b3afa6eaf25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:19.603944 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91418ebc-dbdc-46c1-8d40-2b3afa6eaf25 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:19.604397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4f2f0-e266-44ca-b71f-bc41cd97b553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8189ba8ec84279af90e285297a4ac3, user_id=480e979f66df40b7bff2a9a7e8c94b07, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:19.615200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4f2f0-e266-44ca-b71f-bc41cd97b553 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:19.649993 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 859/1678] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:19 2022] PUT /identity/v3/projects/9e8189ba8ec84279af90e285297a4ac3/users/480e979f66df40b7bff2a9a7e8c94b07/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:19.663592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30581e-4210-4719-836e-12629b1351b4 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:19.663891 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30581e-4210-4719-836e-12629b1351b4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:19.664270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30581e-4210-4719-836e-12629b1351b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:19.683817 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 820/1679] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:19 2022] POST /identity/v3/users => generated 297 bytes in 601 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:19.687867 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91418ebc-dbdc-46c1-8d40-2b3afa6eaf25 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:19.713435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3a30581e-4210-4719-836e-12629b1351b4 None None] MFA Rules not processed for user `480e979f66df40b7bff2a9a7e8c94b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:19.714992 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3a30581e-4210-4719-836e-12629b1351b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:19.734250 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91418ebc-dbdc-46c1-8d40-2b3afa6eaf25 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:19.744067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:19.838071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 860/1680] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:19 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:25:19.941050 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be532a92-4bae-41a5-bd68-4cc86fc3722a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:19.945840 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be532a92-4bae-41a5-bd68-4cc86fc3722a admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:19.946325 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be532a92-4bae-41a5-bd68-4cc86fc3722a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:19.948226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be532a92-4bae-41a5-bd68-4cc86fc3722a admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:19.949305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be532a92-4bae-41a5-bd68-4cc86fc3722a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:19.952782 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be532a92-4bae-41a5-bd68-4cc86fc3722a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:19.983980 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 821/1681] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:19.988286 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30581e-4210-4719-836e-12629b1351b4 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:20.015587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30581e-4210-4719-836e-12629b1351b4 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:20.027673 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86733450-2d8a-4b71-bc98-c51a4beb85d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:20.029781 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86733450-2d8a-4b71-bc98-c51a4beb85d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:20.031300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86733450-2d8a-4b71-bc98-c51a4beb85d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:20.031300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86733450-2d8a-4b71-bc98-c51a4beb85d0 admin admin] PATH_INFO: `/v3/projects/d383a4b8120d44a6a566be2d06c26a2d/users/c0f66bb78a3b4a5e97efd23805358276/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:20.111884 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86733450-2d8a-4b71-bc98-c51a4beb85d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d383a4b8120d44a6a566be2d06c26a2d, user_id=c0f66bb78a3b4a5e97efd23805358276, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:20.113986 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bd37a-c364-4d02-91c8-4bc8dbc5cd73 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:20.114237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bd37a-c364-4d02-91c8-4bc8dbc5cd73 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:20.114517 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bd37a-c364-4d02-91c8-4bc8dbc5cd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:20.121806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86733450-2d8a-4b71-bc98-c51a4beb85d0 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:20.158316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 861/1682] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:19 2022] PUT /identity/v3/projects/d383a4b8120d44a6a566be2d06c26a2d/users/c0f66bb78a3b4a5e97efd23805358276/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:20.164313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86733450-2d8a-4b71-bc98-c51a4beb85d0 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:20.225612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-970bd37a-c364-4d02-91c8-4bc8dbc5cd73 None None] MFA Rules not processed for user `93e3f08697b14594af221fcc1773e592`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:20.228258 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-970bd37a-c364-4d02-91c8-4bc8dbc5cd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:20.363234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86733450-2d8a-4b71-bc98-c51a4beb85d0 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:20.381516 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6974a-8f5e-437f-bc07-87c0fd622268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:20.382389 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6974a-8f5e-437f-bc07-87c0fd622268 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:20.382684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6974a-8f5e-437f-bc07-87c0fd622268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:20.382967 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6974a-8f5e-437f-bc07-87c0fd622268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:20.383975 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6974a-8f5e-437f-bc07-87c0fd622268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:20.395072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6974a-8f5e-437f-bc07-87c0fd622268 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:20.434215 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 862/1683] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:20.435149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6974a-8f5e-437f-bc07-87c0fd622268 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:20.440584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-baa6974a-8f5e-437f-bc07-87c0fd622268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:20.448635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 822/1684] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:20.449519 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bd37a-c364-4d02-91c8-4bc8dbc5cd73 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:20.484765 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bd37a-c364-4d02-91c8-4bc8dbc5cd73 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:20.500086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb65c9c-55b6-4ce8-9bc3-bbde1d354fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:20.500816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb65c9c-55b6-4ce8-9bc3-bbde1d354fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:20.501136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb65c9c-55b6-4ce8-9bc3-bbde1d354fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:20.501435 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb65c9c-55b6-4ce8-9bc3-bbde1d354fc0 admin admin] PATH_INFO: `/v3/projects/d383a4b8120d44a6a566be2d06c26a2d/users/c0f66bb78a3b4a5e97efd23805358276/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:20.506985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb65c9c-55b6-4ce8-9bc3-bbde1d354fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d383a4b8120d44a6a566be2d06c26a2d, user_id=c0f66bb78a3b4a5e97efd23805358276, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:20.514301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb65c9c-55b6-4ce8-9bc3-bbde1d354fc0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:20.542940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 823/1685] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:20 2022] PUT /identity/v3/projects/d383a4b8120d44a6a566be2d06c26a2d/users/c0f66bb78a3b4a5e97efd23805358276/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:20.544625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb65c9c-55b6-4ce8-9bc3-bbde1d354fc0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:20.551511 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7fb65c9c-55b6-4ce8-9bc3-bbde1d354fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:20.614473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:20.623620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6974a-8f5e-437f-bc07-87c0fd622268 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:20.752040 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb65c9c-55b6-4ce8-9bc3-bbde1d354fc0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:20.759464 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:20.768156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a484731-3098-4d24-95e6-8e449d7ba8fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:20.768954 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a484731-3098-4d24-95e6-8e449d7ba8fd service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:20.769222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a484731-3098-4d24-95e6-8e449d7ba8fd service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:20.770601 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a484731-3098-4d24-95e6-8e449d7ba8fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:20.805710 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f3788-6e10-42a4-8b04-7becc56bdb0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:20.806708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f3788-6e10-42a4-8b04-7becc56bdb0c service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:20.807166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f3788-6e10-42a4-8b04-7becc56bdb0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:20.809740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f3788-6e10-42a4-8b04-7becc56bdb0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:20.935277 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a484731-3098-4d24-95e6-8e449d7ba8fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:20.940381 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a484731-3098-4d24-95e6-8e449d7ba8fd service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:20.982928 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 824/1686] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:20.995497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f3788-6e10-42a4-8b04-7becc56bdb0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:20.999281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673f780-7291-47b5-aa5f-08ce13eb9dbd None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:21.001653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f3788-6e10-42a4-8b04-7becc56bdb0c service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:21.002891 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673f780-7291-47b5-aa5f-08ce13eb9dbd None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:21.003169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673f780-7291-47b5-aa5f-08ce13eb9dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:21.030980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 863/1687] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:20 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:21.142509 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3673f780-7291-47b5-aa5f-08ce13eb9dbd None None] MFA Rules not processed for user `c0f66bb78a3b4a5e97efd23805358276`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:21.143773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3673f780-7291-47b5-aa5f-08ce13eb9dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:21.416286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 825/1688] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:21.577798 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f3788-6e10-42a4-8b04-7becc56bdb0c service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:21.592565 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f3788-6e10-42a4-8b04-7becc56bdb0c service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:21.611530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858aaf14-aa09-48a1-b374-81d8dfe894fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:21.616274 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858aaf14-aa09-48a1-b374-81d8dfe894fd service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:21.617793 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858aaf14-aa09-48a1-b374-81d8dfe894fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:21.618098 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858aaf14-aa09-48a1-b374-81d8dfe894fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:21.622846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673f780-7291-47b5-aa5f-08ce13eb9dbd None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:21.641026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3673f780-7291-47b5-aa5f-08ce13eb9dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:21.663528 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673f780-7291-47b5-aa5f-08ce13eb9dbd None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:21.669595 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88b962-9509-4e19-9f26-5a095b9e5f80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:21.670814 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88b962-9509-4e19-9f26-5a095b9e5f80 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:21.671707 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88b962-9509-4e19-9f26-5a095b9e5f80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:21.672097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88b962-9509-4e19-9f26-5a095b9e5f80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:21.692627 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88b962-9509-4e19-9f26-5a095b9e5f80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:21.695517 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88b962-9509-4e19-9f26-5a095b9e5f80 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:21.727399 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 826/1689] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:25:21.879217 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858aaf14-aa09-48a1-b374-81d8dfe894fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:21.883266 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858aaf14-aa09-48a1-b374-81d8dfe894fd service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:21.908653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 864/1690] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:21 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:22.344512 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88b962-9509-4e19-9f26-5a095b9e5f80 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:22.370310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88b962-9509-4e19-9f26-5a095b9e5f80 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:22.387668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff43de-af34-4f51-94b4-1b2ba79d16c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:22.389746 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff43de-af34-4f51-94b4-1b2ba79d16c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:22.390769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff43de-af34-4f51-94b4-1b2ba79d16c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:22.391081 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff43de-af34-4f51-94b4-1b2ba79d16c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:22.449013 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:22.528207 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7a70e-0430-417d-bf79-7a694ee7b895 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:22.528504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7a70e-0430-417d-bf79-7a694ee7b895 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:22.528790 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7a70e-0430-417d-bf79-7a694ee7b895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:22.533042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff43de-af34-4f51-94b4-1b2ba79d16c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:22.541127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff43de-af34-4f51-94b4-1b2ba79d16c2 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:22.562183 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 827/1691] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:22.583581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-14b7a70e-0430-417d-bf79-7a694ee7b895 None None] MFA Rules not processed for user `9c26da44165845babfb18a1c6ae51d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:22.586545 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-14b7a70e-0430-417d-bf79-7a694ee7b895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:22.828232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 865/1692] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:22.837154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f402-d9fe-466c-b586-de24a0377a44 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:22.837477 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f402-d9fe-466c-b586-de24a0377a44 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:22.837761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f402-d9fe-466c-b586-de24a0377a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:22.888242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ac52f402-d9fe-466c-b586-de24a0377a44 None None] MFA Rules not processed for user `9c26da44165845babfb18a1c6ae51d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:22.896001 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ac52f402-d9fe-466c-b586-de24a0377a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:22.945052 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 828/1693] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:22.962286 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7a70e-0430-417d-bf79-7a694ee7b895 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:22.980901 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7a70e-0430-417d-bf79-7a694ee7b895 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:22.998539 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8a93d-9afb-420f-902a-d7bfe9e44a23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:22.999259 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8a93d-9afb-420f-902a-d7bfe9e44a23 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:22.999466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8a93d-9afb-420f-902a-d7bfe9e44a23 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:22.999750 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8a93d-9afb-420f-902a-d7bfe9e44a23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:23.044346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8a93d-9afb-420f-902a-d7bfe9e44a23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:23.065997 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8a93d-9afb-420f-902a-d7bfe9e44a23 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:23.096899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 866/1694] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:24.355862 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85e603-832d-4600-a540-471144954799 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:24.356571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85e603-832d-4600-a540-471144954799 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:24.357103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85e603-832d-4600-a540-471144954799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:24.486095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282d1a8-6de6-4669-8faf-91f48ff4240e None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:24.487533 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282d1a8-6de6-4669-8faf-91f48ff4240e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:24.488433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282d1a8-6de6-4669-8faf-91f48ff4240e None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:24.491647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 867/1695] 10.222.0.48 () {54 vars in 912 bytes} [Thu Aug 4 10:25:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:25:24.527207 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c2a87-dd10-4fd4-90c8-3e18c412076f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:24.527708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c2a87-dd10-4fd4-90c8-3e18c412076f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:24.528064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c2a87-dd10-4fd4-90c8-3e18c412076f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:24.565718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-8b85e603-832d-4600-a540-471144954799 None None] MFA Rules not processed for user `a7faaaa36a964813b0d9ec887fabb6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:24.568369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:24.569640 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8b85e603-832d-4600-a540-471144954799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:24.657319 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-743c2a87-dd10-4fd4-90c8-3e18c412076f None None] MFA Rules not processed for user `2021ac71491f4bebb0fbd91c533dc383`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:24.662811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-743c2a87-dd10-4fd4-90c8-3e18c412076f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:24.742964 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 829/1696] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:24.759176 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dbca2-79ad-4303-850f-b7193c7fb12d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:24.759603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dbca2-79ad-4303-850f-b7193c7fb12d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:24.759791 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dbca2-79ad-4303-850f-b7193c7fb12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:24.766267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 868/1697] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Aug 4 10:25:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:24.789596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c2a87-dd10-4fd4-90c8-3e18c412076f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:24.794375 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-743c2a87-dd10-4fd4-90c8-3e18c412076f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:24.813116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-239dbca2-79ad-4303-850f-b7193c7fb12d None None] MFA Rules not processed for user `a7faaaa36a964813b0d9ec887fabb6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:24.815168 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-239dbca2-79ad-4303-850f-b7193c7fb12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:24.824825 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c2a87-dd10-4fd4-90c8-3e18c412076f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:24.832336 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b688d62-a4fd-44b3-9087-3ad5cf8c86b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:24.834111 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b688d62-a4fd-44b3-9087-3ad5cf8c86b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:24.834504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b688d62-a4fd-44b3-9087-3ad5cf8c86b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:24.834939 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b688d62-a4fd-44b3-9087-3ad5cf8c86b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:24.837942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 830/1698] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:24.847167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b688d62-a4fd-44b3-9087-3ad5cf8c86b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:24.849018 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dbca2-79ad-4303-850f-b7193c7fb12d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:24.849932 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b688d62-a4fd-44b3-9087-3ad5cf8c86b9 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:24.851764 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-239dbca2-79ad-4303-850f-b7193c7fb12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:24.864031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 869/1699] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:25:24.879336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dbca2-79ad-4303-850f-b7193c7fb12d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:24.889052 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd48c1-df76-42bf-bc9c-373e74a05bb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:24.890278 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd48c1-df76-42bf-bc9c-373e74a05bb4 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:24.890763 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd48c1-df76-42bf-bc9c-373e74a05bb4 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:24.891284 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd48c1-df76-42bf-bc9c-373e74a05bb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:24.919120 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd48c1-df76-42bf-bc9c-373e74a05bb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:24.921544 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd48c1-df76-42bf-bc9c-373e74a05bb4 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:24.953468 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 831/1700] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:25:25.978760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a212c5-fc69-490e-991a-c546451dbede None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:25.979315 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a212c5-fc69-490e-991a-c546451dbede None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:25.979315 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a212c5-fc69-490e-991a-c546451dbede None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:25.980720 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 870/1701] 10.222.0.48 () {54 vars in 961 bytes} [Thu Aug 4 10:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:25:25.994027 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f1559-0899-4566-8250-75bcb39322a7 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:25.995338 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f1559-0899-4566-8250-75bcb39322a7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:25.995880 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f1559-0899-4566-8250-75bcb39322a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:26.093532 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a66f1559-0899-4566-8250-75bcb39322a7 None None] MFA Rules not processed for user `0005b0c9582e430e9cb85704a4505bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:26.102376 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a66f1559-0899-4566-8250-75bcb39322a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:26.238572 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a212c5-fc69-490e-991a-c546451dbede None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:26.243543 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a5a212c5-fc69-490e-991a-c546451dbede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:26.508525 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 832/1702] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Aug 4 10:25:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:25:26.517194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a212c5-fc69-490e-991a-c546451dbede None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:26.526721 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ef320-86ea-4458-84de-340488f55619 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:26.528800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ef320-86ea-4458-84de-340488f55619 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:26.529739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ef320-86ea-4458-84de-340488f55619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:26.532544 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d7d19-15d1-42e9-84af-a89e61088f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:26.538885 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d7d19-15d1-42e9-84af-a89e61088f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:26.540418 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d7d19-15d1-42e9-84af-a89e61088f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:26.540865 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d7d19-15d1-42e9-84af-a89e61088f9f admin admin] PATH_INFO: `/v3/users/732b215394e44dc9a77a257a7f35de0c` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:26.543458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d7d19-15d1-42e9-84af-a89e61088f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=732b215394e44dc9a77a257a7f35de0c)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:26.557755 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d7d19-15d1-42e9-84af-a89e61088f9f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:26.613021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-692ef320-86ea-4458-84de-340488f55619 None None] MFA Rules not processed for user `9c26da44165845babfb18a1c6ae51d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:26.623507 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-692ef320-86ea-4458-84de-340488f55619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:26.659506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 833/1703] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:26.662128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ef320-86ea-4458-84de-340488f55619 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:26.681982 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f14d7d19-15d1-42e9-84af-a89e61088f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732b215394e44dc9a77a257a7f35de0c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:26.682803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f14d7d19-15d1-42e9-84af-a89e61088f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732b215394e44dc9a77a257a7f35de0c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:26.700928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f14d7d19-15d1-42e9-84af-a89e61088f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732b215394e44dc9a77a257a7f35de0c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:26.702412 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f14d7d19-15d1-42e9-84af-a89e61088f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732b215394e44dc9a77a257a7f35de0c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:26.703100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ef320-86ea-4458-84de-340488f55619 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:26.716741 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b739eb0-9d4d-43a8-89f8-acc3460943ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0005b0c9582e430e9cb85704a4505bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:26.719005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b739eb0-9d4d-43a8-89f8-acc3460943ab service placement] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:26.720687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b739eb0-9d4d-43a8-89f8-acc3460943ab service placement] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:26.722345 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b739eb0-9d4d-43a8-89f8-acc3460943ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:26.729991 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9b739eb0-9d4d-43a8-89f8-acc3460943ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:26.758073 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f14d7d19-15d1-42e9-84af-a89e61088f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732b215394e44dc9a77a257a7f35de0c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:26.787749 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b739eb0-9d4d-43a8-89f8-acc3460943ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:26.791062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 871/1704] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:25:26 2022] DELETE /identity/v3/users/732b215394e44dc9a77a257a7f35de0c => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:26.794520 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c83e8-9d0c-478e-9d6d-6dd5d3ad8a7d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:26.795987 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c83e8-9d0c-478e-9d6d-6dd5d3ad8a7d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:26.796954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c83e8-9d0c-478e-9d6d-6dd5d3ad8a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:26.810111 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b739eb0-9d4d-43a8-89f8-acc3460943ab service placement] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:26.855894 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6c5c83e8-9d0c-478e-9d6d-6dd5d3ad8a7d None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:26.859415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6c5c83e8-9d0c-478e-9d6d-6dd5d3ad8a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:26.869568 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 834/1705] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:26.869568 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22788629-4f9f-46dc-88e7-2b32a079697b None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:26.869568 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22788629-4f9f-46dc-88e7-2b32a079697b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:26.869568 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22788629-4f9f-46dc-88e7-2b32a079697b None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:26.888343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 835/1706] 10.222.0.48 () {54 vars in 912 bytes} [Thu Aug 4 10:25:26 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:25:26.888598 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:26.890893 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9cb98-48d4-48dd-b9ee-ea4bc9f32670 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:26.891364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9cb98-48d4-48dd-b9ee-ea4bc9f32670 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:26.891846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9cb98-48d4-48dd-b9ee-ea4bc9f32670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:26.975974 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-5fd9cb98-48d4-48dd-b9ee-ea4bc9f32670 None None] MFA Rules not processed for user `2021ac71491f4bebb0fbd91c533dc383`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:26.984863 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5fd9cb98-48d4-48dd-b9ee-ea4bc9f32670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:27.018828 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:27.175981 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 872/1707] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:25:27.211592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c83e8-9d0c-478e-9d6d-6dd5d3ad8a7d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:27.214575 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6c5c83e8-9d0c-478e-9d6d-6dd5d3ad8a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:27.214990 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 836/1708] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Aug 4 10:25:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:27.245915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c83e8-9d0c-478e-9d6d-6dd5d3ad8a7d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:27.258162 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9cb98-48d4-48dd-b9ee-ea4bc9f32670 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:27.269156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7d538-8980-415d-9873-646ab9455065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:27.272541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7d538-8980-415d-9873-646ab9455065 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:27.273626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7d538-8980-415d-9873-646ab9455065 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:27.273927 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7d538-8980-415d-9873-646ab9455065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:27.283378 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9cb98-48d4-48dd-b9ee-ea4bc9f32670 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:27.297703 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7c13e-63ac-4a3a-b38f-560faf86e556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:27.298364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7c13e-63ac-4a3a-b38f-560faf86e556 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:27.298677 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7c13e-63ac-4a3a-b38f-560faf86e556 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:27.299044 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7c13e-63ac-4a3a-b38f-560faf86e556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:27.327055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7c13e-63ac-4a3a-b38f-560faf86e556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:27.328972 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7c13e-63ac-4a3a-b38f-560faf86e556 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:27.330589 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7d538-8980-415d-9873-646ab9455065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:27.336977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7d538-8980-415d-9873-646ab9455065 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:27.358979 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 837/1709] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:27.384596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 873/1710] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:28.104335 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4656c63-c0b5-4230-a62f-418f64c04d8a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:28.105340 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4656c63-c0b5-4230-a62f-418f64c04d8a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:28.105846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4656c63-c0b5-4230-a62f-418f64c04d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:28.197535 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-f4656c63-c0b5-4230-a62f-418f64c04d8a None None] MFA Rules not processed for user `93e3f08697b14594af221fcc1773e592`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:28.200956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f4656c63-c0b5-4230-a62f-418f64c04d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:28.492627 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 838/1711] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:29.636679 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7d538-8980-415d-9873-646ab9455065 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:29.639047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d5e7d538-8980-415d-9873-646ab9455065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:29.675240 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7d538-8980-415d-9873-646ab9455065 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:29.701250 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c22c41-9e25-4ba9-b393-484e10a5aef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:29.713586 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c22c41-9e25-4ba9-b393-484e10a5aef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:29.719278 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c22c41-9e25-4ba9-b393-484e10a5aef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:29.720693 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c22c41-9e25-4ba9-b393-484e10a5aef6 admin admin] PATH_INFO: `/v3/projects/25ed0e6479074312880a98cacc630a98` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:29.725255 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c22c41-9e25-4ba9-b393-484e10a5aef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25ed0e6479074312880a98cacc630a98)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:29.729932 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c22c41-9e25-4ba9-b393-484e10a5aef6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:29.960091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-75c22c41-9e25-4ba9-b393-484e10a5aef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25ed0e6479074312880a98cacc630a98', 'request_id': 'req-75c22c41-9e25-4ba9-b393-484e10a5aef6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:29.981513 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-75c22c41-9e25-4ba9-b393-484e10a5aef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25ed0e6479074312880a98cacc630a98', 'request_id': 'req-75c22c41-9e25-4ba9-b393-484e10a5aef6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:30.010385 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-75c22c41-9e25-4ba9-b393-484e10a5aef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25ed0e6479074312880a98cacc630a98', 'request_id': 'req-75c22c41-9e25-4ba9-b393-484e10a5aef6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:30.066019 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-75c22c41-9e25-4ba9-b393-484e10a5aef6 admin admin] The token cache is being invalidate because project 25ed0e6479074312880a98cacc630a98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:25:30.068716 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-75c22c41-9e25-4ba9-b393-484e10a5aef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:30.071036 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-75c22c41-9e25-4ba9-b393-484e10a5aef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:30.076534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 874/1712] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:25:29 2022] DELETE /identity/v3/projects/25ed0e6479074312880a98cacc630a98 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:25:30.082241 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997cc9b-8034-4198-a6d2-262931d2d860 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:30.082845 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997cc9b-8034-4198-a6d2-262931d2d860 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:30.083328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997cc9b-8034-4198-a6d2-262931d2d860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:30.152406 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c997cc9b-8034-4198-a6d2-262931d2d860 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:30.157140 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c997cc9b-8034-4198-a6d2-262931d2d860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:30.411147 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 839/1713] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:30.414077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75995638-6c81-4f0e-a42d-6d620ef959ef None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:30.414756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75995638-6c81-4f0e-a42d-6d620ef959ef None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:30.415145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75995638-6c81-4f0e-a42d-6d620ef959ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:30.486408 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-75995638-6c81-4f0e-a42d-6d620ef959ef None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:30.489295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-75995638-6c81-4f0e-a42d-6d620ef959ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:30.545928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 875/1714] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:30.550808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997cc9b-8034-4198-a6d2-262931d2d860 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:30.568351 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997cc9b-8034-4198-a6d2-262931d2d860 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:30.585139 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3cc71-a264-4988-b7fe-155fd5dfa3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:30.586134 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3cc71-a264-4988-b7fe-155fd5dfa3ad admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:30.586652 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3cc71-a264-4988-b7fe-155fd5dfa3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:30.587751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3cc71-a264-4988-b7fe-155fd5dfa3ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:30.588733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3cc71-a264-4988-b7fe-155fd5dfa3ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:25:30.589282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3cc71-a264-4988-b7fe-155fd5dfa3ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:30.594883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3cc71-a264-4988-b7fe-155fd5dfa3ad admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:30.639279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 840/1715] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:25:30.643802 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75995638-6c81-4f0e-a42d-6d620ef959ef None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:30.659870 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75995638-6c81-4f0e-a42d-6d620ef959ef None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:30.675203 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a757697-eea5-4e69-bdf5-fdc7b1e7a0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:30.677240 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a757697-eea5-4e69-bdf5-fdc7b1e7a0db admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:30.678295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a757697-eea5-4e69-bdf5-fdc7b1e7a0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:30.679003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a757697-eea5-4e69-bdf5-fdc7b1e7a0db admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:30.680070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a757697-eea5-4e69-bdf5-fdc7b1e7a0db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:30.689613 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a757697-eea5-4e69-bdf5-fdc7b1e7a0db admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:30.762334 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 876/1716] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:30 2022] POST /identity/v3/projects => generated 405 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:30.766878 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3cc71-a264-4988-b7fe-155fd5dfa3ad admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:30.797903 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3cc71-a264-4988-b7fe-155fd5dfa3ad admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:31.017706 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:31.188683 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fc447-e39b-4b6b-b3ab-26eeb6213a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:31.189402 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fc447-e39b-4b6b-b3ab-26eeb6213a25 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:31.189595 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fc447-e39b-4b6b-b3ab-26eeb6213a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:31.195065 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fc447-e39b-4b6b-b3ab-26eeb6213a25 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:31.197044 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fc447-e39b-4b6b-b3ab-26eeb6213a25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:31.216219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fc447-e39b-4b6b-b3ab-26eeb6213a25 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:31.312228 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 841/1717] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:30 2022] POST /identity/v3/users => generated 303 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:25:31.313175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a757697-eea5-4e69-bdf5-fdc7b1e7a0db admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:31.330795 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a757697-eea5-4e69-bdf5-fdc7b1e7a0db admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:31.388892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16b841-48c1-4fb8-ba15-019488fe1459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:31.389547 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16b841-48c1-4fb8-ba15-019488fe1459 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:31.389828 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16b841-48c1-4fb8-ba15-019488fe1459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:31.390099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16b841-48c1-4fb8-ba15-019488fe1459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:31.391896 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16b841-48c1-4fb8-ba15-019488fe1459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:31.393847 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16b841-48c1-4fb8-ba15-019488fe1459 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:31.443317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 877/1718] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:25:31.448088 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fc447-e39b-4b6b-b3ab-26eeb6213a25 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:31.481778 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fc447-e39b-4b6b-b3ab-26eeb6213a25 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:31.540146 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac934e0a-1a4c-46e6-a0d9-4cc7579ae0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:31.540998 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac934e0a-1a4c-46e6-a0d9-4cc7579ae0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:31.541281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac934e0a-1a4c-46e6-a0d9-4cc7579ae0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:31.541555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac934e0a-1a4c-46e6-a0d9-4cc7579ae0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:31.542286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac934e0a-1a4c-46e6-a0d9-4cc7579ae0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:31.543928 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac934e0a-1a4c-46e6-a0d9-4cc7579ae0c6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:31.604916 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 842/1719] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:31.611059 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16b841-48c1-4fb8-ba15-019488fe1459 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:31.653960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16b841-48c1-4fb8-ba15-019488fe1459 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:31.681104 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dbc32-03e0-41d2-b885-34f64114c41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:31.682052 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dbc32-03e0-41d2-b885-34f64114c41e admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:31.682473 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dbc32-03e0-41d2-b885-34f64114c41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:31.682917 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dbc32-03e0-41d2-b885-34f64114c41e admin admin] PATH_INFO: `/v3/projects/25ef2c331df44630b506f91fcd96933b/users/91adbad6f9bb47048544894d8066e022/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:31.722914 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dbc32-03e0-41d2-b885-34f64114c41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=25ef2c331df44630b506f91fcd96933b, user_id=91adbad6f9bb47048544894d8066e022, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:31.737125 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dbc32-03e0-41d2-b885-34f64114c41e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:31.782284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 878/1720] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:31 2022] PUT /identity/v3/projects/25ef2c331df44630b506f91fcd96933b/users/91adbad6f9bb47048544894d8066e022/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:31.796853 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5395a2-7312-4482-a01b-cfc022dbc9d1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:31.797511 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5395a2-7312-4482-a01b-cfc022dbc9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:31.798018 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5395a2-7312-4482-a01b-cfc022dbc9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:31.886419 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-2e5395a2-7312-4482-a01b-cfc022dbc9d1 None None] MFA Rules not processed for user `91adbad6f9bb47048544894d8066e022`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:31.891591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2e5395a2-7312-4482-a01b-cfc022dbc9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:31.970245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dbc32-03e0-41d2-b885-34f64114c41e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:31.972655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8d8dbc32-03e0-41d2-b885-34f64114c41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:32.075494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:32.254372 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 843/1721] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:31 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:32.259453 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5395a2-7312-4482-a01b-cfc022dbc9d1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:32.335459 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dbc32-03e0-41d2-b885-34f64114c41e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:32.356592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa17cb-48f8-4f3f-b1e9-fe8d8f2f33ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:32.357277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa17cb-48f8-4f3f-b1e9-fe8d8f2f33ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:32.357569 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa17cb-48f8-4f3f-b1e9-fe8d8f2f33ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:32.357854 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa17cb-48f8-4f3f-b1e9-fe8d8f2f33ab admin admin] PATH_INFO: `/v3/users/5586a966bd204ddc9139db86eb11398f` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:32.365692 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa17cb-48f8-4f3f-b1e9-fe8d8f2f33ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=5586a966bd204ddc9139db86eb11398f)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:32.377925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa17cb-48f8-4f3f-b1e9-fe8d8f2f33ab admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:32.557270 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5395a2-7312-4482-a01b-cfc022dbc9d1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:32.572268 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d18dbd-f46a-4287-9c15-ec98f143c1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:32.573295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d18dbd-f46a-4287-9c15-ec98f143c1aa admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:32.573793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d18dbd-f46a-4287-9c15-ec98f143c1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:32.574956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d18dbd-f46a-4287-9c15-ec98f143c1aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:32.576107 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d18dbd-f46a-4287-9c15-ec98f143c1aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:32.578415 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d18dbd-f46a-4287-9c15-ec98f143c1aa admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:32.590664 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3caa17cb-48f8-4f3f-b1e9-fe8d8f2f33ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5586a966bd204ddc9139db86eb11398f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:32.595404 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3caa17cb-48f8-4f3f-b1e9-fe8d8f2f33ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5586a966bd204ddc9139db86eb11398f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:32.636751 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3caa17cb-48f8-4f3f-b1e9-fe8d8f2f33ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5586a966bd204ddc9139db86eb11398f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:32.640954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3caa17cb-48f8-4f3f-b1e9-fe8d8f2f33ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5586a966bd204ddc9139db86eb11398f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:32.682426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 844/1722] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:32 2022] POST /identity/v3/projects => generated 403 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:32.684483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d37b7e-77f9-419f-ad06-97a07c4c6a06 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:32.685219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d37b7e-77f9-419f-ad06-97a07c4c6a06 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:32.685905 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d37b7e-77f9-419f-ad06-97a07c4c6a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:32.690189 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3caa17cb-48f8-4f3f-b1e9-fe8d8f2f33ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5586a966bd204ddc9139db86eb11398f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:32.721841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 879/1723] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:25:31 2022] DELETE /identity/v3/users/5586a966bd204ddc9139db86eb11398f => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:32.725466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa17cb-48f8-4f3f-b1e9-fe8d8f2f33ab admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:32.727735 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3caa17cb-48f8-4f3f-b1e9-fe8d8f2f33ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:32.977231 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:32.991107 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-36d37b7e-77f9-419f-ad06-97a07c4c6a06 None None] MFA Rules not processed for user `306a5f4d7e0d44bd9a27145bd35a07fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:33.006821 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-36d37b7e-77f9-419f-ad06-97a07c4c6a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:33.066475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa17cb-48f8-4f3f-b1e9-fe8d8f2f33ab admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:33.083530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04c43f-fbaa-48fa-91d3-8086d11a7f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:33.084580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04c43f-fbaa-48fa-91d3-8086d11a7f1e admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:33.085244 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04c43f-fbaa-48fa-91d3-8086d11a7f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:33.085736 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04c43f-fbaa-48fa-91d3-8086d11a7f1e admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:33.086678 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04c43f-fbaa-48fa-91d3-8086d11a7f1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:33.089585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04c43f-fbaa-48fa-91d3-8086d11a7f1e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:33.134387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 880/1724] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:32 2022] POST /identity/v3/users => generated 308 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:33.136560 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a358d4-95ea-413c-a820-d04e368f7a4c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:33.137115 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a358d4-95ea-413c-a820-d04e368f7a4c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:33.137606 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a358d4-95ea-413c-a820-d04e368f7a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:33.198604 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-20a358d4-95ea-413c-a820-d04e368f7a4c None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:33.200679 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-20a358d4-95ea-413c-a820-d04e368f7a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:33.215041 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 845/1725] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Aug 4 10:25:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 532 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:33.218898 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d37b7e-77f9-419f-ad06-97a07c4c6a06 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:33.238280 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 881/1726] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:33.283398 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d37b7e-77f9-419f-ad06-97a07c4c6a06 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:33.301734 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5add24-6891-48ef-922f-3246fb17e5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:33.303089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5add24-6891-48ef-922f-3246fb17e5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:33.317782 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5add24-6891-48ef-922f-3246fb17e5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:33.318241 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5add24-6891-48ef-922f-3246fb17e5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:33.319119 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5add24-6891-48ef-922f-3246fb17e5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:33.322013 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5add24-6891-48ef-922f-3246fb17e5c0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:33.364765 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 846/1727] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:33.369416 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a358d4-95ea-413c-a820-d04e368f7a4c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:33.392834 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a358d4-95ea-413c-a820-d04e368f7a4c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:33.403053 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5add24-6891-48ef-922f-3246fb17e5c0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:33.405001 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8d5add24-6891-48ef-922f-3246fb17e5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:33.417712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d14ce-03d0-4f73-9d80-25aeafa8335d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:33.420226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d14ce-03d0-4f73-9d80-25aeafa8335d admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:33.422055 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d14ce-03d0-4f73-9d80-25aeafa8335d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:33.423800 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d14ce-03d0-4f73-9d80-25aeafa8335d admin admin] PATH_INFO: `/v3/projects/6d785ec0b87e489280d28f669dcc6a1f/users/27cfc37e8e714e1cbba3761c9dea7f50/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:33.481382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d14ce-03d0-4f73-9d80-25aeafa8335d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d785ec0b87e489280d28f669dcc6a1f, user_id=27cfc37e8e714e1cbba3761c9dea7f50, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:33.493487 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d14ce-03d0-4f73-9d80-25aeafa8335d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:33.510962 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:33.532651 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 882/1728] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:33 2022] PUT /identity/v3/projects/6d785ec0b87e489280d28f669dcc6a1f/users/27cfc37e8e714e1cbba3761c9dea7f50/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:33.536963 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d14ce-03d0-4f73-9d80-25aeafa8335d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:33.542385 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-330d14ce-03d0-4f73-9d80-25aeafa8335d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:33.627901 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5add24-6891-48ef-922f-3246fb17e5c0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:33.743073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c8b8a-ed24-4d5c-9876-6a37be840b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:33.744230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c8b8a-ed24-4d5c-9876-6a37be840b57 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:33.744766 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c8b8a-ed24-4d5c-9876-6a37be840b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:33.745938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c8b8a-ed24-4d5c-9876-6a37be840b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:33.888235 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d14ce-03d0-4f73-9d80-25aeafa8335d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:33.914687 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e4e0c-7dfa-48f0-bec0-3b86279e70c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878797620be54b74a3e8582c78ba78d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:33.915645 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c8b8a-ed24-4d5c-9876-6a37be840b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:33.915759 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e4e0c-7dfa-48f0-bec0-3b86279e70c9 service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:33.915949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e4e0c-7dfa-48f0-bec0-3b86279e70c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:33.916673 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e4e0c-7dfa-48f0-bec0-3b86279e70c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:33.925585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c8b8a-ed24-4d5c-9876-6a37be840b57 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:33.939934 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:33.952226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 847/1729] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:25:33.957046 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c8b8a-ed24-4d5c-9876-6a37be840b57 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:33.977132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c8b8a-ed24-4d5c-9876-6a37be840b57 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:33.988987 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac1a38-0901-48ec-a0c8-e93b131e6633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:33.991468 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac1a38-0901-48ec-a0c8-e93b131e6633 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:33.991783 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac1a38-0901-48ec-a0c8-e93b131e6633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:33.992068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac1a38-0901-48ec-a0c8-e93b131e6633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:33.994572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac1a38-0901-48ec-a0c8-e93b131e6633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:33.998823 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac1a38-0901-48ec-a0c8-e93b131e6633 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:34.040712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 848/1730] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:34.048364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac1a38-0901-48ec-a0c8-e93b131e6633 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:34.085938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac1a38-0901-48ec-a0c8-e93b131e6633 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:34.105855 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e4e0c-7dfa-48f0-bec0-3b86279e70c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:34.107271 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98954c65-6e6d-4616-b630-3ddb31e8ab3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:34.107992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98954c65-6e6d-4616-b630-3ddb31e8ab3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:34.110336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98954c65-6e6d-4616-b630-3ddb31e8ab3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:34.110746 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98954c65-6e6d-4616-b630-3ddb31e8ab3e admin admin] PATH_INFO: `/v3/projects/6d785ec0b87e489280d28f669dcc6a1f/users/27cfc37e8e714e1cbba3761c9dea7f50/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:34.111937 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e4e0c-7dfa-48f0-bec0-3b86279e70c9 service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:34.117066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98954c65-6e6d-4616-b630-3ddb31e8ab3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d785ec0b87e489280d28f669dcc6a1f, user_id=27cfc37e8e714e1cbba3761c9dea7f50, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:34.127567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98954c65-6e6d-4616-b630-3ddb31e8ab3e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:34.139347 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 883/1731] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Aug 4 10:25:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 10:25:34.184220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e4e0c-7dfa-48f0-bec0-3b86279e70c9 service swift] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:34.188558 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ce6e4e0c-7dfa-48f0-bec0-3b86279e70c9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:34.225590 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 849/1732] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:34 2022] PUT /identity/v3/projects/6d785ec0b87e489280d28f669dcc6a1f/users/27cfc37e8e714e1cbba3761c9dea7f50/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:34.239700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e79b71-032a-42d0-980d-6e2f5e7f0669 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:34.240995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e79b71-032a-42d0-980d-6e2f5e7f0669 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:34.242021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e79b71-032a-42d0-980d-6e2f5e7f0669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:34.259782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e4e0c-7dfa-48f0-bec0-3b86279e70c9 service swift] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:34.385661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a0e79b71-032a-42d0-980d-6e2f5e7f0669 None None] MFA Rules not processed for user `27cfc37e8e714e1cbba3761c9dea7f50`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:34.399741 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a0e79b71-032a-42d0-980d-6e2f5e7f0669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:34.551502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ad983-dec9-443e-831a-3a7075c24526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:34.555408 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ad983-dec9-443e-831a-3a7075c24526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:34.555742 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ad983-dec9-443e-831a-3a7075c24526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:34.556033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ad983-dec9-443e-831a-3a7075c24526 admin admin] PATH_INFO: `/v3/users/2be2ebcbfa754cbfa2b3f6354d7b1117` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:34.574670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ad983-dec9-443e-831a-3a7075c24526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be2ebcbfa754cbfa2b3f6354d7b1117)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:34.590172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ad983-dec9-443e-831a-3a7075c24526 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:34.726264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:34.835593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 850/1733] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:34 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 600 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:34.854170 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e79b71-032a-42d0-980d-6e2f5e7f0669 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:34.855721 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a0e79b71-032a-42d0-980d-6e2f5e7f0669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:34.922755 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3d9ad983-dec9-443e-831a-3a7075c24526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be2ebcbfa754cbfa2b3f6354d7b1117'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:34.928826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3d9ad983-dec9-443e-831a-3a7075c24526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be2ebcbfa754cbfa2b3f6354d7b1117'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:34.994728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3d9ad983-dec9-443e-831a-3a7075c24526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be2ebcbfa754cbfa2b3f6354d7b1117'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:34.999045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3d9ad983-dec9-443e-831a-3a7075c24526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be2ebcbfa754cbfa2b3f6354d7b1117'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:35.020057 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e79b71-032a-42d0-980d-6e2f5e7f0669 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:35.041638 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ed2c9-ede1-4a9f-95ac-2b55a27ec71b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:35.042977 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ed2c9-ede1-4a9f-95ac-2b55a27ec71b service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:35.043271 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ed2c9-ede1-4a9f-95ac-2b55a27ec71b service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:35.043559 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ed2c9-ede1-4a9f-95ac-2b55a27ec71b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:35.050984 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-853ed2c9-ede1-4a9f-95ac-2b55a27ec71b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:35.094581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ed2c9-ede1-4a9f-95ac-2b55a27ec71b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:35.096516 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ed2c9-ede1-4a9f-95ac-2b55a27ec71b service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:35.102437 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3d9ad983-dec9-443e-831a-3a7075c24526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be2ebcbfa754cbfa2b3f6354d7b1117'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:35.147695 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 884/1734] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:25:34 2022] DELETE /identity/v3/users/2be2ebcbfa754cbfa2b3f6354d7b1117 => generated 0 bytes in 962 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:35.147879 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 851/1735] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:34 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:25:35.158364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862408f-a731-42d9-99be-b9a3e9a7a283 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:35.165698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862408f-a731-42d9-99be-b9a3e9a7a283 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:35.165698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862408f-a731-42d9-99be-b9a3e9a7a283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:35.231089 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8862408f-a731-42d9-99be-b9a3e9a7a283 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:35.263772 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8862408f-a731-42d9-99be-b9a3e9a7a283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:35.475363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 885/1736] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:35.481054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ed2c9-ede1-4a9f-95ac-2b55a27ec71b service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:35.483156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-853ed2c9-ede1-4a9f-95ac-2b55a27ec71b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:35.529189 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862408f-a731-42d9-99be-b9a3e9a7a283 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:35.545397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8862408f-a731-42d9-99be-b9a3e9a7a283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:35.603893 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862408f-a731-42d9-99be-b9a3e9a7a283 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:35.620428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130817d-b73e-47f3-96dc-55bbd625e481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:35.623387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130817d-b73e-47f3-96dc-55bbd625e481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:35.626946 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130817d-b73e-47f3-96dc-55bbd625e481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:35.629841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130817d-b73e-47f3-96dc-55bbd625e481 admin admin] PATH_INFO: `/v3/users/91adbad6f9bb47048544894d8066e022` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:35.634731 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130817d-b73e-47f3-96dc-55bbd625e481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91adbad6f9bb47048544894d8066e022)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:35.641742 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130817d-b73e-47f3-96dc-55bbd625e481 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:35.850922 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ed2c9-ede1-4a9f-95ac-2b55a27ec71b service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:35.869046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c130817d-b73e-47f3-96dc-55bbd625e481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91adbad6f9bb47048544894d8066e022'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:35.870341 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c130817d-b73e-47f3-96dc-55bbd625e481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91adbad6f9bb47048544894d8066e022'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:35.890891 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c130817d-b73e-47f3-96dc-55bbd625e481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91adbad6f9bb47048544894d8066e022'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:35.897630 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c130817d-b73e-47f3-96dc-55bbd625e481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91adbad6f9bb47048544894d8066e022'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:35.910200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:35.943324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c130817d-b73e-47f3-96dc-55bbd625e481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91adbad6f9bb47048544894d8066e022'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:35.982348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 886/1737] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:25:35 2022] DELETE /identity/v3/users/91adbad6f9bb47048544894d8066e022 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:35.989389 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80209bd-dda4-437e-a439-8dba296dae24 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:35.990716 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80209bd-dda4-437e-a439-8dba296dae24 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:35.994141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80209bd-dda4-437e-a439-8dba296dae24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:36.039611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42350e2d-5f9c-450b-a5a6-08e22b2f3893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:36.040313 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42350e2d-5f9c-450b-a5a6-08e22b2f3893 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:36.040600 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42350e2d-5f9c-450b-a5a6-08e22b2f3893 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:36.040882 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42350e2d-5f9c-450b-a5a6-08e22b2f3893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:36.046727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-42350e2d-5f9c-450b-a5a6-08e22b2f3893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:36.059812 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a80209bd-dda4-437e-a439-8dba296dae24 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:36.061309 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a80209bd-dda4-437e-a439-8dba296dae24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:36.090216 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:36.094259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42350e2d-5f9c-450b-a5a6-08e22b2f3893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:36.099435 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42350e2d-5f9c-450b-a5a6-08e22b2f3893 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:36.127033 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 852/1738] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:36.345367 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 887/1739] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:36.660927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42350e2d-5f9c-450b-a5a6-08e22b2f3893 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:36.665302 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-42350e2d-5f9c-450b-a5a6-08e22b2f3893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:36.704436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42350e2d-5f9c-450b-a5a6-08e22b2f3893 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:37.128750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c8bbe-bd1e-4327-8602-09b9ecc1cc15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:37.131331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c8bbe-bd1e-4327-8602-09b9ecc1cc15 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:37.132084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c8bbe-bd1e-4327-8602-09b9ecc1cc15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:37.132975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c8bbe-bd1e-4327-8602-09b9ecc1cc15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:37.169704 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c8bbe-bd1e-4327-8602-09b9ecc1cc15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:37.174396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c8bbe-bd1e-4327-8602-09b9ecc1cc15 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:37.229004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 853/1740] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:37.449403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8922b1-55b8-4547-b24b-bc91e6417a3a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:37.452075 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c8bbe-bd1e-4327-8602-09b9ecc1cc15 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:37.456081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8922b1-55b8-4547-b24b-bc91e6417a3a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:37.471899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8922b1-55b8-4547-b24b-bc91e6417a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:37.472131 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-797c8bbe-bd1e-4327-8602-09b9ecc1cc15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:37.554577 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c8bbe-bd1e-4327-8602-09b9ecc1cc15 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:37.574412 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-bd8922b1-55b8-4547-b24b-bc91e6417a3a None None] MFA Rules not processed for user `2021ac71491f4bebb0fbd91c533dc383`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:37.576095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-bd8922b1-55b8-4547-b24b-bc91e6417a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:37.588701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 888/1741] 10.222.0.109 () {58 vars in 1016 bytes} [Thu Aug 4 10:25:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:37.593004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650438c8-0bcc-4a2c-993d-500e94138ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:37.598697 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650438c8-0bcc-4a2c-993d-500e94138ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:37.599352 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650438c8-0bcc-4a2c-993d-500e94138ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:37.600090 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650438c8-0bcc-4a2c-993d-500e94138ba8 admin admin] PATH_INFO: `/v3/projects/e52c6eba88264157ab65a4176bdfe868` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:37.605422 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650438c8-0bcc-4a2c-993d-500e94138ba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e52c6eba88264157ab65a4176bdfe868)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:37.611082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8922b1-55b8-4547-b24b-bc91e6417a3a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:37.613715 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-bd8922b1-55b8-4547-b24b-bc91e6417a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:37.624417 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650438c8-0bcc-4a2c-993d-500e94138ba8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:37.658015 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8922b1-55b8-4547-b24b-bc91e6417a3a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:37.675093 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646e786-20e3-443b-b3d2-338c48f7196e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:37.678320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646e786-20e3-443b-b3d2-338c48f7196e service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:37.679189 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646e786-20e3-443b-b3d2-338c48f7196e service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:37.688288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646e786-20e3-443b-b3d2-338c48f7196e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:37.724589 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646e786-20e3-443b-b3d2-338c48f7196e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:37.732730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646e786-20e3-443b-b3d2-338c48f7196e service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:37.782241 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 889/1742] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:37.849798 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-650438c8-0bcc-4a2c-993d-500e94138ba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e52c6eba88264157ab65a4176bdfe868', 'request_id': 'req-650438c8-0bcc-4a2c-993d-500e94138ba8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:37.876126 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-650438c8-0bcc-4a2c-993d-500e94138ba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e52c6eba88264157ab65a4176bdfe868', 'request_id': 'req-650438c8-0bcc-4a2c-993d-500e94138ba8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:37.945289 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-650438c8-0bcc-4a2c-993d-500e94138ba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e52c6eba88264157ab65a4176bdfe868', 'request_id': 'req-650438c8-0bcc-4a2c-993d-500e94138ba8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:38.031962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-650438c8-0bcc-4a2c-993d-500e94138ba8 admin admin] The token cache is being invalidate because project e52c6eba88264157ab65a4176bdfe868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:25:38.032611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-650438c8-0bcc-4a2c-993d-500e94138ba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:38.034773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-650438c8-0bcc-4a2c-993d-500e94138ba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:38.045022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 854/1743] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:25:37 2022] DELETE /identity/v3/projects/e52c6eba88264157ab65a4176bdfe868 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:38.053885 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646e786-20e3-443b-b3d2-338c48f7196e service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:38.118344 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646e786-20e3-443b-b3d2-338c48f7196e service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:38.334529 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800698a8-2d54-482a-9845-e0397b07bf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:38.335487 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800698a8-2d54-482a-9845-e0397b07bf0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:38.335928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800698a8-2d54-482a-9845-e0397b07bf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:38.336488 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800698a8-2d54-482a-9845-e0397b07bf0a admin admin] PATH_INFO: `/v3/users/480e979f66df40b7bff2a9a7e8c94b07` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:38.338146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800698a8-2d54-482a-9845-e0397b07bf0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=480e979f66df40b7bff2a9a7e8c94b07)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:38.343343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800698a8-2d54-482a-9845-e0397b07bf0a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:38.465025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-800698a8-2d54-482a-9845-e0397b07bf0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '480e979f66df40b7bff2a9a7e8c94b07'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:38.467240 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-800698a8-2d54-482a-9845-e0397b07bf0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '480e979f66df40b7bff2a9a7e8c94b07'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:38.492397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-800698a8-2d54-482a-9845-e0397b07bf0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '480e979f66df40b7bff2a9a7e8c94b07'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:38.493723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-800698a8-2d54-482a-9845-e0397b07bf0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '480e979f66df40b7bff2a9a7e8c94b07'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:38.547831 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-800698a8-2d54-482a-9845-e0397b07bf0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '480e979f66df40b7bff2a9a7e8c94b07'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:38.643260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 890/1744] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:25:38 2022] DELETE /identity/v3/users/480e979f66df40b7bff2a9a7e8c94b07 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:39.475251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650438c8-0bcc-4a2c-993d-500e94138ba8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:39.480530 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-650438c8-0bcc-4a2c-993d-500e94138ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:39.555688 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650438c8-0bcc-4a2c-993d-500e94138ba8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:39.875923 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:39.925462 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae60fb-b688-4311-a189-fc9a91ae1b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:39.927842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae60fb-b688-4311-a189-fc9a91ae1b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:39.928229 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae60fb-b688-4311-a189-fc9a91ae1b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:39.940630 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae60fb-b688-4311-a189-fc9a91ae1b88 admin admin] PATH_INFO: `/v3/projects/31e9e1de94594e9699f5c64e9f09e8f3` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:39.943038 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae60fb-b688-4311-a189-fc9a91ae1b88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e9e1de94594e9699f5c64e9f09e8f3)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:39.946312 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae60fb-b688-4311-a189-fc9a91ae1b88 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:40.049144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800698a8-2d54-482a-9845-e0397b07bf0a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:40.050896 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-800698a8-2d54-482a-9845-e0397b07bf0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:40.083317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800698a8-2d54-482a-9845-e0397b07bf0a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:40.099740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058dc63d-7bb2-4384-9e0c-63c8d84914e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:40.101071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dc63d-7bb2-4384-9e0c-63c8d84914e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:40.101574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dc63d-7bb2-4384-9e0c-63c8d84914e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:40.102005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dc63d-7bb2-4384-9e0c-63c8d84914e6 admin admin] PATH_INFO: `/v3/users/570e82c285d942b28805a42ae24ca935` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:40.105892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058dc63d-7bb2-4384-9e0c-63c8d84914e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=570e82c285d942b28805a42ae24ca935)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:40.108399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058dc63d-7bb2-4384-9e0c-63c8d84914e6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:40.126155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:40.176623 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-75ae60fb-b688-4311-a189-fc9a91ae1b88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e9e1de94594e9699f5c64e9f09e8f3', 'request_id': 'req-75ae60fb-b688-4311-a189-fc9a91ae1b88'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:40.191687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-75ae60fb-b688-4311-a189-fc9a91ae1b88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e9e1de94594e9699f5c64e9f09e8f3', 'request_id': 'req-75ae60fb-b688-4311-a189-fc9a91ae1b88'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:40.225854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-75ae60fb-b688-4311-a189-fc9a91ae1b88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e9e1de94594e9699f5c64e9f09e8f3', 'request_id': 'req-75ae60fb-b688-4311-a189-fc9a91ae1b88'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:40.272328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-75ae60fb-b688-4311-a189-fc9a91ae1b88 admin admin] The token cache is being invalidate because project 31e9e1de94594e9699f5c64e9f09e8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:25:40.272786 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-75ae60fb-b688-4311-a189-fc9a91ae1b88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:40.273895 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-75ae60fb-b688-4311-a189-fc9a91ae1b88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:40.279114 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 855/1745] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:25:39 2022] DELETE /identity/v3/projects/31e9e1de94594e9699f5c64e9f09e8f3 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:40.280774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae60fb-b688-4311-a189-fc9a91ae1b88 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:40.283127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-75ae60fb-b688-4311-a189-fc9a91ae1b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:40.293095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-058dc63d-7bb2-4384-9e0c-63c8d84914e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '570e82c285d942b28805a42ae24ca935'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:40.298746 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-058dc63d-7bb2-4384-9e0c-63c8d84914e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '570e82c285d942b28805a42ae24ca935'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:40.351382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-058dc63d-7bb2-4384-9e0c-63c8d84914e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '570e82c285d942b28805a42ae24ca935'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:40.355975 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-058dc63d-7bb2-4384-9e0c-63c8d84914e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '570e82c285d942b28805a42ae24ca935'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:40.450384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-058dc63d-7bb2-4384-9e0c-63c8d84914e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '570e82c285d942b28805a42ae24ca935'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:40.531170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 891/1746] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:25:40 2022] DELETE /identity/v3/users/570e82c285d942b28805a42ae24ca935 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:40.531170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5b927-64b0-4077-b46f-773e3c956a2b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:40.531170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5b927-64b0-4077-b46f-773e3c956a2b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:40.531170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5b927-64b0-4077-b46f-773e3c956a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:40.570399 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae60fb-b688-4311-a189-fc9a91ae1b88 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:40.636152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e8d5b927-64b0-4077-b46f-773e3c956a2b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:40.637684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e8d5b927-64b0-4077-b46f-773e3c956a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:40.855762 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ae9c0-c40c-46aa-b1f8-3c67d0f6f015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:40.856833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ae9c0-c40c-46aa-b1f8-3c67d0f6f015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:40.860704 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ae9c0-c40c-46aa-b1f8-3c67d0f6f015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:40.861170 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ae9c0-c40c-46aa-b1f8-3c67d0f6f015 admin admin] PATH_INFO: `/v3/users/c0f66bb78a3b4a5e97efd23805358276` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:40.866085 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ae9c0-c40c-46aa-b1f8-3c67d0f6f015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f66bb78a3b4a5e97efd23805358276)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:40.872755 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ae9c0-c40c-46aa-b1f8-3c67d0f6f015 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:40.924105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 892/1747] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:40.944479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:40.959067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5b927-64b0-4077-b46f-773e3c956a2b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:40.964847 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e8d5b927-64b0-4077-b46f-773e3c956a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:41.069781 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d32ae9c0-c40c-46aa-b1f8-3c67d0f6f015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f66bb78a3b4a5e97efd23805358276'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:41.072753 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d32ae9c0-c40c-46aa-b1f8-3c67d0f6f015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f66bb78a3b4a5e97efd23805358276'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:41.107686 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d32ae9c0-c40c-46aa-b1f8-3c67d0f6f015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f66bb78a3b4a5e97efd23805358276'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:41.159057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5b927-64b0-4077-b46f-773e3c956a2b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:41.166767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c05fc-9b6f-46f6-a52d-992db3e937cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:41.166767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c05fc-9b6f-46f6-a52d-992db3e937cb service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:41.166767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c05fc-9b6f-46f6-a52d-992db3e937cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:41.167247 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c05fc-9b6f-46f6-a52d-992db3e937cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:41.169506 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-db1c05fc-9b6f-46f6-a52d-992db3e937cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:41.188528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c05fc-9b6f-46f6-a52d-992db3e937cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:41.190172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c05fc-9b6f-46f6-a52d-992db3e937cb service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:41.200235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d32ae9c0-c40c-46aa-b1f8-3c67d0f6f015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f66bb78a3b4a5e97efd23805358276'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:41.206490 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 893/1748] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:25:41.224798 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d32ae9c0-c40c-46aa-b1f8-3c67d0f6f015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f66bb78a3b4a5e97efd23805358276'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:41.260681 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 856/1749] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:25:40 2022] DELETE /identity/v3/users/c0f66bb78a3b4a5e97efd23805358276 => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:41.299680 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f936b06-885d-4aa3-83e2-3cf2453c9d2a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:41.300195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f936b06-885d-4aa3-83e2-3cf2453c9d2a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:41.300703 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f936b06-885d-4aa3-83e2-3cf2453c9d2a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:41.306999 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 894/1750] 10.222.0.48 () {54 vars in 921 bytes} [Thu Aug 4 10:25:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:25:41.749739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c32059-8dcb-4f17-b686-01b641fbb82b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:41.750317 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c32059-8dcb-4f17-b686-01b641fbb82b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:41.750883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c32059-8dcb-4f17-b686-01b641fbb82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:41.855245 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c9c32059-8dcb-4f17-b686-01b641fbb82b None None] MFA Rules not processed for user `592539924feb44ad8ea520d8539b6608`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:41.859626 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c9c32059-8dcb-4f17-b686-01b641fbb82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:42.144500 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 857/1751] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Aug 4 10:25:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:43.061654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f936b06-885d-4aa3-83e2-3cf2453c9d2a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:43.073620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1f936b06-885d-4aa3-83e2-3cf2453c9d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:43.162123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f936b06-885d-4aa3-83e2-3cf2453c9d2a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:43.206236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5409a4-6225-4f50-a8b9-5df9a7055863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:43.207770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5409a4-6225-4f50-a8b9-5df9a7055863 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:43.213164 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5409a4-6225-4f50-a8b9-5df9a7055863 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:43.213777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5409a4-6225-4f50-a8b9-5df9a7055863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:43.262052 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5409a4-6225-4f50-a8b9-5df9a7055863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:43.276566 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5409a4-6225-4f50-a8b9-5df9a7055863 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:43.328058 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 895/1752] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:43.678771 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c32059-8dcb-4f17-b686-01b641fbb82b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:43.688275 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c9c32059-8dcb-4f17-b686-01b641fbb82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:43.742268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5409a4-6225-4f50-a8b9-5df9a7055863 service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:43.744367 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5b5409a4-6225-4f50-a8b9-5df9a7055863 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:43.781914 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:43.913032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c32059-8dcb-4f17-b686-01b641fbb82b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:43.939483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e4f7e-62a2-4b9b-bfe2-e403db2009cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:43.941974 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e4f7e-62a2-4b9b-bfe2-e403db2009cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:43.943565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e4f7e-62a2-4b9b-bfe2-e403db2009cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:43.943878 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e4f7e-62a2-4b9b-bfe2-e403db2009cb admin admin] PATH_INFO: `/v3/projects/25ef2c331df44630b506f91fcd96933b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:43.954310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e4f7e-62a2-4b9b-bfe2-e403db2009cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=25ef2c331df44630b506f91fcd96933b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:43.961625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e4f7e-62a2-4b9b-bfe2-e403db2009cb admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:43.964680 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5409a4-6225-4f50-a8b9-5df9a7055863 service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:43.978921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85a0d5-2327-4f86-b1ba-3e3978dc521c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:43.980830 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85a0d5-2327-4f86-b1ba-3e3978dc521c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:43.981829 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85a0d5-2327-4f86-b1ba-3e3978dc521c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:43.981829 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85a0d5-2327-4f86-b1ba-3e3978dc521c admin admin] PATH_INFO: `/v3/projects/e545683f92824f5394855c0e08cb9f8e` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:43.983802 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85a0d5-2327-4f86-b1ba-3e3978dc521c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e545683f92824f5394855c0e08cb9f8e)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:43.988345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85a0d5-2327-4f86-b1ba-3e3978dc521c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:44.125317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7f85a0d5-2327-4f86-b1ba-3e3978dc521c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e545683f92824f5394855c0e08cb9f8e', 'request_id': 'req-7f85a0d5-2327-4f86-b1ba-3e3978dc521c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:44.131754 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:44.145426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7f85a0d5-2327-4f86-b1ba-3e3978dc521c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e545683f92824f5394855c0e08cb9f8e', 'request_id': 'req-7f85a0d5-2327-4f86-b1ba-3e3978dc521c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:44.168305 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7f85a0d5-2327-4f86-b1ba-3e3978dc521c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e545683f92824f5394855c0e08cb9f8e', 'request_id': 'req-7f85a0d5-2327-4f86-b1ba-3e3978dc521c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:44.174626 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-924e4f7e-62a2-4b9b-bfe2-e403db2009cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25ef2c331df44630b506f91fcd96933b', 'request_id': 'req-924e4f7e-62a2-4b9b-bfe2-e403db2009cb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:44.196955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7f85a0d5-2327-4f86-b1ba-3e3978dc521c admin admin] The token cache is being invalidate because project e545683f92824f5394855c0e08cb9f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:25:44.197378 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7f85a0d5-2327-4f86-b1ba-3e3978dc521c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:44.198755 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7f85a0d5-2327-4f86-b1ba-3e3978dc521c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:44.207355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 896/1753] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:25:43 2022] DELETE /identity/v3/projects/e545683f92824f5394855c0e08cb9f8e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:44.216606 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85a0d5-2327-4f86-b1ba-3e3978dc521c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:44.219271 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7f85a0d5-2327-4f86-b1ba-3e3978dc521c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:44.233725 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-924e4f7e-62a2-4b9b-bfe2-e403db2009cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25ef2c331df44630b506f91fcd96933b', 'request_id': 'req-924e4f7e-62a2-4b9b-bfe2-e403db2009cb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:44.271732 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-924e4f7e-62a2-4b9b-bfe2-e403db2009cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25ef2c331df44630b506f91fcd96933b', 'request_id': 'req-924e4f7e-62a2-4b9b-bfe2-e403db2009cb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:44.331717 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-924e4f7e-62a2-4b9b-bfe2-e403db2009cb admin admin] The token cache is being invalidate because project 25ef2c331df44630b506f91fcd96933b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:25:44.332460 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-924e4f7e-62a2-4b9b-bfe2-e403db2009cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:44.339120 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-924e4f7e-62a2-4b9b-bfe2-e403db2009cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:44.344856 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 858/1754] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:25:43 2022] DELETE /identity/v3/projects/25ef2c331df44630b506f91fcd96933b => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:44.350831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e4f7e-62a2-4b9b-bfe2-e403db2009cb admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:44.357163 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-924e4f7e-62a2-4b9b-bfe2-e403db2009cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:44.535052 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85a0d5-2327-4f86-b1ba-3e3978dc521c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:44.654877 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e4f7e-62a2-4b9b-bfe2-e403db2009cb admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:44.670946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fd1f9-02d7-4347-bacf-208ebd36c397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:44.671640 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fd1f9-02d7-4347-bacf-208ebd36c397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:44.671925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fd1f9-02d7-4347-bacf-208ebd36c397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:44.675296 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fd1f9-02d7-4347-bacf-208ebd36c397 admin admin] PATH_INFO: `/v3/users/27cfc37e8e714e1cbba3761c9dea7f50` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:44.679230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fd1f9-02d7-4347-bacf-208ebd36c397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27cfc37e8e714e1cbba3761c9dea7f50)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:44.690262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fd1f9-02d7-4347-bacf-208ebd36c397 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:44.719709 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:44.757071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b65ce-62b6-4f3e-90ad-46f6fc6e2d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:44.757782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b65ce-62b6-4f3e-90ad-46f6fc6e2d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:44.758112 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b65ce-62b6-4f3e-90ad-46f6fc6e2d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:44.758389 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b65ce-62b6-4f3e-90ad-46f6fc6e2d59 admin admin] PATH_INFO: `/v3/users/83b06c2583104a1dbad766a6efc7da89` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:44.761896 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b65ce-62b6-4f3e-90ad-46f6fc6e2d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b06c2583104a1dbad766a6efc7da89)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:44.764185 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b65ce-62b6-4f3e-90ad-46f6fc6e2d59 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:44.847982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e85fd1f9-02d7-4347-bacf-208ebd36c397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27cfc37e8e714e1cbba3761c9dea7f50'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:44.847982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e85fd1f9-02d7-4347-bacf-208ebd36c397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27cfc37e8e714e1cbba3761c9dea7f50'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:44.887383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e85fd1f9-02d7-4347-bacf-208ebd36c397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27cfc37e8e714e1cbba3761c9dea7f50'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:44.962532 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b86b65ce-62b6-4f3e-90ad-46f6fc6e2d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b06c2583104a1dbad766a6efc7da89'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:44.967504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b86b65ce-62b6-4f3e-90ad-46f6fc6e2d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b06c2583104a1dbad766a6efc7da89'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:44.969327 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e85fd1f9-02d7-4347-bacf-208ebd36c397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27cfc37e8e714e1cbba3761c9dea7f50'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:44.987576 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e85fd1f9-02d7-4347-bacf-208ebd36c397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27cfc37e8e714e1cbba3761c9dea7f50'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:44.990711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b86b65ce-62b6-4f3e-90ad-46f6fc6e2d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b06c2583104a1dbad766a6efc7da89'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:44.995374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b86b65ce-62b6-4f3e-90ad-46f6fc6e2d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b06c2583104a1dbad766a6efc7da89'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:45.021538 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b86b65ce-62b6-4f3e-90ad-46f6fc6e2d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b06c2583104a1dbad766a6efc7da89'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:45.022521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 859/1755] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:25:44 2022] DELETE /identity/v3/users/27cfc37e8e714e1cbba3761c9dea7f50 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:45.026525 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fd1f9-02d7-4347-bacf-208ebd36c397 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:45.037009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e85fd1f9-02d7-4347-bacf-208ebd36c397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:45.059334 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 897/1756] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:25:44 2022] DELETE /identity/v3/users/83b06c2583104a1dbad766a6efc7da89 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:25:45.275111 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:45.385725 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fd1f9-02d7-4347-bacf-208ebd36c397 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:45.572503 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a93c76-dd0f-4af9-bf1e-fd035dec6093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:45.573414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a93c76-dd0f-4af9-bf1e-fd035dec6093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:45.574058 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a93c76-dd0f-4af9-bf1e-fd035dec6093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:45.574607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a93c76-dd0f-4af9-bf1e-fd035dec6093 admin admin] PATH_INFO: `/v3/projects/9e8189ba8ec84279af90e285297a4ac3` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:45.577025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a93c76-dd0f-4af9-bf1e-fd035dec6093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e8189ba8ec84279af90e285297a4ac3)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:45.580991 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a93c76-dd0f-4af9-bf1e-fd035dec6093 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:45.764027 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-44a93c76-dd0f-4af9-bf1e-fd035dec6093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e8189ba8ec84279af90e285297a4ac3', 'request_id': 'req-44a93c76-dd0f-4af9-bf1e-fd035dec6093'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:45.777915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-44a93c76-dd0f-4af9-bf1e-fd035dec6093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e8189ba8ec84279af90e285297a4ac3', 'request_id': 'req-44a93c76-dd0f-4af9-bf1e-fd035dec6093'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:45.806521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-44a93c76-dd0f-4af9-bf1e-fd035dec6093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e8189ba8ec84279af90e285297a4ac3', 'request_id': 'req-44a93c76-dd0f-4af9-bf1e-fd035dec6093'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:45.854267 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-44a93c76-dd0f-4af9-bf1e-fd035dec6093 admin admin] The token cache is being invalidate because project 9e8189ba8ec84279af90e285297a4ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:25:45.854705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-44a93c76-dd0f-4af9-bf1e-fd035dec6093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:45.862561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-44a93c76-dd0f-4af9-bf1e-fd035dec6093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:45.868243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 860/1757] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:25:45 2022] DELETE /identity/v3/projects/9e8189ba8ec84279af90e285297a4ac3 => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:45.874360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9e5ac-08d7-407c-9a4a-f41e76558c56 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:45.875219 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9e5ac-08d7-407c-9a4a-f41e76558c56 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:45.875342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9e5ac-08d7-407c-9a4a-f41e76558c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:45.937297 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-0fe9e5ac-08d7-407c-9a4a-f41e76558c56 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:45.940713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0fe9e5ac-08d7-407c-9a4a-f41e76558c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:46.170749 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d76776-4f11-4678-bd0c-01a99f67e394 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:46.171239 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d76776-4f11-4678-bd0c-01a99f67e394 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:46.171701 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d76776-4f11-4678-bd0c-01a99f67e394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:46.175329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 898/1758] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:46.220996 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaeea64-272b-4e60-854f-b66b5aa713fb None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:46.221503 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaeea64-272b-4e60-854f-b66b5aa713fb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:46.221919 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaeea64-272b-4e60-854f-b66b5aa713fb None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:46.225083 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 899/1759] 10.222.0.48 () {54 vars in 921 bytes} [Thu Aug 4 10:25:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 10:25:46.242404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d9d76776-4f11-4678-bd0c-01a99f67e394 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:46.245488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d9d76776-4f11-4678-bd0c-01a99f67e394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:46.279618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91317378-d961-4ab4-81ac-c088735bb272 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:46.280282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91317378-d961-4ab4-81ac-c088735bb272 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:46.280865 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91317378-d961-4ab4-81ac-c088735bb272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:46.281920 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 861/1760] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:25:46.311832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d76776-4f11-4678-bd0c-01a99f67e394 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:46.382757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d76776-4f11-4678-bd0c-01a99f67e394 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:46.398477 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-91317378-d961-4ab4-81ac-c088735bb272 None None] MFA Rules not processed for user `592539924feb44ad8ea520d8539b6608`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:46.402746 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-91317378-d961-4ab4-81ac-c088735bb272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:46.404330 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512fd7a-ad24-4e99-8d42-2450dd9710a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:46.410035 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512fd7a-ad24-4e99-8d42-2450dd9710a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:46.411716 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512fd7a-ad24-4e99-8d42-2450dd9710a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:46.412086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512fd7a-ad24-4e99-8d42-2450dd9710a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:46.413754 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512fd7a-ad24-4e99-8d42-2450dd9710a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:25:46.416976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512fd7a-ad24-4e99-8d42-2450dd9710a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:46.421848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512fd7a-ad24-4e99-8d42-2450dd9710a8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:46.483367 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 862/1761] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:25:46.485644 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512fd7a-ad24-4e99-8d42-2450dd9710a8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:46.500381 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1512fd7a-ad24-4e99-8d42-2450dd9710a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:46.559569 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512fd7a-ad24-4e99-8d42-2450dd9710a8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:46.594849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39720a-144b-46f9-82f5-2ababa0e09ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:46.596218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39720a-144b-46f9-82f5-2ababa0e09ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:46.597282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39720a-144b-46f9-82f5-2ababa0e09ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:46.597935 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39720a-144b-46f9-82f5-2ababa0e09ad admin admin] PATH_INFO: `/v3/projects/d383a4b8120d44a6a566be2d06c26a2d` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:46.602876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39720a-144b-46f9-82f5-2ababa0e09ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d383a4b8120d44a6a566be2d06c26a2d)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:46.607797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39720a-144b-46f9-82f5-2ababa0e09ad admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:46.715824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 900/1762] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Aug 4 10:25:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:46.717578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91317378-d961-4ab4-81ac-c088735bb272 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:46.738179 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:46.771508 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91317378-d961-4ab4-81ac-c088735bb272 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:46.840467 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0d39720a-144b-46f9-82f5-2ababa0e09ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd383a4b8120d44a6a566be2d06c26a2d', 'request_id': 'req-0d39720a-144b-46f9-82f5-2ababa0e09ad'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:46.873077 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0d39720a-144b-46f9-82f5-2ababa0e09ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd383a4b8120d44a6a566be2d06c26a2d', 'request_id': 'req-0d39720a-144b-46f9-82f5-2ababa0e09ad'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:46.885079 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:46.899979 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0d39720a-144b-46f9-82f5-2ababa0e09ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd383a4b8120d44a6a566be2d06c26a2d', 'request_id': 'req-0d39720a-144b-46f9-82f5-2ababa0e09ad'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:46.943089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0d39720a-144b-46f9-82f5-2ababa0e09ad admin admin] The token cache is being invalidate because project d383a4b8120d44a6a566be2d06c26a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:25:46.943682 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0d39720a-144b-46f9-82f5-2ababa0e09ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:46.946770 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0d39720a-144b-46f9-82f5-2ababa0e09ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:46.952669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 863/1763] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:25:46 2022] DELETE /identity/v3/projects/d383a4b8120d44a6a566be2d06c26a2d => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:46.962050 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e645a36-ecbf-4c4e-bcc6-de7a730c4c73 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:46.962571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e645a36-ecbf-4c4e-bcc6-de7a730c4c73 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:46.962973 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e645a36-ecbf-4c4e-bcc6-de7a730c4c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:47.043723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-5e645a36-ecbf-4c4e-bcc6-de7a730c4c73 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:47.045926 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4fc4f-b5fb-48fa-a08c-ec86c53ac5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:47.048662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4fc4f-b5fb-48fa-a08c-ec86c53ac5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:47.049389 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4fc4f-b5fb-48fa-a08c-ec86c53ac5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:47.050238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4fc4f-b5fb-48fa-a08c-ec86c53ac5c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:47.053422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4fc4f-b5fb-48fa-a08c-ec86c53ac5c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:47.053633 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5e645a36-ecbf-4c4e-bcc6-de7a730c4c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:47.058922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4fc4f-b5fb-48fa-a08c-ec86c53ac5c5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:47.094832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 864/1764] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:47.096778 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0d31b-5446-48c9-bcd2-255b556b81ca None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:47.097096 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0d31b-5446-48c9-bcd2-255b556b81ca None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:47.097360 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0d31b-5446-48c9-bcd2-255b556b81ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:47.199705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-1ac0d31b-5446-48c9-bcd2-255b556b81ca None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:47.202576 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1ac0d31b-5446-48c9-bcd2-255b556b81ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:47.218423 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 901/1765] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:46 2022] POST /identity/v3/projects => generated 409 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:47.219255 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4fc4f-b5fb-48fa-a08c-ec86c53ac5c5 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:47.223493 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d7c4fc4f-b5fb-48fa-a08c-ec86c53ac5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:47.227032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 865/1766] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:47.229025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0d31b-5446-48c9-bcd2-255b556b81ca None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:47.232263 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1ac0d31b-5446-48c9-bcd2-255b556b81ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:47.291058 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0d31b-5446-48c9-bcd2-255b556b81ca None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:47.445308 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4fc4f-b5fb-48fa-a08c-ec86c53ac5c5 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:47.470879 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92488945-07f6-4122-ade7-31c6c82ec67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:47.473335 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92488945-07f6-4122-ade7-31c6c82ec67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:47.473681 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92488945-07f6-4122-ade7-31c6c82ec67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:47.473967 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92488945-07f6-4122-ade7-31c6c82ec67e admin admin] PATH_INFO: `/v3/projects/6d785ec0b87e489280d28f669dcc6a1f` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:47.477532 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92488945-07f6-4122-ade7-31c6c82ec67e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d785ec0b87e489280d28f669dcc6a1f)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:47.482727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92488945-07f6-4122-ade7-31c6c82ec67e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:47.508631 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecf262-dc85-49e6-980d-d97010e7ba5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:47.511465 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecf262-dc85-49e6-980d-d97010e7ba5d admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:47.512096 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecf262-dc85-49e6-980d-d97010e7ba5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:47.512753 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecf262-dc85-49e6-980d-d97010e7ba5d admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:47.513963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ecf262-dc85-49e6-980d-d97010e7ba5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:47.542025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ecf262-dc85-49e6-980d-d97010e7ba5d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:47.605702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 866/1767] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:47 2022] POST /identity/v3/users => generated 305 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:47.607357 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecf262-dc85-49e6-980d-d97010e7ba5d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:47.633688 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-92488945-07f6-4122-ade7-31c6c82ec67e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d785ec0b87e489280d28f669dcc6a1f', 'request_id': 'req-92488945-07f6-4122-ade7-31c6c82ec67e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:47.644697 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecf262-dc85-49e6-980d-d97010e7ba5d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:47.657221 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-92488945-07f6-4122-ade7-31c6c82ec67e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d785ec0b87e489280d28f669dcc6a1f', 'request_id': 'req-92488945-07f6-4122-ade7-31c6c82ec67e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:47.675237 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-92488945-07f6-4122-ade7-31c6c82ec67e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d785ec0b87e489280d28f669dcc6a1f', 'request_id': 'req-92488945-07f6-4122-ade7-31c6c82ec67e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:47.703435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-92488945-07f6-4122-ade7-31c6c82ec67e admin admin] The token cache is being invalidate because project 6d785ec0b87e489280d28f669dcc6a1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:25:47.703800 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-92488945-07f6-4122-ade7-31c6c82ec67e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:47.706513 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-92488945-07f6-4122-ade7-31c6c82ec67e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:47.708740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 902/1768] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:25:47 2022] DELETE /identity/v3/projects/6d785ec0b87e489280d28f669dcc6a1f => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:47.716514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92488945-07f6-4122-ade7-31c6c82ec67e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:47.716514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-92488945-07f6-4122-ade7-31c6c82ec67e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:47.778746 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:47.914181 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc65d9-3212-4480-ab89-072016210e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:47.915260 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc65d9-3212-4480-ab89-072016210e09 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:47.915755 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc65d9-3212-4480-ab89-072016210e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:47.916346 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc65d9-3212-4480-ab89-072016210e09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:47.917635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc65d9-3212-4480-ab89-072016210e09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:25:47.918199 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc65d9-3212-4480-ab89-072016210e09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:47.921273 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc65d9-3212-4480-ab89-072016210e09 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:47.941437 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92488945-07f6-4122-ade7-31c6c82ec67e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:47.964021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255b036-b697-400a-b301-af24c648e125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:47.964719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255b036-b697-400a-b301-af24c648e125 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:47.965003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255b036-b697-400a-b301-af24c648e125 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:47.965267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255b036-b697-400a-b301-af24c648e125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:47.967405 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0255b036-b697-400a-b301-af24c648e125 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:47.980944 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 867/1769] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:25:47.980944 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc65d9-3212-4480-ab89-072016210e09 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:47.980944 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-96dc65d9-3212-4480-ab89-072016210e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:47.997626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255b036-b697-400a-b301-af24c648e125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:47.999294 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255b036-b697-400a-b301-af24c648e125 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:48.022763 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc65d9-3212-4480-ab89-072016210e09 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:48.038592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee1a6d-52ca-4a6c-902a-624fea2f6653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:48.038592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee1a6d-52ca-4a6c-902a-624fea2f6653 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:48.039017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee1a6d-52ca-4a6c-902a-624fea2f6653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:48.039017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee1a6d-52ca-4a6c-902a-624fea2f6653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:48.039786 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee1a6d-52ca-4a6c-902a-624fea2f6653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:48.041524 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee1a6d-52ca-4a6c-902a-624fea2f6653 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:48.045633 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 903/1770] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:48.046871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f2902-7a2e-4a5e-afb4-2b687ddac198 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:48.052327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f2902-7a2e-4a5e-afb4-2b687ddac198 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:48.055621 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f2902-7a2e-4a5e-afb4-2b687ddac198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:48.082221 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 868/1771] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:48.084135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee1a6d-52ca-4a6c-902a-624fea2f6653 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:48.092137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-48ee1a6d-52ca-4a6c-902a-624fea2f6653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:48.154310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a14f2902-7a2e-4a5e-afb4-2b687ddac198 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:48.156716 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a14f2902-7a2e-4a5e-afb4-2b687ddac198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:48.160457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee1a6d-52ca-4a6c-902a-624fea2f6653 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:48.216496 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 904/1772] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:48.216496 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f2902-7a2e-4a5e-afb4-2b687ddac198 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:48.217031 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1ff3b-d6cb-4f1c-8f80-5994dd081183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:48.217031 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1ff3b-d6cb-4f1c-8f80-5994dd081183 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:48.217031 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1ff3b-d6cb-4f1c-8f80-5994dd081183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:48.217031 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1ff3b-d6cb-4f1c-8f80-5994dd081183 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:48.217297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1ff3b-d6cb-4f1c-8f80-5994dd081183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:48.225829 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1ff3b-d6cb-4f1c-8f80-5994dd081183 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:48.273923 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f2902-7a2e-4a5e-afb4-2b687ddac198 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:48.288215 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621fc93-3ca6-45f2-b4af-eae7b3711d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:48.289444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621fc93-3ca6-45f2-b4af-eae7b3711d1b admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:48.290004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621fc93-3ca6-45f2-b4af-eae7b3711d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:48.293819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621fc93-3ca6-45f2-b4af-eae7b3711d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:48.299174 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621fc93-3ca6-45f2-b4af-eae7b3711d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:48.309714 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621fc93-3ca6-45f2-b4af-eae7b3711d1b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:48.321384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 869/1773] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:48 2022] POST /identity/v3/projects => generated 365 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:48.327126 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96086b67-7c12-4b07-bd35-d033bd4a1678 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:48.327437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96086b67-7c12-4b07-bd35-d033bd4a1678 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:48.332107 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96086b67-7c12-4b07-bd35-d033bd4a1678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:48.387545 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 905/1774] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:48.389280 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621fc93-3ca6-45f2-b4af-eae7b3711d1b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:48.407348 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-96086b67-7c12-4b07-bd35-d033bd4a1678 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:48.410605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-96086b67-7c12-4b07-bd35-d033bd4a1678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:48.473143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621fc93-3ca6-45f2-b4af-eae7b3711d1b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:48.493040 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:48.674090 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 870/1775] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:48.682184 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96086b67-7c12-4b07-bd35-d033bd4a1678 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:48.710894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96086b67-7c12-4b07-bd35-d033bd4a1678 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:48.719868 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae385413-f3bd-4530-8892-804ad77b04e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:48.721038 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae385413-f3bd-4530-8892-804ad77b04e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:48.721566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae385413-f3bd-4530-8892-804ad77b04e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:48.721959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae385413-f3bd-4530-8892-804ad77b04e6 admin admin] PATH_INFO: `/v3/projects/8cc146b1443f4425b2a057ee6a7e5c94/users/1e0cc29d6fee452db377afe62d4b150e/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:48.750544 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997b8a8-d123-4ae5-9ede-e31936257b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:48.752006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997b8a8-d123-4ae5-9ede-e31936257b1d admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:48.752341 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997b8a8-d123-4ae5-9ede-e31936257b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:48.752887 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997b8a8-d123-4ae5-9ede-e31936257b1d admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:48.755347 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae385413-f3bd-4530-8892-804ad77b04e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc146b1443f4425b2a057ee6a7e5c94, user_id=1e0cc29d6fee452db377afe62d4b150e, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:48.759576 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997b8a8-d123-4ae5-9ede-e31936257b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:48.763237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae385413-f3bd-4530-8892-804ad77b04e6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:48.765834 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997b8a8-d123-4ae5-9ede-e31936257b1d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:48.796977 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 871/1776] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:48 2022] PUT /identity/v3/projects/8cc146b1443f4425b2a057ee6a7e5c94/users/1e0cc29d6fee452db377afe62d4b150e/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:48.798088 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae385413-f3bd-4530-8892-804ad77b04e6 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:48.877254 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 906/1777] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:48 2022] POST /identity/v3/users => generated 283 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:48.878948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fe861-c623-4917-8640-7dd8f0aa0343 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:48.879233 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fe861-c623-4917-8640-7dd8f0aa0343 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:48.879514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fe861-c623-4917-8640-7dd8f0aa0343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:48.998795 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5e4fe861-c623-4917-8640-7dd8f0aa0343 None None] MFA Rules not processed for user `1e0cc29d6fee452db377afe62d4b150e`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:49.001811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5e4fe861-c623-4917-8640-7dd8f0aa0343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:49.085777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae385413-f3bd-4530-8892-804ad77b04e6 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:49.103366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa542756-1e7e-49eb-88b7-0fa74ab14e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:49.104210 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa542756-1e7e-49eb-88b7-0fa74ab14e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:49.104902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa542756-1e7e-49eb-88b7-0fa74ab14e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:49.105443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa542756-1e7e-49eb-88b7-0fa74ab14e1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:49.106628 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa542756-1e7e-49eb-88b7-0fa74ab14e1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:25:49.106948 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa542756-1e7e-49eb-88b7-0fa74ab14e1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:49.109233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa542756-1e7e-49eb-88b7-0fa74ab14e1f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:49.110638 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 907/1778] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:48 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:49.111891 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fe861-c623-4917-8640-7dd8f0aa0343 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:49.126185 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:49.132709 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fe861-c623-4917-8640-7dd8f0aa0343 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:49.144462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61824c-87b4-4622-8828-588b622bbab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:49.146316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61824c-87b4-4622-8828-588b622bbab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:49.147140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61824c-87b4-4622-8828-588b622bbab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:49.147592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61824c-87b4-4622-8828-588b622bbab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:49.148406 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61824c-87b4-4622-8828-588b622bbab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:49.153230 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61824c-87b4-4622-8828-588b622bbab1 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:49.159379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 872/1779] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:25:49.160394 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa542756-1e7e-49eb-88b7-0fa74ab14e1f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:49.181822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 908/1780] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:49.183094 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61824c-87b4-4622-8828-588b622bbab1 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:49.186637 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa542756-1e7e-49eb-88b7-0fa74ab14e1f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:49.203520 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61824c-87b4-4622-8828-588b622bbab1 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:49.208830 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efdd90-02f9-4f20-84c7-4a4ea9e63edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:49.209628 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09535b74-32a3-42d1-8935-34bc0533e653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:49.210458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09535b74-32a3-42d1-8935-34bc0533e653 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:49.210712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efdd90-02f9-4f20-84c7-4a4ea9e63edf admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:49.210817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09535b74-32a3-42d1-8935-34bc0533e653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:49.211013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09535b74-32a3-42d1-8935-34bc0533e653 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:49.211146 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efdd90-02f9-4f20-84c7-4a4ea9e63edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:49.211578 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efdd90-02f9-4f20-84c7-4a4ea9e63edf admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:49.211779 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09535b74-32a3-42d1-8935-34bc0533e653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:49.214959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09535b74-32a3-42d1-8935-34bc0533e653 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:49.222473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efdd90-02f9-4f20-84c7-4a4ea9e63edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:49.232013 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efdd90-02f9-4f20-84c7-4a4ea9e63edf admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:49.282462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 909/1781] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:49 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:49.283727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09535b74-32a3-42d1-8935-34bc0533e653 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:49.336453 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 873/1782] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:49 2022] POST /identity/v3/projects => generated 409 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:49.339336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efdd90-02f9-4f20-84c7-4a4ea9e63edf admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:49.345313 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-86efdd90-02f9-4f20-84c7-4a4ea9e63edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:49.403305 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09535b74-32a3-42d1-8935-34bc0533e653 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:49.503866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b336ae0-55db-4534-953b-c18bf1237363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:49.505629 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b336ae0-55db-4534-953b-c18bf1237363 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:49.506304 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b336ae0-55db-4534-953b-c18bf1237363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:49.506727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b336ae0-55db-4534-953b-c18bf1237363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:49.507483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b336ae0-55db-4534-953b-c18bf1237363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:49.509219 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b336ae0-55db-4534-953b-c18bf1237363 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:49.510259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efdd90-02f9-4f20-84c7-4a4ea9e63edf admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:49.517842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0c02b-a767-486e-b48f-f87e97b96f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:49.519062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0c02b-a767-486e-b48f-f87e97b96f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:49.519494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0c02b-a767-486e-b48f-f87e97b96f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:49.519939 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0c02b-a767-486e-b48f-f87e97b96f10 admin admin] PATH_INFO: `/v3/projects/9f88bc6e07ae461098be8b020e5065cf` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:49.522483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 910/1783] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:49.524028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0c02b-a767-486e-b48f-f87e97b96f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f88bc6e07ae461098be8b020e5065cf)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:49.526692 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b336ae0-55db-4534-953b-c18bf1237363 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:49.527112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0c02b-a767-486e-b48f-f87e97b96f10 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:49.540702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b336ae0-55db-4534-953b-c18bf1237363 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:49.546753 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:49.549400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c94ff5-dbb0-4705-b5bf-34e114816c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:49.550267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c94ff5-dbb0-4705-b5bf-34e114816c87 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:49.550800 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c94ff5-dbb0-4705-b5bf-34e114816c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:49.551182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c94ff5-dbb0-4705-b5bf-34e114816c87 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:49.553275 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c94ff5-dbb0-4705-b5bf-34e114816c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:49.557228 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c94ff5-dbb0-4705-b5bf-34e114816c87 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:49.593873 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 911/1784] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:49 2022] POST /identity/v3/users => generated 303 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:49.593873 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c94ff5-dbb0-4705-b5bf-34e114816c87 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:49.605444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c94ff5-dbb0-4705-b5bf-34e114816c87 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:49.607871 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-11d0c02b-a767-486e-b48f-f87e97b96f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f88bc6e07ae461098be8b020e5065cf', 'request_id': 'req-11d0c02b-a767-486e-b48f-f87e97b96f10'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:49.617371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-11d0c02b-a767-486e-b48f-f87e97b96f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f88bc6e07ae461098be8b020e5065cf', 'request_id': 'req-11d0c02b-a767-486e-b48f-f87e97b96f10'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:49.630619 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-11d0c02b-a767-486e-b48f-f87e97b96f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f88bc6e07ae461098be8b020e5065cf', 'request_id': 'req-11d0c02b-a767-486e-b48f-f87e97b96f10'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:49.652408 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-11d0c02b-a767-486e-b48f-f87e97b96f10 admin admin] The token cache is being invalidate because project 9f88bc6e07ae461098be8b020e5065cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:25:49.652890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-11d0c02b-a767-486e-b48f-f87e97b96f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:49.653985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-11d0c02b-a767-486e-b48f-f87e97b96f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:49.656669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 874/1785] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:25:49 2022] DELETE /identity/v3/projects/9f88bc6e07ae461098be8b020e5065cf => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:49.657986 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0c02b-a767-486e-b48f-f87e97b96f10 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:49.661729 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-11d0c02b-a767-486e-b48f-f87e97b96f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:49.735050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:49.753343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c9984-c94b-4e08-8f91-b81f6e4d90b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:49.754969 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c9984-c94b-4e08-8f91-b81f6e4d90b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:49.755445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c9984-c94b-4e08-8f91-b81f6e4d90b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:49.756072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c9984-c94b-4e08-8f91-b81f6e4d90b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:49.757833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c9984-c94b-4e08-8f91-b81f6e4d90b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:49.762190 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c9984-c94b-4e08-8f91-b81f6e4d90b7 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:49.785075 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0c02b-a767-486e-b48f-f87e97b96f10 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:49.793396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0231602-17e3-4544-be9a-3fc38df38b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:49.794125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0231602-17e3-4544-be9a-3fc38df38b8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:49.794419 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0231602-17e3-4544-be9a-3fc38df38b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:49.794760 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0231602-17e3-4544-be9a-3fc38df38b8f admin admin] PATH_INFO: `/v3/projects/9c0b9740d2974d2f89337fd034db0909/users/0d3d26911a2249948f788745e969fe22/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:49.809506 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 912/1786] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:49 2022] POST /identity/v3/users => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:49.810533 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c9984-c94b-4e08-8f91-b81f6e4d90b7 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:49.812542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ad5c9984-c94b-4e08-8f91-b81f6e4d90b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:49.827395 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c9984-c94b-4e08-8f91-b81f6e4d90b7 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:49.840507 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24237f4b-8574-48f8-a00f-fa543867799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:49.840507 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24237f4b-8574-48f8-a00f-fa543867799a admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:49.840507 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24237f4b-8574-48f8-a00f-fa543867799a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:49.840507 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24237f4b-8574-48f8-a00f-fa543867799a admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:49.841408 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24237f4b-8574-48f8-a00f-fa543867799a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:49.848822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24237f4b-8574-48f8-a00f-fa543867799a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:49.867775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0231602-17e3-4544-be9a-3fc38df38b8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0b9740d2974d2f89337fd034db0909, user_id=0d3d26911a2249948f788745e969fe22, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:49.870710 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0231602-17e3-4544-be9a-3fc38df38b8f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:49.874390 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 913/1787] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:49.875964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b8e98-ad84-4d36-ac31-a5514f1410de None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:49.876925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b8e98-ad84-4d36-ac31-a5514f1410de None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:49.877481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b8e98-ad84-4d36-ac31-a5514f1410de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:49.907091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 875/1788] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:49 2022] PUT /identity/v3/projects/9c0b9740d2974d2f89337fd034db0909/users/0d3d26911a2249948f788745e969fe22/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:49.908057 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0231602-17e3-4544-be9a-3fc38df38b8f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:49.920252 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b0231602-17e3-4544-be9a-3fc38df38b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:49.921697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7c3b8e98-ad84-4d36-ac31-a5514f1410de None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:49.929048 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7c3b8e98-ad84-4d36-ac31-a5514f1410de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:50.144307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 914/1789] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:50.148390 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b8e98-ad84-4d36-ac31-a5514f1410de None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:50.159362 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0231602-17e3-4544-be9a-3fc38df38b8f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:50.170643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cfbeb-22b4-4b11-af1d-bf924377a8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:50.171494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cfbeb-22b4-4b11-af1d-bf924377a8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:50.171866 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cfbeb-22b4-4b11-af1d-bf924377a8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:50.172252 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cfbeb-22b4-4b11-af1d-bf924377a8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:50.173095 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cfbeb-22b4-4b11-af1d-bf924377a8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:50.173878 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b8e98-ad84-4d36-ac31-a5514f1410de None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:50.175207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cfbeb-22b4-4b11-af1d-bf924377a8e0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:50.195488 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eba34d-a8b6-4dd0-b3c0-48d9830c306d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:50.196928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eba34d-a8b6-4dd0-b3c0-48d9830c306d admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:50.197462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eba34d-a8b6-4dd0-b3c0-48d9830c306d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:50.197569 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 876/1790] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:50.199369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba4ab5-ea2b-4539-ac40-996556afb035 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:50.199369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba4ab5-ea2b-4539-ac40-996556afb035 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:50.199592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eba34d-a8b6-4dd0-b3c0-48d9830c306d admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:50.199673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba4ab5-ea2b-4539-ac40-996556afb035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:50.203529 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eba34d-a8b6-4dd0-b3c0-48d9830c306d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:50.206799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eba34d-a8b6-4dd0-b3c0-48d9830c306d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:50.236403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-60ba4ab5-ea2b-4539-ac40-996556afb035 None None] MFA Rules not processed for user `0d3d26911a2249948f788745e969fe22`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:50.237923 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-60ba4ab5-ea2b-4539-ac40-996556afb035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:50.245024 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 915/1791] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:50.246742 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961c83f-981b-4efa-b931-b4810677ee9b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:50.247134 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961c83f-981b-4efa-b931-b4810677ee9b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:50.247531 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961c83f-981b-4efa-b931-b4810677ee9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:50.262887 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:50.281951 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e961c83f-981b-4efa-b931-b4810677ee9b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:50.283243 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e961c83f-981b-4efa-b931-b4810677ee9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:50.293750 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 916/1792] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:50.294407 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961c83f-981b-4efa-b931-b4810677ee9b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:50.305520 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961c83f-981b-4efa-b931-b4810677ee9b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:50.311032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b79388-f9ed-4700-9f31-2f34441f1914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:50.311909 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b79388-f9ed-4700-9f31-2f34441f1914 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:50.312199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b79388-f9ed-4700-9f31-2f34441f1914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:50.312608 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b79388-f9ed-4700-9f31-2f34441f1914 admin admin] PATH_INFO: `/v3/projects/dd2a38ee6c1749129cab44f85a52a2dd/users/9712b15ba4fc4f278a51ce7aad2735e3/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:50.350233 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b79388-f9ed-4700-9f31-2f34441f1914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd2a38ee6c1749129cab44f85a52a2dd, user_id=9712b15ba4fc4f278a51ce7aad2735e3, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:50.353822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b79388-f9ed-4700-9f31-2f34441f1914 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:50.387631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 917/1793] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:50 2022] PUT /identity/v3/projects/dd2a38ee6c1749129cab44f85a52a2dd/users/9712b15ba4fc4f278a51ce7aad2735e3/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:50.391385 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b79388-f9ed-4700-9f31-2f34441f1914 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:50.426123 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 877/1794] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:50.426123 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba4ab5-ea2b-4539-ac40-996556afb035 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:50.453622 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba4ab5-ea2b-4539-ac40-996556afb035 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:50.498448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b79388-f9ed-4700-9f31-2f34441f1914 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:50.504142 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80154585-734f-4b4c-b095-dbf734fa5423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:50.505599 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80154585-734f-4b4c-b095-dbf734fa5423 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:50.505950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80154585-734f-4b4c-b095-dbf734fa5423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:50.506288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80154585-734f-4b4c-b095-dbf734fa5423 admin admin] PATH_INFO: `/v3/projects/bc4327d6889240b588382446a5b819c1/users/a714833f16a24f62be73c2c7f2ebea7c/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:50.548664 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80154585-734f-4b4c-b095-dbf734fa5423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4327d6889240b588382446a5b819c1, user_id=a714833f16a24f62be73c2c7f2ebea7c, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:50.552528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80154585-734f-4b4c-b095-dbf734fa5423 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:50.570688 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 918/1795] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:50 2022] PUT /identity/v3/projects/bc4327d6889240b588382446a5b819c1/users/a714833f16a24f62be73c2c7f2ebea7c/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:50.572510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80154585-734f-4b4c-b095-dbf734fa5423 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:50.580191 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72280e-a6d8-4cca-899c-64ec78fddb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:50.580859 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72280e-a6d8-4cca-899c-64ec78fddb49 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:50.581151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72280e-a6d8-4cca-899c-64ec78fddb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:50.581438 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72280e-a6d8-4cca-899c-64ec78fddb49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:50.582173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72280e-a6d8-4cca-899c-64ec78fddb49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:25:50.582485 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72280e-a6d8-4cca-899c-64ec78fddb49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:50.584617 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72280e-a6d8-4cca-899c-64ec78fddb49 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:50.596870 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:50.597559 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 878/1796] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:25:50.599537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72280e-a6d8-4cca-899c-64ec78fddb49 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:50.610925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72280e-a6d8-4cca-899c-64ec78fddb49 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:50.655328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80154585-734f-4b4c-b095-dbf734fa5423 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:50.660708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c910909-20a2-4289-a8a8-aa1e7c1ab328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:50.662234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c910909-20a2-4289-a8a8-aa1e7c1ab328 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:50.662748 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c910909-20a2-4289-a8a8-aa1e7c1ab328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:50.663248 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c910909-20a2-4289-a8a8-aa1e7c1ab328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:50.664180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c910909-20a2-4289-a8a8-aa1e7c1ab328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:50.666410 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c910909-20a2-4289-a8a8-aa1e7c1ab328 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:50.675331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895653ec-e66f-447b-9407-225240b3d725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:50.675971 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895653ec-e66f-447b-9407-225240b3d725 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:50.676545 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895653ec-e66f-447b-9407-225240b3d725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:50.677629 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895653ec-e66f-447b-9407-225240b3d725 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:50.678374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895653ec-e66f-447b-9407-225240b3d725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:50.680533 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895653ec-e66f-447b-9407-225240b3d725 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:50.684352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 919/1797] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:50.684352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616c2bf-54d3-47e4-a166-716560587a4c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:50.684352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616c2bf-54d3-47e4-a166-716560587a4c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:50.684352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616c2bf-54d3-47e4-a166-716560587a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:50.709696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f616c2bf-54d3-47e4-a166-716560587a4c None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:50.711645 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f616c2bf-54d3-47e4-a166-716560587a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:50.721327 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 879/1798] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:50 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:50.721327 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895653ec-e66f-447b-9407-225240b3d725 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:50.731265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 920/1799] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:50.731265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616c2bf-54d3-47e4-a166-716560587a4c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:50.744609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616c2bf-54d3-47e4-a166-716560587a4c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:50.763718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:50.807677 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895653ec-e66f-447b-9407-225240b3d725 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:50.810193 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e081e-e6f4-410c-8bf9-904bacb05131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:50.810896 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e081e-e6f4-410c-8bf9-904bacb05131 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:50.811186 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e081e-e6f4-410c-8bf9-904bacb05131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:50.811473 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e081e-e6f4-410c-8bf9-904bacb05131 admin admin] PATH_INFO: `/v3/projects/dd2a38ee6c1749129cab44f85a52a2dd/users/9712b15ba4fc4f278a51ce7aad2735e3/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:50.812681 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152d228-c069-4da3-9606-d290ae80add8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:50.813297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152d228-c069-4da3-9606-d290ae80add8 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:50.813579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152d228-c069-4da3-9606-d290ae80add8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:50.813715 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e081e-e6f4-410c-8bf9-904bacb05131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd2a38ee6c1749129cab44f85a52a2dd, user_id=9712b15ba4fc4f278a51ce7aad2735e3, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:50.813921 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152d228-c069-4da3-9606-d290ae80add8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:50.814596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152d228-c069-4da3-9606-d290ae80add8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:50.816507 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e081e-e6f4-410c-8bf9-904bacb05131 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:50.816667 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152d228-c069-4da3-9606-d290ae80add8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:50.836188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 921/1800] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:50 2022] PUT /identity/v3/projects/dd2a38ee6c1749129cab44f85a52a2dd/users/9712b15ba4fc4f278a51ce7aad2735e3/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:50.837555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e081e-e6f4-410c-8bf9-904bacb05131 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:50.859256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 880/1801] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:50 2022] POST /identity/v3/projects => generated 363 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:50.859256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152d228-c069-4da3-9606-d290ae80add8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:50.859256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4152d228-c069-4da3-9606-d290ae80add8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:50.949463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152d228-c069-4da3-9606-d290ae80add8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:50.956035 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30578246-f52a-43ae-9ae6-6f81c31c9f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:50.957230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30578246-f52a-43ae-9ae6-6f81c31c9f9b service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:50.957733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30578246-f52a-43ae-9ae6-6f81c31c9f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:50.958875 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30578246-f52a-43ae-9ae6-6f81c31c9f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:50.964844 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e081e-e6f4-410c-8bf9-904bacb05131 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:51.031879 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:51.062740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1be9b-1440-4d99-8e9f-199b7583178b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:51.063777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1be9b-1440-4d99-8e9f-199b7583178b admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:51.064047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1be9b-1440-4d99-8e9f-199b7583178b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:51.064375 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1be9b-1440-4d99-8e9f-199b7583178b admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:51.065079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1be9b-1440-4d99-8e9f-199b7583178b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:51.069822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1be9b-1440-4d99-8e9f-199b7583178b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:51.090867 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30578246-f52a-43ae-9ae6-6f81c31c9f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:51.090867 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30578246-f52a-43ae-9ae6-6f81c31c9f9b service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:51.105174 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 881/1802] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:51.106306 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 922/1803] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:50 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:51.109756 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f876f71-b955-4cf3-99fa-b3259c658b0f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:51.110086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f876f71-b955-4cf3-99fa-b3259c658b0f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:51.110400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f876f71-b955-4cf3-99fa-b3259c658b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:51.113103 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1be9b-1440-4d99-8e9f-199b7583178b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:51.135946 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1be9b-1440-4d99-8e9f-199b7583178b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:51.149308 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e0a05-bd78-40a7-9275-778dc09905ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:51.150392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e0a05-bd78-40a7-9275-778dc09905ad admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:51.152043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e0a05-bd78-40a7-9275-778dc09905ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:51.152567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e0a05-bd78-40a7-9275-778dc09905ad admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:51.154051 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e0a05-bd78-40a7-9275-778dc09905ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:51.154848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3f876f71-b955-4cf3-99fa-b3259c658b0f None None] MFA Rules not processed for user `9712b15ba4fc4f278a51ce7aad2735e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:51.156152 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3f876f71-b955-4cf3-99fa-b3259c658b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:51.157923 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e0a05-bd78-40a7-9275-778dc09905ad admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:51.208814 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 923/1804] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:51 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:51.209754 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e0a05-bd78-40a7-9275-778dc09905ad admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:51.221968 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e0a05-bd78-40a7-9275-778dc09905ad admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:51.228934 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77138ea-cee6-4303-94ed-ae82a5eef42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:51.229601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77138ea-cee6-4303-94ed-ae82a5eef42a admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:51.230071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77138ea-cee6-4303-94ed-ae82a5eef42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:51.230406 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77138ea-cee6-4303-94ed-ae82a5eef42a admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:51.231127 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77138ea-cee6-4303-94ed-ae82a5eef42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:51.232859 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77138ea-cee6-4303-94ed-ae82a5eef42a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:51.249061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 924/1805] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:51.249953 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77138ea-cee6-4303-94ed-ae82a5eef42a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:51.272914 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77138ea-cee6-4303-94ed-ae82a5eef42a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:51.293251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:51.294045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af76c94-74bb-41e7-972c-5f6881120f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:51.295323 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af76c94-74bb-41e7-972c-5f6881120f56 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:51.296018 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af76c94-74bb-41e7-972c-5f6881120f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:51.296767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af76c94-74bb-41e7-972c-5f6881120f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:51.298787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af76c94-74bb-41e7-972c-5f6881120f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:51.302985 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af76c94-74bb-41e7-972c-5f6881120f56 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:51.354921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 925/1806] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:51.360335 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af76c94-74bb-41e7-972c-5f6881120f56 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:51.380051 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 882/1807] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:51 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:51.381870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f876f71-b955-4cf3-99fa-b3259c658b0f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:51.386026 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af76c94-74bb-41e7-972c-5f6881120f56 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:51.393288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be68a3-62bc-482a-8599-218334963ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:51.394738 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be68a3-62bc-482a-8599-218334963ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:51.395123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be68a3-62bc-482a-8599-218334963ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:51.396239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be68a3-62bc-482a-8599-218334963ee7 admin admin] PATH_INFO: `/v3/projects/9d3861dc14094147a630bafe305f530a/users/bcc9f6aec9a14db7addf57c4bb6868ce/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:51.425999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f876f71-b955-4cf3-99fa-b3259c658b0f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:51.439666 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffc9b2-b6f0-4472-a949-de5c265509e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:51.440822 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffc9b2-b6f0-4472-a949-de5c265509e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:51.441297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffc9b2-b6f0-4472-a949-de5c265509e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:51.441796 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffc9b2-b6f0-4472-a949-de5c265509e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:51.443286 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be68a3-62bc-482a-8599-218334963ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d3861dc14094147a630bafe305f530a, user_id=bcc9f6aec9a14db7addf57c4bb6868ce, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:51.443786 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffc9b2-b6f0-4472-a949-de5c265509e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:51.447179 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffc9b2-b6f0-4472-a949-de5c265509e8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:51.449853 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be68a3-62bc-482a-8599-218334963ee7 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:51.478640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 926/1808] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:51 2022] PUT /identity/v3/projects/9d3861dc14094147a630bafe305f530a/users/bcc9f6aec9a14db7addf57c4bb6868ce/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:51.479476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be68a3-62bc-482a-8599-218334963ee7 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:51.481261 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 883/1809] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:51.484598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffc9b2-b6f0-4472-a949-de5c265509e8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:51.485660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-74be68a3-62bc-482a-8599-218334963ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:51.502007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffc9b2-b6f0-4472-a949-de5c265509e8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:51.606542 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6f08e-d8aa-4916-9e77-cb13376791c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:51.607353 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6f08e-d8aa-4916-9e77-cb13376791c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:51.608892 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6f08e-d8aa-4916-9e77-cb13376791c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:51.609726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6f08e-d8aa-4916-9e77-cb13376791c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:51.610905 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6f08e-d8aa-4916-9e77-cb13376791c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:51.612785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6f08e-d8aa-4916-9e77-cb13376791c1 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:51.630760 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 884/1810] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:51.632801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6f08e-d8aa-4916-9e77-cb13376791c1 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:51.668951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6f08e-d8aa-4916-9e77-cb13376791c1 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:51.685330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be68a3-62bc-482a-8599-218334963ee7 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:51.686284 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54e3ef-2757-4179-8043-7fd7958b7146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:51.687106 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54e3ef-2757-4179-8043-7fd7958b7146 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:51.687504 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54e3ef-2757-4179-8043-7fd7958b7146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:51.687911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54e3ef-2757-4179-8043-7fd7958b7146 admin admin] PATH_INFO: `/v3/projects/627a2af3939749b5b13122a5e41af62d/users/2b2e6548db6448f18aa09c4b6f94ab53/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:51.694993 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1d119-693e-4838-9cb5-7fda8e875d09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:51.695659 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1d119-693e-4838-9cb5-7fda8e875d09 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:51.696871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1d119-693e-4838-9cb5-7fda8e875d09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:51.697165 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1d119-693e-4838-9cb5-7fda8e875d09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:51.720094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54e3ef-2757-4179-8043-7fd7958b7146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=627a2af3939749b5b13122a5e41af62d, user_id=2b2e6548db6448f18aa09c4b6f94ab53, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:51.723054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54e3ef-2757-4179-8043-7fd7958b7146 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:51.755337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 885/1811] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:51 2022] PUT /identity/v3/projects/627a2af3939749b5b13122a5e41af62d/users/2b2e6548db6448f18aa09c4b6f94ab53/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:51.757618 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54e3ef-2757-4179-8043-7fd7958b7146 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:51.810317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1d119-693e-4838-9cb5-7fda8e875d09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:51.812129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1d119-693e-4838-9cb5-7fda8e875d09 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:51.854278 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 927/1812] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:51 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:51.858612 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8c241-6e50-4b0c-b270-602d9fa1d19a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:51.859452 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8c241-6e50-4b0c-b270-602d9fa1d19a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:51.860140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8c241-6e50-4b0c-b270-602d9fa1d19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:51.932966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-45d8c241-6e50-4b0c-b270-602d9fa1d19a None None] MFA Rules not processed for user `2b2e6548db6448f18aa09c4b6f94ab53`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:51.937811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-45d8c241-6e50-4b0c-b270-602d9fa1d19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:51.972800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54e3ef-2757-4179-8043-7fd7958b7146 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:51.985635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9228863-8b0a-42b2-b2f7-f4f85b1dcc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:51.986808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9228863-8b0a-42b2-b2f7-f4f85b1dcc55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:51.987808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9228863-8b0a-42b2-b2f7-f4f85b1dcc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:51.989390 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9228863-8b0a-42b2-b2f7-f4f85b1dcc55 admin admin] PATH_INFO: `/v3/projects/9d3861dc14094147a630bafe305f530a/users/bcc9f6aec9a14db7addf57c4bb6868ce/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:51.993952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:51.995160 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9228863-8b0a-42b2-b2f7-f4f85b1dcc55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d3861dc14094147a630bafe305f530a, user_id=bcc9f6aec9a14db7addf57c4bb6868ce, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:52.008714 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9228863-8b0a-42b2-b2f7-f4f85b1dcc55 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:52.033013 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 886/1813] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:51 2022] PUT /identity/v3/projects/9d3861dc14094147a630bafe305f530a/users/bcc9f6aec9a14db7addf57c4bb6868ce/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:52.052884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb218ca4-0872-4c46-b074-68f981eff837 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:52.054400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb218ca4-0872-4c46-b074-68f981eff837 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:52.054710 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb218ca4-0872-4c46-b074-68f981eff837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:52.133905 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-fb218ca4-0872-4c46-b074-68f981eff837 None None] MFA Rules not processed for user `bcc9f6aec9a14db7addf57c4bb6868ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:52.137303 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fb218ca4-0872-4c46-b074-68f981eff837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:52.252289 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 928/1814] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:52.260047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8c241-6e50-4b0c-b270-602d9fa1d19a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:52.278569 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:52.310458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8c241-6e50-4b0c-b270-602d9fa1d19a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:52.361402 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 887/1815] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:52.485548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3873eb0-aaf1-4a7a-bf63-b4e517bdaf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:52.486740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3873eb0-aaf1-4a7a-bf63-b4e517bdaf77 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:52.488094 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3873eb0-aaf1-4a7a-bf63-b4e517bdaf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:52.488796 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3873eb0-aaf1-4a7a-bf63-b4e517bdaf77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:52.490650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3873eb0-aaf1-4a7a-bf63-b4e517bdaf77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:52.494397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3873eb0-aaf1-4a7a-bf63-b4e517bdaf77 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:52.518286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb218ca4-0872-4c46-b074-68f981eff837 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:52.527139 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fb218ca4-0872-4c46-b074-68f981eff837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:52.572901 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 929/1816] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:52 2022] POST /identity/v3/projects => generated 363 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:52.575615 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3873eb0-aaf1-4a7a-bf63-b4e517bdaf77 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:52.690794 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb218ca4-0872-4c46-b074-68f981eff837 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:52.699949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2440c-bd41-4b4c-9b65-ff318b3169e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:52.701216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2440c-bd41-4b4c-9b65-ff318b3169e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:52.701849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2440c-bd41-4b4c-9b65-ff318b3169e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:52.702353 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3873eb0-aaf1-4a7a-bf63-b4e517bdaf77 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:52.702643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2440c-bd41-4b4c-9b65-ff318b3169e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:52.707110 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0b827-6a6e-438b-b2b9-1e17114eac69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:52.708656 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0b827-6a6e-438b-b2b9-1e17114eac69 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:52.709137 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0b827-6a6e-438b-b2b9-1e17114eac69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:52.710499 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0b827-6a6e-438b-b2b9-1e17114eac69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:52.714140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-16a0b827-6a6e-438b-b2b9-1e17114eac69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:52.798092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:52.804554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0b827-6a6e-438b-b2b9-1e17114eac69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:52.809500 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0b827-6a6e-438b-b2b9-1e17114eac69 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:52.816024 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2440c-bd41-4b4c-9b65-ff318b3169e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:52.818176 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2440c-bd41-4b4c-9b65-ff318b3169e6 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:52.829693 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 930/1817] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:52 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:52.831046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0b827-6a6e-438b-b2b9-1e17114eac69 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:52.831515 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 888/1818] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:52 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:25:52.833328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6ef8a-c045-4d3b-ad2f-187e33e15d03 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:52.833634 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6ef8a-c045-4d3b-ad2f-187e33e15d03 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:52.833922 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6ef8a-c045-4d3b-ad2f-187e33e15d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:52.872835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-8de6ef8a-c045-4d3b-ad2f-187e33e15d03 None None] MFA Rules not processed for user `a714833f16a24f62be73c2c7f2ebea7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:52.874288 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8de6ef8a-c045-4d3b-ad2f-187e33e15d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:52.966387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0b827-6a6e-438b-b2b9-1e17114eac69 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:52.977272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1c4bd-5d4d-4c09-806f-f2de9a0782e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:52.978416 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1c4bd-5d4d-4c09-806f-f2de9a0782e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:52.978708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1c4bd-5d4d-4c09-806f-f2de9a0782e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:52.980514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1c4bd-5d4d-4c09-806f-f2de9a0782e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:52.982787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1c4bd-5d4d-4c09-806f-f2de9a0782e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:52.989025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 889/1819] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:52 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:52.989732 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1c4bd-5d4d-4c09-806f-f2de9a0782e5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:52.995768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6ef8a-c045-4d3b-ad2f-187e33e15d03 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:53.013109 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6ef8a-c045-4d3b-ad2f-187e33e15d03 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:53.022080 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 931/1820] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:52 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:53.030609 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcdb04-62fd-4322-a6de-0cdc4f7e0d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:53.030919 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1c4bd-5d4d-4c09-806f-f2de9a0782e5 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:53.031269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcdb04-62fd-4322-a6de-0cdc4f7e0d97 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:53.031555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcdb04-62fd-4322-a6de-0cdc4f7e0d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:53.031832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcdb04-62fd-4322-a6de-0cdc4f7e0d97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:53.032538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcdb04-62fd-4322-a6de-0cdc4f7e0d97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:53.040664 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcdb04-62fd-4322-a6de-0cdc4f7e0d97 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:53.043753 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1c4bd-5d4d-4c09-806f-f2de9a0782e5 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:53.052337 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6647c-5bd9-4c8f-9f6d-6b585ba2d3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:53.053405 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6647c-5bd9-4c8f-9f6d-6b585ba2d3cf admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:53.054559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6647c-5bd9-4c8f-9f6d-6b585ba2d3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:53.054559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6647c-5bd9-4c8f-9f6d-6b585ba2d3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:53.055105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6647c-5bd9-4c8f-9f6d-6b585ba2d3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:53.057452 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6647c-5bd9-4c8f-9f6d-6b585ba2d3cf admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:53.058183 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:53.086709 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 932/1821] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:53.086709 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6647c-5bd9-4c8f-9f6d-6b585ba2d3cf admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:53.091849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 890/1822] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:25:52 2022] POST /identity/v3/projects => generated 405 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:53.092826 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcdb04-62fd-4322-a6de-0cdc4f7e0d97 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:53.119712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6647c-5bd9-4c8f-9f6d-6b585ba2d3cf admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:53.244321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcdb04-62fd-4322-a6de-0cdc4f7e0d97 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:53.247918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b514e7-8b38-43aa-a8e2-2eda4cdeeb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:53.248930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b514e7-8b38-43aa-a8e2-2eda4cdeeb0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:53.249299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b514e7-8b38-43aa-a8e2-2eda4cdeeb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:53.249687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b514e7-8b38-43aa-a8e2-2eda4cdeeb0a admin admin] PATH_INFO: `/v3/projects/2d9d94bad6054e71bca9da2c3ea630dd/users/7fb2f6fb3ced4a7fa55641ee761a5d94/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:53.256316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8eeda-070b-4116-82cf-e872d7b3607d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:53.257213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8eeda-070b-4116-82cf-e872d7b3607d service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:53.257674 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8eeda-070b-4116-82cf-e872d7b3607d service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:53.258211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8eeda-070b-4116-82cf-e872d7b3607d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:53.293897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b514e7-8b38-43aa-a8e2-2eda4cdeeb0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9d94bad6054e71bca9da2c3ea630dd, user_id=7fb2f6fb3ced4a7fa55641ee761a5d94, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:53.296884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b514e7-8b38-43aa-a8e2-2eda4cdeeb0a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:53.320845 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 891/1823] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:53 2022] PUT /identity/v3/projects/2d9d94bad6054e71bca9da2c3ea630dd/users/7fb2f6fb3ced4a7fa55641ee761a5d94/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:53.336572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b514e7-8b38-43aa-a8e2-2eda4cdeeb0a admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:53.369575 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8eeda-070b-4116-82cf-e872d7b3607d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:53.372026 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8eeda-070b-4116-82cf-e872d7b3607d service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:53.383988 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 933/1824] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:53.384754 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8eeda-070b-4116-82cf-e872d7b3607d service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:53.399914 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8eeda-070b-4116-82cf-e872d7b3607d service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:53.403601 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b514e7-8b38-43aa-a8e2-2eda4cdeeb0a admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:53.406393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407162d-1ebd-4204-99af-4a2bdb5e2da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:53.407178 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407162d-1ebd-4204-99af-4a2bdb5e2da5 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:53.407472 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407162d-1ebd-4204-99af-4a2bdb5e2da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:53.407756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407162d-1ebd-4204-99af-4a2bdb5e2da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:53.408575 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407162d-1ebd-4204-99af-4a2bdb5e2da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:53.410448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029ff21-1e5d-4730-a1b4-012fce7ca3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:53.410652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407162d-1ebd-4204-99af-4a2bdb5e2da5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:53.412146 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029ff21-1e5d-4730-a1b4-012fce7ca3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:53.412707 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029ff21-1e5d-4730-a1b4-012fce7ca3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:53.413179 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029ff21-1e5d-4730-a1b4-012fce7ca3c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:53.413853 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029ff21-1e5d-4730-a1b4-012fce7ca3c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:53.423563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029ff21-1e5d-4730-a1b4-012fce7ca3c1 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:53.427156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 934/1825] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:53.431296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407162d-1ebd-4204-99af-4a2bdb5e2da5 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:53.469239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407162d-1ebd-4204-99af-4a2bdb5e2da5 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:53.485648 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a6a72-988c-4b39-af0f-b59dc35ef427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:53.490229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a6a72-988c-4b39-af0f-b59dc35ef427 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:53.490975 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a6a72-988c-4b39-af0f-b59dc35ef427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:53.492035 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a6a72-988c-4b39-af0f-b59dc35ef427 admin admin] PATH_INFO: `/v3/projects/2d9d94bad6054e71bca9da2c3ea630dd/users/7fb2f6fb3ced4a7fa55641ee761a5d94/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:53.494933 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 892/1826] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:25:53 2022] POST /identity/v3/users => generated 309 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:25:53.501334 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a6a72-988c-4b39-af0f-b59dc35ef427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9d94bad6054e71bca9da2c3ea630dd, user_id=7fb2f6fb3ced4a7fa55641ee761a5d94, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:53.503054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029ff21-1e5d-4730-a1b4-012fce7ca3c1 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:53.506817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a6a72-988c-4b39-af0f-b59dc35ef427 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:53.544429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 935/1827] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:53 2022] PUT /identity/v3/projects/2d9d94bad6054e71bca9da2c3ea630dd/users/7fb2f6fb3ced4a7fa55641ee761a5d94/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:53.564465 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a72ee8-80f0-482a-9ea1-e2f432af237a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:53.564977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a72ee8-80f0-482a-9ea1-e2f432af237a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:53.565512 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a72ee8-80f0-482a-9ea1-e2f432af237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:53.570894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029ff21-1e5d-4730-a1b4-012fce7ca3c1 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:53.590629 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:53.657288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f9a72ee8-80f0-482a-9ea1-e2f432af237a None None] MFA Rules not processed for user `7fb2f6fb3ced4a7fa55641ee761a5d94`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:53.660915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f9a72ee8-80f0-482a-9ea1-e2f432af237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:53.792359 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b654c-b193-4403-b233-fe1d7656b48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:53.793045 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b654c-b193-4403-b233-fe1d7656b48a admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:53.793337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b654c-b193-4403-b233-fe1d7656b48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:53.793734 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b654c-b193-4403-b233-fe1d7656b48a admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:53.794737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b654c-b193-4403-b233-fe1d7656b48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:53.797721 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b654c-b193-4403-b233-fe1d7656b48a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:53.800786 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:53.822114 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 893/1828] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:25:53.823222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b654c-b193-4403-b233-fe1d7656b48a admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:53.848033 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b654c-b193-4403-b233-fe1d7656b48a admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:53.860260 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab6096-63a6-4de1-999d-bc297ca5c51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:53.864536 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab6096-63a6-4de1-999d-bc297ca5c51f admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:53.868439 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab6096-63a6-4de1-999d-bc297ca5c51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:53.868439 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab6096-63a6-4de1-999d-bc297ca5c51f admin admin] PATH_INFO: `/v3/projects/c9d3187ec51d4553b6bf1643b27fa44d/users/587a569169d84a95ab4545527bb3f213/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:53.894088 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 936/1829] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:25:53.917677 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab6096-63a6-4de1-999d-bc297ca5c51f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d3187ec51d4553b6bf1643b27fa44d, user_id=587a569169d84a95ab4545527bb3f213, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:53.925879 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab6096-63a6-4de1-999d-bc297ca5c51f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:53.929478 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a72ee8-80f0-482a-9ea1-e2f432af237a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:53.947234 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 894/1830] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:53 2022] PUT /identity/v3/projects/c9d3187ec51d4553b6bf1643b27fa44d/users/587a569169d84a95ab4545527bb3f213/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:53.955942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab6096-63a6-4de1-999d-bc297ca5c51f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:54.048975 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a72ee8-80f0-482a-9ea1-e2f432af237a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:54.099366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab6096-63a6-4de1-999d-bc297ca5c51f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:54.108216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6120b-a929-450a-8273-ea06526f18e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:54.109600 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6120b-a929-450a-8273-ea06526f18e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:54.110207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6120b-a929-450a-8273-ea06526f18e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:54.110778 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6120b-a929-450a-8273-ea06526f18e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:54.112109 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6120b-a929-450a-8273-ea06526f18e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:54.114355 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e32a68-0ed5-4eda-809b-53aa2526a0c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:54.115013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e32a68-0ed5-4eda-809b-53aa2526a0c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:54.115300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e32a68-0ed5-4eda-809b-53aa2526a0c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:54.115394 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6120b-a929-450a-8273-ea06526f18e5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:54.115603 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e32a68-0ed5-4eda-809b-53aa2526a0c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:54.132597 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 895/1831] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:25:54.137293 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6120b-a929-450a-8273-ea06526f18e5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:54.153285 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6120b-a929-450a-8273-ea06526f18e5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:54.162597 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea9190-d3a9-4f38-94e3-b2cb935b86cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:54.163196 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea9190-d3a9-4f38-94e3-b2cb935b86cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:54.163487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea9190-d3a9-4f38-94e3-b2cb935b86cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:54.163775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea9190-d3a9-4f38-94e3-b2cb935b86cc admin admin] PATH_INFO: `/v3/projects/c9d3187ec51d4553b6bf1643b27fa44d/users/587a569169d84a95ab4545527bb3f213/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:54.167407 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea9190-d3a9-4f38-94e3-b2cb935b86cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d3187ec51d4553b6bf1643b27fa44d, user_id=587a569169d84a95ab4545527bb3f213, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:54.171079 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea9190-d3a9-4f38-94e3-b2cb935b86cc admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:54.183887 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 896/1832] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:25:54 2022] PUT /identity/v3/projects/c9d3187ec51d4553b6bf1643b27fa44d/users/587a569169d84a95ab4545527bb3f213/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:54.202288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:54.208245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e32a68-0ed5-4eda-809b-53aa2526a0c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:54.210024 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e32a68-0ed5-4eda-809b-53aa2526a0c5 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:54.225519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 937/1833] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:25:54.316554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea9190-d3a9-4f38-94e3-b2cb935b86cc admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:54.421524 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea9190-d3a9-4f38-94e3-b2cb935b86cc admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:54.426037 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af481eb-10ec-4ce9-a1c5-3c90d36680d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:54.428456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af481eb-10ec-4ce9-a1c5-3c90d36680d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:54.429001 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af481eb-10ec-4ce9-a1c5-3c90d36680d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:54.429413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af481eb-10ec-4ce9-a1c5-3c90d36680d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:54.531074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af481eb-10ec-4ce9-a1c5-3c90d36680d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:54.538615 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af481eb-10ec-4ce9-a1c5-3c90d36680d8 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:54.557540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 897/1834] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:55.716046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8335a2e-e311-487c-9655-70b0ac966157 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:55.718200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8335a2e-e311-487c-9655-70b0ac966157 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:55.718907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8335a2e-e311-487c-9655-70b0ac966157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:55.782867 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b8335a2e-e311-487c-9655-70b0ac966157 None None] MFA Rules not processed for user `587a569169d84a95ab4545527bb3f213`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:55.785404 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b8335a2e-e311-487c-9655-70b0ac966157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:55.988311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 938/1835] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:55 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:58.008076 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac99a0-ff26-4745-b51b-87e9e1c481ae None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:58.008950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac99a0-ff26-4745-b51b-87e9e1c481ae None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:58.009704 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac99a0-ff26-4745-b51b-87e9e1c481ae None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:58.013892 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 898/1836] 10.222.0.48 () {54 vars in 921 bytes} [Thu Aug 4 10:25:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:25:58.043894 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8335a2e-e311-487c-9655-70b0ac966157 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:58.062444 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8ce49-0ed1-4700-b659-fac46b700af0 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:58.063047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8ce49-0ed1-4700-b659-fac46b700af0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:58.063385 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8ce49-0ed1-4700-b659-fac46b700af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:58.127942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-92b8ce49-0ed1-4700-b659-fac46b700af0 None None] MFA Rules not processed for user `0005b0c9582e430e9cb85704a4505bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:58.134244 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-92b8ce49-0ed1-4700-b659-fac46b700af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:58.154895 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:58.216225 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8335a2e-e311-487c-9655-70b0ac966157 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:58.225350 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83035f-1b47-4e53-9317-d9fa17fb2bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:58.225350 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83035f-1b47-4e53-9317-d9fa17fb2bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:58.229769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83035f-1b47-4e53-9317-d9fa17fb2bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:58.230790 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83035f-1b47-4e53-9317-d9fa17fb2bd6 admin admin] PATH_INFO: `/v3/users/0d3d26911a2249948f788745e969fe22` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:58.232867 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83035f-1b47-4e53-9317-d9fa17fb2bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3d26911a2249948f788745e969fe22)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:58.239260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83035f-1b47-4e53-9317-d9fa17fb2bd6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:58.297431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 899/1837] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Aug 4 10:25:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:58.319990 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8ce49-0ed1-4700-b659-fac46b700af0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:58.321990 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-92b8ce49-0ed1-4700-b659-fac46b700af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:58.348158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8ce49-0ed1-4700-b659-fac46b700af0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:58.357619 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec385d2e-772a-4c5b-85c1-6aef23ed60ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0005b0c9582e430e9cb85704a4505bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:58.359149 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec385d2e-772a-4c5b-85c1-6aef23ed60ff service placement] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:58.359149 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec385d2e-772a-4c5b-85c1-6aef23ed60ff service placement] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:58.359872 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec385d2e-772a-4c5b-85c1-6aef23ed60ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:58.361118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-be83035f-1b47-4e53-9317-d9fa17fb2bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3d26911a2249948f788745e969fe22'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:58.362640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-be83035f-1b47-4e53-9317-d9fa17fb2bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3d26911a2249948f788745e969fe22'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:58.375624 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-be83035f-1b47-4e53-9317-d9fa17fb2bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3d26911a2249948f788745e969fe22'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:58.376037 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec385d2e-772a-4c5b-85c1-6aef23ed60ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:58.376911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-be83035f-1b47-4e53-9317-d9fa17fb2bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3d26911a2249948f788745e969fe22'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:58.378347 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec385d2e-772a-4c5b-85c1-6aef23ed60ff service placement] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:58.398257 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 900/1838] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:25:58.404559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-be83035f-1b47-4e53-9317-d9fa17fb2bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3d26911a2249948f788745e969fe22'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:25:58.429957 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:58.461393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ac743-b13f-4ed7-97ae-089350fe384e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:58.461885 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ac743-b13f-4ed7-97ae-089350fe384e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:58.463875 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ac743-b13f-4ed7-97ae-089350fe384e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:58.466871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 939/1839] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:25:58 2022] DELETE /identity/v3/users/0d3d26911a2249948f788745e969fe22 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:25:58.499658 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-cf0ac743-b13f-4ed7-97ae-089350fe384e None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:58.501879 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cf0ac743-b13f-4ed7-97ae-089350fe384e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:58.612511 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 901/1840] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:25:58.634303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83035f-1b47-4e53-9317-d9fa17fb2bd6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:58.636121 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-be83035f-1b47-4e53-9317-d9fa17fb2bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:58.766069 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83035f-1b47-4e53-9317-d9fa17fb2bd6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:58.771846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481bb44-f269-4a35-a0aa-3e0eb9b21529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:58.772606 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481bb44-f269-4a35-a0aa-3e0eb9b21529 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:58.772888 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481bb44-f269-4a35-a0aa-3e0eb9b21529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:58.773178 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481bb44-f269-4a35-a0aa-3e0eb9b21529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:58.790248 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481bb44-f269-4a35-a0aa-3e0eb9b21529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:58.792100 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481bb44-f269-4a35-a0aa-3e0eb9b21529 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:58.811910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 940/1841] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:25:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:25:59.493064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c596366-0c08-4374-b410-3beeee0d6bf6 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:59.493639 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c596366-0c08-4374-b410-3beeee0d6bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:59.493639 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c596366-0c08-4374-b410-3beeee0d6bf6 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:59.495952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 902/1842] 10.222.0.48 () {54 vars in 921 bytes} [Thu Aug 4 10:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:25:59.530822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bb14f-ab00-46d8-a6e0-187fad977875 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:59.530822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bb14f-ab00-46d8-a6e0-187fad977875 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:59.531295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bb14f-ab00-46d8-a6e0-187fad977875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:59.570784 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-739bb14f-ab00-46d8-a6e0-187fad977875 None None] MFA Rules not processed for user `592539924feb44ad8ea520d8539b6608`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:25:59.572794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-739bb14f-ab00-46d8-a6e0-187fad977875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:59.750589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c596366-0c08-4374-b410-3beeee0d6bf6 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:25:59.752965 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8c596366-0c08-4374-b410-3beeee0d6bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:25:59.789394 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c596366-0c08-4374-b410-3beeee0d6bf6 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:25:59.867342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c620be6-2da3-4ebf-8823-4907532311ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:25:59.870899 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c620be6-2da3-4ebf-8823-4907532311ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:25:59.872840 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c620be6-2da3-4ebf-8823-4907532311ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:25:59.873406 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c620be6-2da3-4ebf-8823-4907532311ed admin admin] PATH_INFO: `/v3/projects/9c0b9740d2974d2f89337fd034db0909` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:25:59.894222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c620be6-2da3-4ebf-8823-4907532311ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c0b9740d2974d2f89337fd034db0909)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:25:59.914208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c620be6-2da3-4ebf-8823-4907532311ed admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:25:59.994725 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 941/1843] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Aug 4 10:25:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:00.076716 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4c620be6-2da3-4ebf-8823-4907532311ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c0b9740d2974d2f89337fd034db0909', 'request_id': 'req-4c620be6-2da3-4ebf-8823-4907532311ed'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.094294 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bb14f-ab00-46d8-a6e0-187fad977875 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:00.095987 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-739bb14f-ab00-46d8-a6e0-187fad977875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:00.098066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4c620be6-2da3-4ebf-8823-4907532311ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c0b9740d2974d2f89337fd034db0909', 'request_id': 'req-4c620be6-2da3-4ebf-8823-4907532311ed'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.112260 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4c620be6-2da3-4ebf-8823-4907532311ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c0b9740d2974d2f89337fd034db0909', 'request_id': 'req-4c620be6-2da3-4ebf-8823-4907532311ed'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.120872 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bb14f-ab00-46d8-a6e0-187fad977875 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:00.181244 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4c620be6-2da3-4ebf-8823-4907532311ed admin admin] The token cache is being invalidate because project 9c0b9740d2974d2f89337fd034db0909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:00.181754 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4c620be6-2da3-4ebf-8823-4907532311ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.183057 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4c620be6-2da3-4ebf-8823-4907532311ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.185897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 903/1844] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:25:59 2022] DELETE /identity/v3/projects/9c0b9740d2974d2f89337fd034db0909 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:00.191474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c620be6-2da3-4ebf-8823-4907532311ed admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:00.195200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4c620be6-2da3-4ebf-8823-4907532311ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:00.242699 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:00.265542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecb024-ea03-41bc-86e9-19c6b0b7fd84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:00.265542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecb024-ea03-41bc-86e9-19c6b0b7fd84 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:00.267072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecb024-ea03-41bc-86e9-19c6b0b7fd84 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:00.267668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecb024-ea03-41bc-86e9-19c6b0b7fd84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:00.278566 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6aecb024-ea03-41bc-86e9-19c6b0b7fd84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:00.312452 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecb024-ea03-41bc-86e9-19c6b0b7fd84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:00.315724 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecb024-ea03-41bc-86e9-19c6b0b7fd84 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:00.347367 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 942/1845] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:26:00.355578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88b5f2-b6b1-4e0d-9ef7-08d90ef6e601 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:00.356106 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88b5f2-b6b1-4e0d-9ef7-08d90ef6e601 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:00.356642 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88b5f2-b6b1-4e0d-9ef7-08d90ef6e601 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:00.359267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 943/1846] 10.222.0.48 () {54 vars in 921 bytes} [Thu Aug 4 10:26:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:26:00.366489 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88b5f2-b6b1-4e0d-9ef7-08d90ef6e601 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:00.376422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2c88b5f2-b6b1-4e0d-9ef7-08d90ef6e601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:00.395231 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c620be6-2da3-4ebf-8823-4907532311ed admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:00.404422 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b89121-888d-4dd1-ac0f-4f01612605f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:00.405547 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b89121-888d-4dd1-ac0f-4f01612605f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:00.405983 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b89121-888d-4dd1-ac0f-4f01612605f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:00.406451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b89121-888d-4dd1-ac0f-4f01612605f0 admin admin] PATH_INFO: `/v3/users/bcc9f6aec9a14db7addf57c4bb6868ce` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:00.408576 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b89121-888d-4dd1-ac0f-4f01612605f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc9f6aec9a14db7addf57c4bb6868ce)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:00.409974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88b5f2-b6b1-4e0d-9ef7-08d90ef6e601 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:00.413879 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b89121-888d-4dd1-ac0f-4f01612605f0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:00.420958 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa721434-6d2a-467e-a80c-ee5ba8d1d9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:00.421655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa721434-6d2a-467e-a80c-ee5ba8d1d9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:00.421940 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa721434-6d2a-467e-a80c-ee5ba8d1d9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:00.422214 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa721434-6d2a-467e-a80c-ee5ba8d1d9f7 admin admin] PATH_INFO: `/v3/users/2b418a6b7893417cbcecd1db92b11b40` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:00.425252 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa721434-6d2a-467e-a80c-ee5ba8d1d9f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b418a6b7893417cbcecd1db92b11b40)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:00.428033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa721434-6d2a-467e-a80c-ee5ba8d1d9f7 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:00.460115 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:00.520715 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-fa721434-6d2a-467e-a80c-ee5ba8d1d9f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b418a6b7893417cbcecd1db92b11b40'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.521615 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-fa721434-6d2a-467e-a80c-ee5ba8d1d9f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b418a6b7893417cbcecd1db92b11b40'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.526199 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d5b89121-888d-4dd1-ac0f-4f01612605f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc9f6aec9a14db7addf57c4bb6868ce'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.527500 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d5b89121-888d-4dd1-ac0f-4f01612605f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc9f6aec9a14db7addf57c4bb6868ce'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.532993 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-fa721434-6d2a-467e-a80c-ee5ba8d1d9f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b418a6b7893417cbcecd1db92b11b40'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.539746 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-fa721434-6d2a-467e-a80c-ee5ba8d1d9f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b418a6b7893417cbcecd1db92b11b40'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.543598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d5b89121-888d-4dd1-ac0f-4f01612605f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc9f6aec9a14db7addf57c4bb6868ce'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.560376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-fa721434-6d2a-467e-a80c-ee5ba8d1d9f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b418a6b7893417cbcecd1db92b11b40'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.561275 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d5b89121-888d-4dd1-ac0f-4f01612605f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc9f6aec9a14db7addf57c4bb6868ce'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.577797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d5b89121-888d-4dd1-ac0f-4f01612605f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc9f6aec9a14db7addf57c4bb6868ce'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.585064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 944/1847] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:00 2022] DELETE /identity/v3/users/2b418a6b7893417cbcecd1db92b11b40 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:00.586500 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 904/1848] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:00 2022] DELETE /identity/v3/users/bcc9f6aec9a14db7addf57c4bb6868ce => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:00.587174 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e46628-1f69-49b9-8fc8-9557ef69fa6f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:00.587544 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e46628-1f69-49b9-8fc8-9557ef69fa6f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:00.587649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b89121-888d-4dd1-ac0f-4f01612605f0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:00.587990 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e46628-1f69-49b9-8fc8-9557ef69fa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:00.592967 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d5b89121-888d-4dd1-ac0f-4f01612605f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:00.664508 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-14e46628-1f69-49b9-8fc8-9557ef69fa6f None None] MFA Rules not processed for user `0005b0c9582e430e9cb85704a4505bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:00.665863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-14e46628-1f69-49b9-8fc8-9557ef69fa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:00.761837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b89121-888d-4dd1-ac0f-4f01612605f0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:00.775837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4659ba-3f5a-4f11-abfe-745e8661bd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:00.776888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4659ba-3f5a-4f11-abfe-745e8661bd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:00.777160 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4659ba-3f5a-4f11-abfe-745e8661bd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:00.777476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4659ba-3f5a-4f11-abfe-745e8661bd6d admin admin] PATH_INFO: `/v3/users/a714833f16a24f62be73c2c7f2ebea7c` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:00.779460 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4659ba-3f5a-4f11-abfe-745e8661bd6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a714833f16a24f62be73c2c7f2ebea7c)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:00.781918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4659ba-3f5a-4f11-abfe-745e8661bd6d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:00.843479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:00.854963 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 945/1849] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Aug 4 10:26:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:00.857396 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2777c-f8a7-4385-904e-caf8a8c3ea3d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:00.857913 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2777c-f8a7-4385-904e-caf8a8c3ea3d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:00.864062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-de4659ba-3f5a-4f11-abfe-745e8661bd6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a714833f16a24f62be73c2c7f2ebea7c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.865164 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-de4659ba-3f5a-4f11-abfe-745e8661bd6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a714833f16a24f62be73c2c7f2ebea7c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.870317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2777c-f8a7-4385-904e-caf8a8c3ea3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:00.890446 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-de4659ba-3f5a-4f11-abfe-745e8661bd6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a714833f16a24f62be73c2c7f2ebea7c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.916865 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2fa2777c-f8a7-4385-904e-caf8a8c3ea3d None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:00.918692 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2fa2777c-f8a7-4385-904e-caf8a8c3ea3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:00.925430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-de4659ba-3f5a-4f11-abfe-745e8661bd6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a714833f16a24f62be73c2c7f2ebea7c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.930841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 946/1850] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:00.944339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2777c-f8a7-4385-904e-caf8a8c3ea3d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:00.949021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-de4659ba-3f5a-4f11-abfe-745e8661bd6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a714833f16a24f62be73c2c7f2ebea7c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:00.954193 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2fa2777c-f8a7-4385-904e-caf8a8c3ea3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:00.975817 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 905/1851] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:00 2022] DELETE /identity/v3/users/a714833f16a24f62be73c2c7f2ebea7c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:00.978465 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4659ba-3f5a-4f11-abfe-745e8661bd6d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:00.980902 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2777c-f8a7-4385-904e-caf8a8c3ea3d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:00.983586 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-de4659ba-3f5a-4f11-abfe-745e8661bd6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:01.178000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548a652-ac4b-49aa-96c3-e6167ea98718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:01.186606 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548a652-ac4b-49aa-96c3-e6167ea98718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:01.188857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548a652-ac4b-49aa-96c3-e6167ea98718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:01.193743 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548a652-ac4b-49aa-96c3-e6167ea98718 admin admin] PATH_INFO: `/v3/users/1e0cc29d6fee452db377afe62d4b150e` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:01.202535 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548a652-ac4b-49aa-96c3-e6167ea98718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e0cc29d6fee452db377afe62d4b150e)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:01.211952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548a652-ac4b-49aa-96c3-e6167ea98718 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:01.241143 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4659ba-3f5a-4f11-abfe-745e8661bd6d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:01.261674 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b05ca-198e-4746-8c9d-7111efb33f29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0005b0c9582e430e9cb85704a4505bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:01.262687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b05ca-198e-4746-8c9d-7111efb33f29 service placement] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:01.263397 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b05ca-198e-4746-8c9d-7111efb33f29 service placement] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:01.263857 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b05ca-198e-4746-8c9d-7111efb33f29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:01.274321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0b1b05ca-198e-4746-8c9d-7111efb33f29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:01.283635 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:01.322431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b05ca-198e-4746-8c9d-7111efb33f29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:01.324843 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b05ca-198e-4746-8c9d-7111efb33f29 service placement] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:01.346810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4548a652-ac4b-49aa-96c3-e6167ea98718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e0cc29d6fee452db377afe62d4b150e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:01.347865 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4548a652-ac4b-49aa-96c3-e6167ea98718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e0cc29d6fee452db377afe62d4b150e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:01.354032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 906/1852] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:01.356295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b05ca-198e-4746-8c9d-7111efb33f29 service placement] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:01.358035 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4548a652-ac4b-49aa-96c3-e6167ea98718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e0cc29d6fee452db377afe62d4b150e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:01.358888 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4548a652-ac4b-49aa-96c3-e6167ea98718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e0cc29d6fee452db377afe62d4b150e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:01.359959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0b1b05ca-198e-4746-8c9d-7111efb33f29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:01.397358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4548a652-ac4b-49aa-96c3-e6167ea98718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e0cc29d6fee452db377afe62d4b150e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:01.430550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 947/1853] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:00 2022] DELETE /identity/v3/users/1e0cc29d6fee452db377afe62d4b150e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:01.432422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090be945-1cab-4c8a-82ef-12519db4de62 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:01.433006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090be945-1cab-4c8a-82ef-12519db4de62 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:01.433368 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090be945-1cab-4c8a-82ef-12519db4de62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:01.477834 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-090be945-1cab-4c8a-82ef-12519db4de62 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:01.479277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-090be945-1cab-4c8a-82ef-12519db4de62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:01.492198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b05ca-198e-4746-8c9d-7111efb33f29 service placement] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:01.616148 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 948/1854] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:26:01.617267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090be945-1cab-4c8a-82ef-12519db4de62 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:01.618656 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-090be945-1cab-4c8a-82ef-12519db4de62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:01.643684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090be945-1cab-4c8a-82ef-12519db4de62 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:01.652306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f037b-5b62-49a2-8638-a26c247770a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:01.653033 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f037b-5b62-49a2-8638-a26c247770a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:01.653033 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f037b-5b62-49a2-8638-a26c247770a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:01.654165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f037b-5b62-49a2-8638-a26c247770a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:01.660319 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2a4f037b-5b62-49a2-8638-a26c247770a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:01.663889 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae031c-45ce-4d83-97ec-d9314166b23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:01.665770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae031c-45ce-4d83-97ec-d9314166b23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:01.666291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae031c-45ce-4d83-97ec-d9314166b23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:01.667272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae031c-45ce-4d83-97ec-d9314166b23d admin admin] PATH_INFO: `/v3/projects/9d3861dc14094147a630bafe305f530a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:01.682712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae031c-45ce-4d83-97ec-d9314166b23d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d3861dc14094147a630bafe305f530a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:01.686921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae031c-45ce-4d83-97ec-d9314166b23d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:01.697805 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f037b-5b62-49a2-8638-a26c247770a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:01.699837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f037b-5b62-49a2-8638-a26c247770a0 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:01.716770 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 907/1855] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:01.719770 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f037b-5b62-49a2-8638-a26c247770a0 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:01.721521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2a4f037b-5b62-49a2-8638-a26c247770a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:01.744931 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:01.759706 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f037b-5b62-49a2-8638-a26c247770a0 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:01.767418 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561ab67-b611-4238-af28-6de54f5f3f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:01.768662 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561ab67-b611-4238-af28-6de54f5f3f36 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:01.769094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561ab67-b611-4238-af28-6de54f5f3f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:01.769593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561ab67-b611-4238-af28-6de54f5f3f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:01.785342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561ab67-b611-4238-af28-6de54f5f3f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:01.788123 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561ab67-b611-4238-af28-6de54f5f3f36 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:01.803804 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 908/1856] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:01.809430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a5ae031c-45ce-4d83-97ec-d9314166b23d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d3861dc14094147a630bafe305f530a', 'request_id': 'req-a5ae031c-45ce-4d83-97ec-d9314166b23d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:01.819489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561ab67-b611-4238-af28-6de54f5f3f36 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:01.819893 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a5ae031c-45ce-4d83-97ec-d9314166b23d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d3861dc14094147a630bafe305f530a', 'request_id': 'req-a5ae031c-45ce-4d83-97ec-d9314166b23d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:01.824811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1561ab67-b611-4238-af28-6de54f5f3f36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:01.834462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a5ae031c-45ce-4d83-97ec-d9314166b23d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d3861dc14094147a630bafe305f530a', 'request_id': 'req-a5ae031c-45ce-4d83-97ec-d9314166b23d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:01.856845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a5ae031c-45ce-4d83-97ec-d9314166b23d admin admin] The token cache is being invalidate because project 9d3861dc14094147a630bafe305f530a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:01.858212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a5ae031c-45ce-4d83-97ec-d9314166b23d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:01.859463 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a5ae031c-45ce-4d83-97ec-d9314166b23d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:01.864218 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 949/1857] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:01 2022] DELETE /identity/v3/projects/9d3861dc14094147a630bafe305f530a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:01.864715 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561ab67-b611-4238-af28-6de54f5f3f36 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:01.866872 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf452d-7f44-41f8-b0ce-17f3abd5b6f8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:01.867344 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf452d-7f44-41f8-b0ce-17f3abd5b6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:01.867956 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf452d-7f44-41f8-b0ce-17f3abd5b6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:01.898623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-0bbf452d-7f44-41f8-b0ce-17f3abd5b6f8 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:01.901810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0bbf452d-7f44-41f8-b0ce-17f3abd5b6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:01.962084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:02.000293 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59953827-0818-44f6-8c68-8131928fd374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:02.002884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59953827-0818-44f6-8c68-8131928fd374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:02.003451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59953827-0818-44f6-8c68-8131928fd374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:02.003884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59953827-0818-44f6-8c68-8131928fd374 admin admin] PATH_INFO: `/v3/projects/bc4327d6889240b588382446a5b819c1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:02.008676 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59953827-0818-44f6-8c68-8131928fd374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc4327d6889240b588382446a5b819c1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:02.015169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59953827-0818-44f6-8c68-8131928fd374 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:02.096487 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 950/1858] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:02.098392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc996337-3756-4b44-9f23-3fcac0264a16 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:02.098932 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc996337-3756-4b44-9f23-3fcac0264a16 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:02.099078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc996337-3756-4b44-9f23-3fcac0264a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:02.143799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-fc996337-3756-4b44-9f23-3fcac0264a16 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:02.145732 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-59953827-0818-44f6-8c68-8131928fd374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc4327d6889240b588382446a5b819c1', 'request_id': 'req-59953827-0818-44f6-8c68-8131928fd374'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:02.147524 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-fc996337-3756-4b44-9f23-3fcac0264a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:02.162110 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-59953827-0818-44f6-8c68-8131928fd374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc4327d6889240b588382446a5b819c1', 'request_id': 'req-59953827-0818-44f6-8c68-8131928fd374'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:02.186989 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-59953827-0818-44f6-8c68-8131928fd374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc4327d6889240b588382446a5b819c1', 'request_id': 'req-59953827-0818-44f6-8c68-8131928fd374'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:02.226519 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-59953827-0818-44f6-8c68-8131928fd374 admin admin] The token cache is being invalidate because project bc4327d6889240b588382446a5b819c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:02.228628 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-59953827-0818-44f6-8c68-8131928fd374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:02.234532 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-59953827-0818-44f6-8c68-8131928fd374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:02.238046 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 909/1859] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:01 2022] DELETE /identity/v3/projects/bc4327d6889240b588382446a5b819c1 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:02.260638 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59953827-0818-44f6-8c68-8131928fd374 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:02.274747 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-59953827-0818-44f6-8c68-8131928fd374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:02.454199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 951/1860] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:26:02.462576 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc996337-3756-4b44-9f23-3fcac0264a16 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:02.496790 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc996337-3756-4b44-9f23-3fcac0264a16 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:02.510563 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95d118-dffc-4142-81c1-8ce2acc1cfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:02.511723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95d118-dffc-4142-81c1-8ce2acc1cfda admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:02.512308 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95d118-dffc-4142-81c1-8ce2acc1cfda admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:02.512861 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95d118-dffc-4142-81c1-8ce2acc1cfda admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:02.514426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95d118-dffc-4142-81c1-8ce2acc1cfda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:02.515265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95d118-dffc-4142-81c1-8ce2acc1cfda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:02.518964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95d118-dffc-4142-81c1-8ce2acc1cfda admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:02.559968 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 952/1861] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:02.562180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59953827-0818-44f6-8c68-8131928fd374 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:02.574647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95d118-dffc-4142-81c1-8ce2acc1cfda admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:02.576655 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748463c-09f8-4e3a-b56d-f075bf8a647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:02.577362 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748463c-09f8-4e3a-b56d-f075bf8a647b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:02.577658 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748463c-09f8-4e3a-b56d-f075bf8a647b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:02.578839 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748463c-09f8-4e3a-b56d-f075bf8a647b admin admin] PATH_INFO: `/v3/users/587a569169d84a95ab4545527bb3f213` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:02.580645 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748463c-09f8-4e3a-b56d-f075bf8a647b admin admin] RBAC: Authorizing `identity:delete_user(user_id=587a569169d84a95ab4545527bb3f213)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:02.583071 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748463c-09f8-4e3a-b56d-f075bf8a647b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:02.602257 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95d118-dffc-4142-81c1-8ce2acc1cfda admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:02.624665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3f167-a917-4eb4-ac13-4e2b2cb4e1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:02.643229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3f167-a917-4eb4-ac13-4e2b2cb4e1aa admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:02.654520 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3f167-a917-4eb4-ac13-4e2b2cb4e1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:02.657061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3f167-a917-4eb4-ac13-4e2b2cb4e1aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:02.658465 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:02.663522 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3f167-a917-4eb4-ac13-4e2b2cb4e1aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:02.668454 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3f167-a917-4eb4-ac13-4e2b2cb4e1aa admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:02.727948 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6748463c-09f8-4e3a-b56d-f075bf8a647b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '587a569169d84a95ab4545527bb3f213'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:02.730969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6748463c-09f8-4e3a-b56d-f075bf8a647b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '587a569169d84a95ab4545527bb3f213'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:02.751278 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6748463c-09f8-4e3a-b56d-f075bf8a647b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '587a569169d84a95ab4545527bb3f213'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:02.787700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6748463c-09f8-4e3a-b56d-f075bf8a647b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '587a569169d84a95ab4545527bb3f213'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:02.794947 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 953/1862] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:02 2022] POST /identity/v3/projects => generated 367 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:02.807603 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3f167-a917-4eb4-ac13-4e2b2cb4e1aa admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:02.813055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6748463c-09f8-4e3a-b56d-f075bf8a647b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '587a569169d84a95ab4545527bb3f213'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:02.819797 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3db3f167-a917-4eb4-ac13-4e2b2cb4e1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:02.825948 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 910/1863] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:02 2022] DELETE /identity/v3/users/587a569169d84a95ab4545527bb3f213 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:02.937466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748463c-09f8-4e3a-b56d-f075bf8a647b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:02.939144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6748463c-09f8-4e3a-b56d-f075bf8a647b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:02.983968 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3f167-a917-4eb4-ac13-4e2b2cb4e1aa admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:03.032521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748463c-09f8-4e3a-b56d-f075bf8a647b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:03.040838 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722b38b-7ed3-4823-9250-baa5b576728d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:03.046385 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722b38b-7ed3-4823-9250-baa5b576728d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:03.046921 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722b38b-7ed3-4823-9250-baa5b576728d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:03.048098 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722b38b-7ed3-4823-9250-baa5b576728d admin admin] PATH_INFO: `/v3/projects/8cc146b1443f4425b2a057ee6a7e5c94` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:03.054617 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722b38b-7ed3-4823-9250-baa5b576728d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cc146b1443f4425b2a057ee6a7e5c94)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:03.059930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722b38b-7ed3-4823-9250-baa5b576728d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:03.094361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:03.163460 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566045c4-b3c8-434f-921c-3b7346550715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:03.164934 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566045c4-b3c8-434f-921c-3b7346550715 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:03.165671 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566045c4-b3c8-434f-921c-3b7346550715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:03.166557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566045c4-b3c8-434f-921c-3b7346550715 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:03.168306 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566045c4-b3c8-434f-921c-3b7346550715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:03.172443 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566045c4-b3c8-434f-921c-3b7346550715 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:03.258048 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 954/1864] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:02 2022] POST /identity/v3/users => generated 284 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:26:03.264849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566045c4-b3c8-434f-921c-3b7346550715 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:03.312860 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566045c4-b3c8-434f-921c-3b7346550715 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:03.314316 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a722b38b-7ed3-4823-9250-baa5b576728d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc146b1443f4425b2a057ee6a7e5c94', 'request_id': 'req-a722b38b-7ed3-4823-9250-baa5b576728d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:03.368930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a722b38b-7ed3-4823-9250-baa5b576728d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc146b1443f4425b2a057ee6a7e5c94', 'request_id': 'req-a722b38b-7ed3-4823-9250-baa5b576728d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:03.468778 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a722b38b-7ed3-4823-9250-baa5b576728d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc146b1443f4425b2a057ee6a7e5c94', 'request_id': 'req-a722b38b-7ed3-4823-9250-baa5b576728d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:03.540238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a722b38b-7ed3-4823-9250-baa5b576728d admin admin] The token cache is being invalidate because project 8cc146b1443f4425b2a057ee6a7e5c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:03.540238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a722b38b-7ed3-4823-9250-baa5b576728d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:03.541760 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a722b38b-7ed3-4823-9250-baa5b576728d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:03.552287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 911/1865] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:02 2022] DELETE /identity/v3/projects/8cc146b1443f4425b2a057ee6a7e5c94 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:03.554727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722b38b-7ed3-4823-9250-baa5b576728d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:03.561165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a722b38b-7ed3-4823-9250-baa5b576728d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:03.651366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0782f4-2933-49b4-84b3-de19c24cc816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:03.652956 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0782f4-2933-49b4-84b3-de19c24cc816 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:03.653470 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0782f4-2933-49b4-84b3-de19c24cc816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:03.653974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0782f4-2933-49b4-84b3-de19c24cc816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:03.655322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0782f4-2933-49b4-84b3-de19c24cc816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:03.664058 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0782f4-2933-49b4-84b3-de19c24cc816 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:03.695869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 955/1866] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:03.697797 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0782f4-2933-49b4-84b3-de19c24cc816 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:03.700827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6c0782f4-2933-49b4-84b3-de19c24cc816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:03.719930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:03.738224 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0782f4-2933-49b4-84b3-de19c24cc816 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:03.748229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781fec6-c3c9-4a76-bfad-359c12c86d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:03.749494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781fec6-c3c9-4a76-bfad-359c12c86d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:03.749998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781fec6-c3c9-4a76-bfad-359c12c86d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:03.750597 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781fec6-c3c9-4a76-bfad-359c12c86d5f admin admin] PATH_INFO: `/v3/users/9712b15ba4fc4f278a51ce7aad2735e3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:03.753142 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781fec6-c3c9-4a76-bfad-359c12c86d5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9712b15ba4fc4f278a51ce7aad2735e3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:03.759191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781fec6-c3c9-4a76-bfad-359c12c86d5f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:03.810970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722b38b-7ed3-4823-9250-baa5b576728d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:03.834836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef7131-83c3-416d-b3f7-5370ff56ef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:03.843854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef7131-83c3-416d-b3f7-5370ff56ef90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:03.843854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef7131-83c3-416d-b3f7-5370ff56ef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:03.843854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef7131-83c3-416d-b3f7-5370ff56ef90 admin admin] PATH_INFO: `/v3/projects/c9d3187ec51d4553b6bf1643b27fa44d` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:03.846552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef7131-83c3-416d-b3f7-5370ff56ef90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d3187ec51d4553b6bf1643b27fa44d)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:03.849509 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef7131-83c3-416d-b3f7-5370ff56ef90 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:03.982039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-44ef7131-83c3-416d-b3f7-5370ff56ef90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d3187ec51d4553b6bf1643b27fa44d', 'request_id': 'req-44ef7131-83c3-416d-b3f7-5370ff56ef90'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:04.020568 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-44ef7131-83c3-416d-b3f7-5370ff56ef90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d3187ec51d4553b6bf1643b27fa44d', 'request_id': 'req-44ef7131-83c3-416d-b3f7-5370ff56ef90'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:04.030107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6781fec6-c3c9-4a76-bfad-359c12c86d5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9712b15ba4fc4f278a51ce7aad2735e3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:04.030523 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6781fec6-c3c9-4a76-bfad-359c12c86d5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9712b15ba4fc4f278a51ce7aad2735e3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:04.053676 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-44ef7131-83c3-416d-b3f7-5370ff56ef90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d3187ec51d4553b6bf1643b27fa44d', 'request_id': 'req-44ef7131-83c3-416d-b3f7-5370ff56ef90'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:04.060402 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6781fec6-c3c9-4a76-bfad-359c12c86d5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9712b15ba4fc4f278a51ce7aad2735e3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:04.068218 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6781fec6-c3c9-4a76-bfad-359c12c86d5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9712b15ba4fc4f278a51ce7aad2735e3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:04.072960 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-44ef7131-83c3-416d-b3f7-5370ff56ef90 admin admin] The token cache is being invalidate because project c9d3187ec51d4553b6bf1643b27fa44d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:04.073597 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-44ef7131-83c3-416d-b3f7-5370ff56ef90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:04.074733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-44ef7131-83c3-416d-b3f7-5370ff56ef90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:04.077160 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 912/1867] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:03 2022] DELETE /identity/v3/projects/c9d3187ec51d4553b6bf1643b27fa44d => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:04.078513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef7131-83c3-416d-b3f7-5370ff56ef90 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:04.080723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-44ef7131-83c3-416d-b3f7-5370ff56ef90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:04.142948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6781fec6-c3c9-4a76-bfad-359c12c86d5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9712b15ba4fc4f278a51ce7aad2735e3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:04.195431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef7131-83c3-416d-b3f7-5370ff56ef90 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:04.200458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 956/1868] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:03 2022] DELETE /identity/v3/users/9712b15ba4fc4f278a51ce7aad2735e3 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:04.206760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f266c11-f6dc-4593-ac76-e410fbd3a9ba None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:04.207311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f266c11-f6dc-4593-ac76-e410fbd3a9ba None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:04.208468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f266c11-f6dc-4593-ac76-e410fbd3a9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:04.259934 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5f266c11-f6dc-4593-ac76-e410fbd3a9ba None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:04.262082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5f266c11-f6dc-4593-ac76-e410fbd3a9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:04.299372 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b0639-08b7-494c-8771-dc3f3bb91dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:04.302090 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b0639-08b7-494c-8771-dc3f3bb91dcc admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:04.303499 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b0639-08b7-494c-8771-dc3f3bb91dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:04.304766 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b0639-08b7-494c-8771-dc3f3bb91dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:04.307154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b0639-08b7-494c-8771-dc3f3bb91dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:04.318129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b0639-08b7-494c-8771-dc3f3bb91dcc admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:04.331070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:04.370162 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 913/1869] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:04.372551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b0639-08b7-494c-8771-dc3f3bb91dcc admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:04.376913 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9b7b0639-08b7-494c-8771-dc3f3bb91dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:04.394166 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:04.397079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 957/1870] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:04.398864 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f266c11-f6dc-4593-ac76-e410fbd3a9ba None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:04.416418 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b0639-08b7-494c-8771-dc3f3bb91dcc admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:04.438553 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f266c11-f6dc-4593-ac76-e410fbd3a9ba None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:04.446122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76731a82-561f-4da6-bf77-3e35edf29d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:04.448222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76731a82-561f-4da6-bf77-3e35edf29d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:04.451319 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76731a82-561f-4da6-bf77-3e35edf29d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:04.453037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aeff3a-bd4f-44b9-ada9-5bc4e00c6519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:04.453760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeff3a-bd4f-44b9-ada9-5bc4e00c6519 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:04.454048 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeff3a-bd4f-44b9-ada9-5bc4e00c6519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:04.454338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeff3a-bd4f-44b9-ada9-5bc4e00c6519 admin admin] PATH_INFO: `/v3/projects/6ef9e99586ca4b01a33ae63f50cf7089/users/02c2712413d041d7811a78df30afa978/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:04.455756 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76731a82-561f-4da6-bf77-3e35edf29d41 admin admin] PATH_INFO: `/v3/users/2b2e6548db6448f18aa09c4b6f94ab53` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:04.464826 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76731a82-561f-4da6-bf77-3e35edf29d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2e6548db6448f18aa09c4b6f94ab53)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:04.479730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76731a82-561f-4da6-bf77-3e35edf29d41 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:04.525534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aeff3a-bd4f-44b9-ada9-5bc4e00c6519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef9e99586ca4b01a33ae63f50cf7089, user_id=02c2712413d041d7811a78df30afa978, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:04.547100 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aeff3a-bd4f-44b9-ada9-5bc4e00c6519 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:04.579350 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 958/1871] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:04 2022] PUT /identity/v3/projects/6ef9e99586ca4b01a33ae63f50cf7089/users/02c2712413d041d7811a78df30afa978/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:04.589186 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aeb8f-6fe6-4a31-9871-9e8b444f3504 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:04.589699 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aeb8f-6fe6-4a31-9871-9e8b444f3504 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:04.590192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6aeb8f-6fe6-4a31-9871-9e8b444f3504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:04.659055 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-9b6aeb8f-6fe6-4a31-9871-9e8b444f3504 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:04.662434 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9b6aeb8f-6fe6-4a31-9871-9e8b444f3504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:04.684193 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-76731a82-561f-4da6-bf77-3e35edf29d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2e6548db6448f18aa09c4b6f94ab53'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:04.687135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-76731a82-561f-4da6-bf77-3e35edf29d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2e6548db6448f18aa09c4b6f94ab53'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:04.706073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-76731a82-561f-4da6-bf77-3e35edf29d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2e6548db6448f18aa09c4b6f94ab53'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:04.732305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-76731a82-561f-4da6-bf77-3e35edf29d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2e6548db6448f18aa09c4b6f94ab53'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:04.762382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-76731a82-561f-4da6-bf77-3e35edf29d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2e6548db6448f18aa09c4b6f94ab53'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:04.782451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 914/1872] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:04 2022] DELETE /identity/v3/users/2b2e6548db6448f18aa09c4b6f94ab53 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:04.784886 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76731a82-561f-4da6-bf77-3e35edf29d41 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:04.787823 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-76731a82-561f-4da6-bf77-3e35edf29d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:04.886690 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 959/1873] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:04.889632 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb806d2e-41f5-4948-bd68-1ae1d3676eb8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:04.889632 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb806d2e-41f5-4948-bd68-1ae1d3676eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:04.889632 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb806d2e-41f5-4948-bd68-1ae1d3676eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:04.937643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76731a82-561f-4da6-bf77-3e35edf29d41 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:04.944472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e27cf9-57b1-4491-82f1-89920fe4b555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:04.945592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-eb806d2e-41f5-4948-bd68-1ae1d3676eb8 None None] MFA Rules not processed for user `02c2712413d041d7811a78df30afa978`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:04.946183 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e27cf9-57b1-4491-82f1-89920fe4b555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:04.946756 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e27cf9-57b1-4491-82f1-89920fe4b555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:04.947128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e27cf9-57b1-4491-82f1-89920fe4b555 admin admin] PATH_INFO: `/v3/projects/7cb6e1dedbd64a55881d27de23dad656` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:04.947596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-eb806d2e-41f5-4948-bd68-1ae1d3676eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:04.948919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e27cf9-57b1-4491-82f1-89920fe4b555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb6e1dedbd64a55881d27de23dad656)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:04.951146 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e27cf9-57b1-4491-82f1-89920fe4b555 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:05.023855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-86e27cf9-57b1-4491-82f1-89920fe4b555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb6e1dedbd64a55881d27de23dad656', 'request_id': 'req-86e27cf9-57b1-4491-82f1-89920fe4b555'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:05.031855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-86e27cf9-57b1-4491-82f1-89920fe4b555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb6e1dedbd64a55881d27de23dad656', 'request_id': 'req-86e27cf9-57b1-4491-82f1-89920fe4b555'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:05.043140 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-86e27cf9-57b1-4491-82f1-89920fe4b555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb6e1dedbd64a55881d27de23dad656', 'request_id': 'req-86e27cf9-57b1-4491-82f1-89920fe4b555'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:05.059434 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 960/1874] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:05.059434 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64b321-835f-4e3f-a2ba-dfe5a1be2b4a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:05.059434 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64b321-835f-4e3f-a2ba-dfe5a1be2b4a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:05.059434 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64b321-835f-4e3f-a2ba-dfe5a1be2b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:05.063083 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-86e27cf9-57b1-4491-82f1-89920fe4b555 admin admin] The token cache is being invalidate because project 7cb6e1dedbd64a55881d27de23dad656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:05.063495 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-86e27cf9-57b1-4491-82f1-89920fe4b555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:05.064323 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-86e27cf9-57b1-4491-82f1-89920fe4b555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:05.066190 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 915/1875] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:04 2022] DELETE /identity/v3/projects/7cb6e1dedbd64a55881d27de23dad656 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:05.068395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e27cf9-57b1-4491-82f1-89920fe4b555 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:05.071077 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-86e27cf9-57b1-4491-82f1-89920fe4b555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:05.081408 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:05.087764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-9b64b321-835f-4e3f-a2ba-dfe5a1be2b4a None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:05.090068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9b64b321-835f-4e3f-a2ba-dfe5a1be2b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:05.173241 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:05.222085 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e27cf9-57b1-4491-82f1-89920fe4b555 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:05.233248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697e23b-030a-462d-a673-f8816f6d4b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:05.235019 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697e23b-030a-462d-a673-f8816f6d4b13 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:05.235779 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697e23b-030a-462d-a673-f8816f6d4b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:05.236589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697e23b-030a-462d-a673-f8816f6d4b13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:05.238247 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697e23b-030a-462d-a673-f8816f6d4b13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:05.239687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697e23b-030a-462d-a673-f8816f6d4b13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:05.243866 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697e23b-030a-462d-a673-f8816f6d4b13 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:05.260228 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 961/1876] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:05.261425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64b321-835f-4e3f-a2ba-dfe5a1be2b4a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:05.266323 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9b64b321-835f-4e3f-a2ba-dfe5a1be2b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:05.288305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 916/1877] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:05.290148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697e23b-030a-462d-a673-f8816f6d4b13 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:05.293992 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64b321-835f-4e3f-a2ba-dfe5a1be2b4a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:05.296252 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b697e23b-030a-462d-a673-f8816f6d4b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:05.301340 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0325c5-5514-4ed5-b29d-a7f339240780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:05.302171 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0325c5-5514-4ed5-b29d-a7f339240780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:05.302581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0325c5-5514-4ed5-b29d-a7f339240780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:05.303010 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0325c5-5514-4ed5-b29d-a7f339240780 admin admin] PATH_INFO: `/v3/projects/dd2a38ee6c1749129cab44f85a52a2dd` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:05.304762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0325c5-5514-4ed5-b29d-a7f339240780 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd2a38ee6c1749129cab44f85a52a2dd)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:05.307074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0325c5-5514-4ed5-b29d-a7f339240780 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:05.320709 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697e23b-030a-462d-a673-f8816f6d4b13 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:05.333828 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba16442-39ec-42d9-b453-1d1a7f9f4357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:05.335262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba16442-39ec-42d9-b453-1d1a7f9f4357 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:05.335471 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba16442-39ec-42d9-b453-1d1a7f9f4357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:05.335941 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba16442-39ec-42d9-b453-1d1a7f9f4357 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:05.337275 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba16442-39ec-42d9-b453-1d1a7f9f4357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:05.341150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba16442-39ec-42d9-b453-1d1a7f9f4357 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:05.402194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-cd0325c5-5514-4ed5-b29d-a7f339240780 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd2a38ee6c1749129cab44f85a52a2dd', 'request_id': 'req-cd0325c5-5514-4ed5-b29d-a7f339240780'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:05.407279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 917/1878] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:05 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:05.407279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba16442-39ec-42d9-b453-1d1a7f9f4357 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:05.410436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4ba16442-39ec-42d9-b453-1d1a7f9f4357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:05.415095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-cd0325c5-5514-4ed5-b29d-a7f339240780 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd2a38ee6c1749129cab44f85a52a2dd', 'request_id': 'req-cd0325c5-5514-4ed5-b29d-a7f339240780'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:05.429677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-cd0325c5-5514-4ed5-b29d-a7f339240780 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd2a38ee6c1749129cab44f85a52a2dd', 'request_id': 'req-cd0325c5-5514-4ed5-b29d-a7f339240780'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:05.447534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-cd0325c5-5514-4ed5-b29d-a7f339240780 admin admin] The token cache is being invalidate because project dd2a38ee6c1749129cab44f85a52a2dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:05.447994 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-cd0325c5-5514-4ed5-b29d-a7f339240780 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:05.449274 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-cd0325c5-5514-4ed5-b29d-a7f339240780 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:05.452145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 962/1879] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:05 2022] DELETE /identity/v3/projects/dd2a38ee6c1749129cab44f85a52a2dd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:05.453858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0325c5-5514-4ed5-b29d-a7f339240780 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:05.456204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-cd0325c5-5514-4ed5-b29d-a7f339240780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:05.559720 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba16442-39ec-42d9-b453-1d1a7f9f4357 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:05.564402 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0325c5-5514-4ed5-b29d-a7f339240780 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:05.566774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4d415-c0ab-4cd8-962a-f80f4e4de3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:05.568450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4d415-c0ab-4cd8-962a-f80f4e4de3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:05.568924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4d415-c0ab-4cd8-962a-f80f4e4de3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:05.570147 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4d415-c0ab-4cd8-962a-f80f4e4de3a8 admin admin] PATH_INFO: `/v3/users/04ad045d8e4343f7b8512ff3e87b1de2` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:05.571724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4d415-c0ab-4cd8-962a-f80f4e4de3a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ad045d8e4343f7b8512ff3e87b1de2)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:05.575374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4d415-c0ab-4cd8-962a-f80f4e4de3a8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:05.647776 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bac4d415-c0ab-4cd8-962a-f80f4e4de3a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ad045d8e4343f7b8512ff3e87b1de2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:05.648688 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bac4d415-c0ab-4cd8-962a-f80f4e4de3a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ad045d8e4343f7b8512ff3e87b1de2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:05.652928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6926db2-fc1a-433f-bb67-a420dcd38287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:05.653631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6926db2-fc1a-433f-bb67-a420dcd38287 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:05.653952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6926db2-fc1a-433f-bb67-a420dcd38287 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:05.654274 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6926db2-fc1a-433f-bb67-a420dcd38287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:05.656665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e6926db2-fc1a-433f-bb67-a420dcd38287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:05.658857 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bac4d415-c0ab-4cd8-962a-f80f4e4de3a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ad045d8e4343f7b8512ff3e87b1de2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:05.672744 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6926db2-fc1a-433f-bb67-a420dcd38287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:05.674675 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6926db2-fc1a-433f-bb67-a420dcd38287 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:05.675176 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bac4d415-c0ab-4cd8-962a-f80f4e4de3a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ad045d8e4343f7b8512ff3e87b1de2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:05.681262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:05.687484 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bac4d415-c0ab-4cd8-962a-f80f4e4de3a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ad045d8e4343f7b8512ff3e87b1de2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:05.689813 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 963/1880] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:05.690695 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6926db2-fc1a-433f-bb67-a420dcd38287 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:05.692422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e6926db2-fc1a-433f-bb67-a420dcd38287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:05.707999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 918/1881] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:05 2022] DELETE /identity/v3/users/04ad045d8e4343f7b8512ff3e87b1de2 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:05.712967 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4d415-c0ab-4cd8-962a-f80f4e4de3a8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:05.712967 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-bac4d415-c0ab-4cd8-962a-f80f4e4de3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:05.713532 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6926db2-fc1a-433f-bb67-a420dcd38287 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:05.755837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:05.877920 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074cd67-953f-4275-b8cf-54a1e420e6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:05.881933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074cd67-953f-4275-b8cf-54a1e420e6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:05.881933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074cd67-953f-4275-b8cf-54a1e420e6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:05.881933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074cd67-953f-4275-b8cf-54a1e420e6f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:05.883597 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4d415-c0ab-4cd8-962a-f80f4e4de3a8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:05.906190 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0c40e-0afe-49a8-b2e2-96e98708fc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:05.907403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074cd67-953f-4275-b8cf-54a1e420e6f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:05.908641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0c40e-0afe-49a8-b2e2-96e98708fc3f admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:05.908941 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0c40e-0afe-49a8-b2e2-96e98708fc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:05.925068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0c40e-0afe-49a8-b2e2-96e98708fc3f admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:05.928037 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0c40e-0afe-49a8-b2e2-96e98708fc3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:05.931513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0c40e-0afe-49a8-b2e2-96e98708fc3f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:05.938870 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074cd67-953f-4275-b8cf-54a1e420e6f3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:06.025767 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 919/1882] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:05 2022] POST /identity/v3/users => generated 291 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:06.032495 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4aaf26-8dae-476b-951e-31dc215b5443 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:06.035414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4aaf26-8dae-476b-951e-31dc215b5443 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:06.036990 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4aaf26-8dae-476b-951e-31dc215b5443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:06.066783 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 964/1883] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:05 2022] POST /identity/v3/projects => generated 381 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:06.072984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074cd67-953f-4275-b8cf-54a1e420e6f3 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:06.097546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ba4aaf26-8dae-476b-951e-31dc215b5443 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:06.100938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ba4aaf26-8dae-476b-951e-31dc215b5443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:06.324356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074cd67-953f-4275-b8cf-54a1e420e6f3 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:06.338760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192d3cf-96ca-4cc3-8600-49473a62dc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:06.342662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192d3cf-96ca-4cc3-8600-49473a62dc80 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:06.344958 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192d3cf-96ca-4cc3-8600-49473a62dc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:06.345833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192d3cf-96ca-4cc3-8600-49473a62dc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:06.349091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192d3cf-96ca-4cc3-8600-49473a62dc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:06.354529 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192d3cf-96ca-4cc3-8600-49473a62dc80 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:06.356133 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 920/1884] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:06.358766 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4aaf26-8dae-476b-951e-31dc215b5443 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:06.382514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 965/1885] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:06.384851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4aaf26-8dae-476b-951e-31dc215b5443 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:06.386451 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f9235-05c4-41fc-add0-29962d680ab3 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:06.387325 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f9235-05c4-41fc-add0-29962d680ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:06.388398 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f9235-05c4-41fc-add0-29962d680ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:06.396108 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874265f6-9bda-4dbe-af1d-d62a8e1ca1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:06.397196 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874265f6-9bda-4dbe-af1d-d62a8e1ca1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:06.397671 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874265f6-9bda-4dbe-af1d-d62a8e1ca1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:06.398774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874265f6-9bda-4dbe-af1d-d62a8e1ca1a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:06.399323 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874265f6-9bda-4dbe-af1d-d62a8e1ca1a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:06.403436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874265f6-9bda-4dbe-af1d-d62a8e1ca1a0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:06.429091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-dd0f9235-05c4-41fc-add0-29962d680ab3 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:06.432427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-dd0f9235-05c4-41fc-add0-29962d680ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:06.455910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 921/1887] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:06 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:06.456189 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 966/1887] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:06.457956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874265f6-9bda-4dbe-af1d-d62a8e1ca1a0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:06.465721 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f9235-05c4-41fc-add0-29962d680ab3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:06.479387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874265f6-9bda-4dbe-af1d-d62a8e1ca1a0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:06.492865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06afe1-87d9-49a4-b22d-cf1527ebff2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:06.494002 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06afe1-87d9-49a4-b22d-cf1527ebff2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:06.494701 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06afe1-87d9-49a4-b22d-cf1527ebff2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:06.495700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06afe1-87d9-49a4-b22d-cf1527ebff2f admin admin] PATH_INFO: `/v3/projects/799ca87ff14d492099f2fb3a9ac733e4/users/ac00cb9a28774e2d988bf7c1d019fc9d/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:06.505683 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f9235-05c4-41fc-add0-29962d680ab3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:06.517152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e2d7f-9c60-4e44-b7c2-5a9a7ac7b5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:06.519080 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e2d7f-9c60-4e44-b7c2-5a9a7ac7b5ac admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:06.520971 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e2d7f-9c60-4e44-b7c2-5a9a7ac7b5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:06.522175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e2d7f-9c60-4e44-b7c2-5a9a7ac7b5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:06.523926 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e2d7f-9c60-4e44-b7c2-5a9a7ac7b5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:06.529316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e2d7f-9c60-4e44-b7c2-5a9a7ac7b5ac admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:06.536042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06afe1-87d9-49a4-b22d-cf1527ebff2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=799ca87ff14d492099f2fb3a9ac733e4, user_id=ac00cb9a28774e2d988bf7c1d019fc9d, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:06.553973 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06afe1-87d9-49a4-b22d-cf1527ebff2f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:06.556558 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 967/1888] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:06.565640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e2d7f-9c60-4e44-b7c2-5a9a7ac7b5ac admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:06.581141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e2d7f-9c60-4e44-b7c2-5a9a7ac7b5ac admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:06.603161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 922/1889] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:06 2022] PUT /identity/v3/projects/799ca87ff14d492099f2fb3a9ac733e4/users/ac00cb9a28774e2d988bf7c1d019fc9d/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:06.605719 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06afe1-87d9-49a4-b22d-cf1527ebff2f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:06.667559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205e89-be69-4a72-b49d-4bddd1176164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:06.669353 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205e89-be69-4a72-b49d-4bddd1176164 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:06.669861 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205e89-be69-4a72-b49d-4bddd1176164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:06.670375 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205e89-be69-4a72-b49d-4bddd1176164 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:06.671356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82205e89-be69-4a72-b49d-4bddd1176164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:06.671879 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82205e89-be69-4a72-b49d-4bddd1176164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:06.673779 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82205e89-be69-4a72-b49d-4bddd1176164 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:06.692056 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 968/1890] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:06.693671 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205e89-be69-4a72-b49d-4bddd1176164 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:06.706625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205e89-be69-4a72-b49d-4bddd1176164 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:06.713464 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b2080-cee4-4a28-87d7-a421ab4ee83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:06.714844 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b2080-cee4-4a28-87d7-a421ab4ee83d admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:06.715420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b2080-cee4-4a28-87d7-a421ab4ee83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:06.715881 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b2080-cee4-4a28-87d7-a421ab4ee83d admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:06.716804 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b2080-cee4-4a28-87d7-a421ab4ee83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:06.719327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b2080-cee4-4a28-87d7-a421ab4ee83d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:06.732046 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:06.738121 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 969/1891] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:06.739139 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b2080-cee4-4a28-87d7-a421ab4ee83d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:06.752220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b2080-cee4-4a28-87d7-a421ab4ee83d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:06.759080 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce8f01-def7-4be7-b1e3-5d208b628f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:06.759746 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce8f01-def7-4be7-b1e3-5d208b628f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:06.760032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce8f01-def7-4be7-b1e3-5d208b628f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:06.760348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce8f01-def7-4be7-b1e3-5d208b628f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:06.761042 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce8f01-def7-4be7-b1e3-5d208b628f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:06.763406 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce8f01-def7-4be7-b1e3-5d208b628f22 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:06.792328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:06.798416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06afe1-87d9-49a4-b22d-cf1527ebff2f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:06.809662 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aaf802-1af3-4460-b26f-9fd6e15c4269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:06.810987 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf802-1af3-4460-b26f-9fd6e15c4269 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:06.811469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf802-1af3-4460-b26f-9fd6e15c4269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:06.811746 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf802-1af3-4460-b26f-9fd6e15c4269 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:06.812730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aaf802-1af3-4460-b26f-9fd6e15c4269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:06.824079 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aaf802-1af3-4460-b26f-9fd6e15c4269 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:06.844517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 970/1892] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:06 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:06.845950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce8f01-def7-4be7-b1e3-5d208b628f22 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:06.864473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 923/1893] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:06.866024 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aaf802-1af3-4460-b26f-9fd6e15c4269 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:06.904881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aaf802-1af3-4460-b26f-9fd6e15c4269 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:06.951356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce8f01-def7-4be7-b1e3-5d208b628f22 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:06.957875 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b43c70-768d-4ae5-af0e-518f50e9e32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:06.958854 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b43c70-768d-4ae5-af0e-518f50e9e32f admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:06.959849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b43c70-768d-4ae5-af0e-518f50e9e32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:06.959849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b43c70-768d-4ae5-af0e-518f50e9e32f admin admin] PATH_INFO: `/v3/projects/799ca87ff14d492099f2fb3a9ac733e4/users/ac00cb9a28774e2d988bf7c1d019fc9d/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:06.962666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b43c70-768d-4ae5-af0e-518f50e9e32f admin admin] RBAC: Authorizing `identity:create_grant(project_id=799ca87ff14d492099f2fb3a9ac733e4, user_id=ac00cb9a28774e2d988bf7c1d019fc9d, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:06.965993 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b43c70-768d-4ae5-af0e-518f50e9e32f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:06.983364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 971/1894] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:06 2022] PUT /identity/v3/projects/799ca87ff14d492099f2fb3a9ac733e4/users/ac00cb9a28774e2d988bf7c1d019fc9d/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:06.984852 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b43c70-768d-4ae5-af0e-518f50e9e32f admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:06.995395 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-84b43c70-768d-4ae5-af0e-518f50e9e32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:07.070148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a94aa-c9a9-42d7-89dc-dcfb51ee3299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:07.070941 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a94aa-c9a9-42d7-89dc-dcfb51ee3299 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:07.071557 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a94aa-c9a9-42d7-89dc-dcfb51ee3299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:07.072051 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a94aa-c9a9-42d7-89dc-dcfb51ee3299 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:07.072932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a94aa-c9a9-42d7-89dc-dcfb51ee3299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:07.075464 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a94aa-c9a9-42d7-89dc-dcfb51ee3299 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:07.108207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 924/1895] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:06 2022] POST /identity/v3/users => generated 290 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:07.109243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a94aa-c9a9-42d7-89dc-dcfb51ee3299 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:07.124706 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a94aa-c9a9-42d7-89dc-dcfb51ee3299 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:07.130213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b43c70-768d-4ae5-af0e-518f50e9e32f admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:07.132606 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b75cf-930c-431a-8df9-d696c6485635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:07.133400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b75cf-930c-431a-8df9-d696c6485635 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:07.134076 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b75cf-930c-431a-8df9-d696c6485635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:07.134578 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b75cf-930c-431a-8df9-d696c6485635 admin admin] PATH_INFO: `/v3/projects/448295eaf86a4a9098bcf064c6c128cd/users/c59b6e85c1164e12918248fa5dc6e78c/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:07.138813 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1552d-c3ed-467e-bce6-1e53c7374462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:07.139878 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1552d-c3ed-467e-bce6-1e53c7374462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:07.140338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1552d-c3ed-467e-bce6-1e53c7374462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:07.140793 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1552d-c3ed-467e-bce6-1e53c7374462 admin admin] PATH_INFO: `/v3/projects/f42ed03f60ad40b68766d09461ad5f35` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:07.142686 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1552d-c3ed-467e-bce6-1e53c7374462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f42ed03f60ad40b68766d09461ad5f35)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:07.146014 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1552d-c3ed-467e-bce6-1e53c7374462 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:07.154552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b75cf-930c-431a-8df9-d696c6485635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448295eaf86a4a9098bcf064c6c128cd, user_id=c59b6e85c1164e12918248fa5dc6e78c, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:07.158358 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b75cf-930c-431a-8df9-d696c6485635 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:07.183470 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 925/1896] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:07 2022] PUT /identity/v3/projects/448295eaf86a4a9098bcf064c6c128cd/users/c59b6e85c1164e12918248fa5dc6e78c/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:07.183470 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b75cf-930c-431a-8df9-d696c6485635 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:07.185877 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3a7b75cf-930c-431a-8df9-d696c6485635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:07.221721 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d1a1552d-c3ed-467e-bce6-1e53c7374462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f42ed03f60ad40b68766d09461ad5f35', 'request_id': 'req-d1a1552d-c3ed-467e-bce6-1e53c7374462'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:07.230825 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d1a1552d-c3ed-467e-bce6-1e53c7374462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f42ed03f60ad40b68766d09461ad5f35', 'request_id': 'req-d1a1552d-c3ed-467e-bce6-1e53c7374462'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:07.243936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d1a1552d-c3ed-467e-bce6-1e53c7374462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f42ed03f60ad40b68766d09461ad5f35', 'request_id': 'req-d1a1552d-c3ed-467e-bce6-1e53c7374462'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:07.263997 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d1a1552d-c3ed-467e-bce6-1e53c7374462 admin admin] The token cache is being invalidate because project f42ed03f60ad40b68766d09461ad5f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:07.264466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d1a1552d-c3ed-467e-bce6-1e53c7374462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:07.265354 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d1a1552d-c3ed-467e-bce6-1e53c7374462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:07.267585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 972/1897] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:06 2022] DELETE /identity/v3/projects/f42ed03f60ad40b68766d09461ad5f35 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:07.269267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161428b-1c7e-4ec4-82cf-d7d9e979b9bd None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:07.269852 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161428b-1c7e-4ec4-82cf-d7d9e979b9bd None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:07.270788 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161428b-1c7e-4ec4-82cf-d7d9e979b9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:07.285951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b75cf-930c-431a-8df9-d696c6485635 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:07.296698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:07.320882 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c161428b-1c7e-4ec4-82cf-d7d9e979b9bd None None] MFA Rules not processed for user `ac00cb9a28774e2d988bf7c1d019fc9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:07.324879 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c161428b-1c7e-4ec4-82cf-d7d9e979b9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:07.361343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:07.387460 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348f328-1481-4e97-9295-5fccd3442852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:07.389205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348f328-1481-4e97-9295-5fccd3442852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:07.389911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348f328-1481-4e97-9295-5fccd3442852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:07.390393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348f328-1481-4e97-9295-5fccd3442852 admin admin] PATH_INFO: `/v3/projects/627a2af3939749b5b13122a5e41af62d` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:07.392851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348f328-1481-4e97-9295-5fccd3442852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=627a2af3939749b5b13122a5e41af62d)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:07.398010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348f328-1481-4e97-9295-5fccd3442852 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:07.429344 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 973/1898] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:07.430523 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161428b-1c7e-4ec4-82cf-d7d9e979b9bd None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:07.432548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c161428b-1c7e-4ec4-82cf-d7d9e979b9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:07.452840 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161428b-1c7e-4ec4-82cf-d7d9e979b9bd None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:07.461238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcb720-8b9f-4f67-9414-0c90b7b3f5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:07.461973 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcb720-8b9f-4f67-9414-0c90b7b3f5cf admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:07.462180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcb720-8b9f-4f67-9414-0c90b7b3f5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:07.462661 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcb720-8b9f-4f67-9414-0c90b7b3f5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:07.463587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcb720-8b9f-4f67-9414-0c90b7b3f5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:07.465606 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcb720-8b9f-4f67-9414-0c90b7b3f5cf admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:07.483102 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 974/1899] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:07.483102 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be393e9-1a24-49e5-975b-46fc1424b152 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:07.483102 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be393e9-1a24-49e5-975b-46fc1424b152 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:07.483102 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be393e9-1a24-49e5-975b-46fc1424b152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:07.507633 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0348f328-1481-4e97-9295-5fccd3442852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '627a2af3939749b5b13122a5e41af62d', 'request_id': 'req-0348f328-1481-4e97-9295-5fccd3442852'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:07.525020 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0348f328-1481-4e97-9295-5fccd3442852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '627a2af3939749b5b13122a5e41af62d', 'request_id': 'req-0348f328-1481-4e97-9295-5fccd3442852'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:07.538244 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0348f328-1481-4e97-9295-5fccd3442852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '627a2af3939749b5b13122a5e41af62d', 'request_id': 'req-0348f328-1481-4e97-9295-5fccd3442852'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:07.561489 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7be393e9-1a24-49e5-975b-46fc1424b152 None None] MFA Rules not processed for user `c59b6e85c1164e12918248fa5dc6e78c`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:07.561757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0348f328-1481-4e97-9295-5fccd3442852 admin admin] The token cache is being invalidate because project 627a2af3939749b5b13122a5e41af62d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:07.562331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0348f328-1481-4e97-9295-5fccd3442852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:07.563652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7be393e9-1a24-49e5-975b-46fc1424b152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:07.563850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0348f328-1481-4e97-9295-5fccd3442852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:07.572861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 926/1900] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:07 2022] DELETE /identity/v3/projects/627a2af3939749b5b13122a5e41af62d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:07.572861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd033a-35cb-45c6-9d11-327531704988 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:07.572861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd033a-35cb-45c6-9d11-327531704988 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:07.572861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd033a-35cb-45c6-9d11-327531704988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:07.610446 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-17fd033a-35cb-45c6-9d11-327531704988 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:07.612907 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-17fd033a-35cb-45c6-9d11-327531704988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:07.761033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 975/1901] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:07.768060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be393e9-1a24-49e5-975b-46fc1424b152 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:07.771143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7be393e9-1a24-49e5-975b-46fc1424b152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:07.774407 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 927/1902] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:07.777271 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd033a-35cb-45c6-9d11-327531704988 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:07.780976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-17fd033a-35cb-45c6-9d11-327531704988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:07.812959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd033a-35cb-45c6-9d11-327531704988 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:07.824946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bd905-774c-4ba4-b2dc-9247ae837fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:07.825692 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bd905-774c-4ba4-b2dc-9247ae837fde admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:07.826053 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bd905-774c-4ba4-b2dc-9247ae837fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:07.826410 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bd905-774c-4ba4-b2dc-9247ae837fde admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:07.827244 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bd905-774c-4ba4-b2dc-9247ae837fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:07.829565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bd905-774c-4ba4-b2dc-9247ae837fde admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:07.859368 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 928/1903] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:07.859368 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bd905-774c-4ba4-b2dc-9247ae837fde admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:07.864845 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2d6bd905-774c-4ba4-b2dc-9247ae837fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:07.889292 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bd905-774c-4ba4-b2dc-9247ae837fde admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:07.893944 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be393e9-1a24-49e5-975b-46fc1424b152 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:07.898064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1716c61-cd8e-4407-82ca-28593b26648c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:07.899193 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1716c61-cd8e-4407-82ca-28593b26648c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:07.899692 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1716c61-cd8e-4407-82ca-28593b26648c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:07.900227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1716c61-cd8e-4407-82ca-28593b26648c admin admin] PATH_INFO: `/v3/users/7fb2f6fb3ced4a7fa55641ee761a5d94` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:07.900388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e33abf-c556-40c1-b68d-50a75d89ad7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:07.901038 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e33abf-c556-40c1-b68d-50a75d89ad7a service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:07.901582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e33abf-c556-40c1-b68d-50a75d89ad7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:07.901925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e33abf-c556-40c1-b68d-50a75d89ad7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:07.902810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1716c61-cd8e-4407-82ca-28593b26648c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb2f6fb3ced4a7fa55641ee761a5d94)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:07.903987 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-29e33abf-c556-40c1-b68d-50a75d89ad7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:07.906682 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1716c61-cd8e-4407-82ca-28593b26648c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:07.965259 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:08.048972 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f1716c61-cd8e-4407-82ca-28593b26648c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb2f6fb3ced4a7fa55641ee761a5d94'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:08.050150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f1716c61-cd8e-4407-82ca-28593b26648c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb2f6fb3ced4a7fa55641ee761a5d94'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:08.053948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e33abf-c556-40c1-b68d-50a75d89ad7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:08.055727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e33abf-c556-40c1-b68d-50a75d89ad7a service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:08.065831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f1716c61-cd8e-4407-82ca-28593b26648c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb2f6fb3ced4a7fa55641ee761a5d94'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:08.076595 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 976/1904] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:08.078427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e33abf-c556-40c1-b68d-50a75d89ad7a service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:08.080941 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-29e33abf-c556-40c1-b68d-50a75d89ad7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:08.086321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:08.100819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f1716c61-cd8e-4407-82ca-28593b26648c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb2f6fb3ced4a7fa55641ee761a5d94'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:08.119016 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f1716c61-cd8e-4407-82ca-28593b26648c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb2f6fb3ced4a7fa55641ee761a5d94'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:08.119307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e33abf-c556-40c1-b68d-50a75d89ad7a service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:08.132299 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a474a1-8115-4dd7-903d-b6979e709e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:08.133792 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a474a1-8115-4dd7-903d-b6979e709e75 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:08.135294 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a474a1-8115-4dd7-903d-b6979e709e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:08.135294 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a474a1-8115-4dd7-903d-b6979e709e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:08.139645 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 929/1905] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:07 2022] DELETE /identity/v3/users/7fb2f6fb3ced4a7fa55641ee761a5d94 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:08.143498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d4365-44ac-45ad-a3a2-e95ce8dbabfc None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:08.143498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d4365-44ac-45ad-a3a2-e95ce8dbabfc None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:08.143498 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d4365-44ac-45ad-a3a2-e95ce8dbabfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:08.169795 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a474a1-8115-4dd7-903d-b6979e709e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:08.180194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a474a1-8115-4dd7-903d-b6979e709e75 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:08.188254 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a16d4365-44ac-45ad-a3a2-e95ce8dbabfc None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:08.191038 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a16d4365-44ac-45ad-a3a2-e95ce8dbabfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:08.263677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 977/1906] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:08 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:08.265671 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a474a1-8115-4dd7-903d-b6979e709e75 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:08.283573 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-99a474a1-8115-4dd7-903d-b6979e709e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:08.331592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 930/1907] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:08.333287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d4365-44ac-45ad-a3a2-e95ce8dbabfc None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:08.337614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a16d4365-44ac-45ad-a3a2-e95ce8dbabfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:08.414284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a474a1-8115-4dd7-903d-b6979e709e75 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:08.420590 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c17f8-d790-44be-81a8-54802a2bc462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:08.421304 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c17f8-d790-44be-81a8-54802a2bc462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:08.422569 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c17f8-d790-44be-81a8-54802a2bc462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:08.422762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c17f8-d790-44be-81a8-54802a2bc462 admin admin] PATH_INFO: `/v3/projects/3df698c7a78f4084b3d6e90be7ac285f/users/169db502e9bd463c8423f74bc6e0818e/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:08.443734 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c17f8-d790-44be-81a8-54802a2bc462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df698c7a78f4084b3d6e90be7ac285f, user_id=169db502e9bd463c8423f74bc6e0818e, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:08.447648 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c17f8-d790-44be-81a8-54802a2bc462 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:08.459859 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d4365-44ac-45ad-a3a2-e95ce8dbabfc None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:08.466737 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 978/1908] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:08 2022] PUT /identity/v3/projects/3df698c7a78f4084b3d6e90be7ac285f/users/169db502e9bd463c8423f74bc6e0818e/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:08.467843 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c17f8-d790-44be-81a8-54802a2bc462 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:08.474027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1c7c17f8-d790-44be-81a8-54802a2bc462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:08.552105 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c84e36-4e44-4230-a0d0-6d1c37d393b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:08.553614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c84e36-4e44-4230-a0d0-6d1c37d393b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:08.553778 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c84e36-4e44-4230-a0d0-6d1c37d393b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:08.554264 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c84e36-4e44-4230-a0d0-6d1c37d393b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:08.557824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-28c84e36-4e44-4230-a0d0-6d1c37d393b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:08.576921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c17f8-d790-44be-81a8-54802a2bc462 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:08.583016 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62be05-538a-4934-8a91-126fb45d966b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:08.584058 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62be05-538a-4934-8a91-126fb45d966b admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:08.585091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62be05-538a-4934-8a91-126fb45d966b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:08.585091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62be05-538a-4934-8a91-126fb45d966b admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:08.585377 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62be05-538a-4934-8a91-126fb45d966b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:08.587324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62be05-538a-4934-8a91-126fb45d966b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:08.614715 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 979/1909] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:08 2022] POST /identity/v3/users => generated 296 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:08.615782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62be05-538a-4934-8a91-126fb45d966b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:08.628685 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62be05-538a-4934-8a91-126fb45d966b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:08.634469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d516dcf-bef5-448a-8458-065cd23b26fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:08.635585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d516dcf-bef5-448a-8458-065cd23b26fc admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:08.635875 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d516dcf-bef5-448a-8458-065cd23b26fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:08.636153 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d516dcf-bef5-448a-8458-065cd23b26fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:08.637777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d516dcf-bef5-448a-8458-065cd23b26fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:08.637777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d516dcf-bef5-448a-8458-065cd23b26fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:08.639039 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d516dcf-bef5-448a-8458-065cd23b26fc admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:08.659470 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 980/1910] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:08.662962 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662c030-4d39-41d4-b1bf-d59bf3dadc1f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:08.663495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662c030-4d39-41d4-b1bf-d59bf3dadc1f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:08.663905 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662c030-4d39-41d4-b1bf-d59bf3dadc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:08.673439 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:08.674149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:08.681442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c84e36-4e44-4230-a0d0-6d1c37d393b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:08.683879 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c84e36-4e44-4230-a0d0-6d1c37d393b0 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:08.701079 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 931/1911] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:08.702207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c84e36-4e44-4230-a0d0-6d1c37d393b0 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:08.725228 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c84e36-4e44-4230-a0d0-6d1c37d393b0 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:08.729924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f662c030-4d39-41d4-b1bf-d59bf3dadc1f None None] MFA Rules not processed for user `169db502e9bd463c8423f74bc6e0818e`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:08.731556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f662c030-4d39-41d4-b1bf-d59bf3dadc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:08.735583 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58424d7-4cdf-4261-a9d5-070306f5a0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:08.738279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58424d7-4cdf-4261-a9d5-070306f5a0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:08.740401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58424d7-4cdf-4261-a9d5-070306f5a0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:08.740905 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58424d7-4cdf-4261-a9d5-070306f5a0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:08.742555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58424d7-4cdf-4261-a9d5-070306f5a0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:08.747012 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58424d7-4cdf-4261-a9d5-070306f5a0a9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:08.778208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 932/1912] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:08.779964 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58424d7-4cdf-4261-a9d5-070306f5a0a9 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:08.806711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58424d7-4cdf-4261-a9d5-070306f5a0a9 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:08.827344 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 981/1913] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:08.827344 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662c030-4d39-41d4-b1bf-d59bf3dadc1f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:08.827344 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f662c030-4d39-41d4-b1bf-d59bf3dadc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:08.828451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a20d6-01ae-48e2-be5a-2dee1d46eb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:08.829131 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a20d6-01ae-48e2-be5a-2dee1d46eb09 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:08.830454 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a20d6-01ae-48e2-be5a-2dee1d46eb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:08.831022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a20d6-01ae-48e2-be5a-2dee1d46eb09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:08.833292 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a20d6-01ae-48e2-be5a-2dee1d46eb09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:08.839077 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a20d6-01ae-48e2-be5a-2dee1d46eb09 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:08.844045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662c030-4d39-41d4-b1bf-d59bf3dadc1f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:08.850020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85189a1d-9e6c-4e94-9892-d49831a00622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:08.850778 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85189a1d-9e6c-4e94-9892-d49831a00622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:08.851138 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85189a1d-9e6c-4e94-9892-d49831a00622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:08.851496 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85189a1d-9e6c-4e94-9892-d49831a00622 admin admin] PATH_INFO: `/v3/projects/2d9d94bad6054e71bca9da2c3ea630dd` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:08.853035 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85189a1d-9e6c-4e94-9892-d49831a00622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d9d94bad6054e71bca9da2c3ea630dd)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:08.856823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85189a1d-9e6c-4e94-9892-d49831a00622 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:08.893480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 933/1914] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:08 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:08.895562 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a20d6-01ae-48e2-be5a-2dee1d46eb09 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:08.930683 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-85189a1d-9e6c-4e94-9892-d49831a00622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9d94bad6054e71bca9da2c3ea630dd', 'request_id': 'req-85189a1d-9e6c-4e94-9892-d49831a00622'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:08.941170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-85189a1d-9e6c-4e94-9892-d49831a00622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9d94bad6054e71bca9da2c3ea630dd', 'request_id': 'req-85189a1d-9e6c-4e94-9892-d49831a00622'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:08.957836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-85189a1d-9e6c-4e94-9892-d49831a00622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9d94bad6054e71bca9da2c3ea630dd', 'request_id': 'req-85189a1d-9e6c-4e94-9892-d49831a00622'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:08.986754 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-85189a1d-9e6c-4e94-9892-d49831a00622 admin admin] The token cache is being invalidate because project 2d9d94bad6054e71bca9da2c3ea630dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:08.987387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-85189a1d-9e6c-4e94-9892-d49831a00622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:08.988375 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-85189a1d-9e6c-4e94-9892-d49831a00622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:08.993659 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 982/1915] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:08 2022] DELETE /identity/v3/projects/2d9d94bad6054e71bca9da2c3ea630dd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:08.998377 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85189a1d-9e6c-4e94-9892-d49831a00622 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:09.000033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-85189a1d-9e6c-4e94-9892-d49831a00622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:09.034222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a20d6-01ae-48e2-be5a-2dee1d46eb09 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:09.125470 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85189a1d-9e6c-4e94-9892-d49831a00622 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:09.146447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3b522-037a-46e4-9f34-abe039922269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:09.147317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3b522-037a-46e4-9f34-abe039922269 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:09.147497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3b522-037a-46e4-9f34-abe039922269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:09.147687 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3b522-037a-46e4-9f34-abe039922269 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:09.148873 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3b522-037a-46e4-9f34-abe039922269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:09.150347 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3b522-037a-46e4-9f34-abe039922269 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:09.183197 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa59467-d3a2-4633-9c8a-7912e4ad8952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:09.183918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa59467-d3a2-4633-9c8a-7912e4ad8952 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:09.184240 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa59467-d3a2-4633-9c8a-7912e4ad8952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:09.184531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa59467-d3a2-4633-9c8a-7912e4ad8952 admin admin] PATH_INFO: `/v3/projects/0fb19f622740458d906f564413e56170/users/c258f7a4094d4a0ca633a4f101e81c74/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:09.197840 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:09.203793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa59467-d3a2-4633-9c8a-7912e4ad8952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb19f622740458d906f564413e56170, user_id=c258f7a4094d4a0ca633a4f101e81c74, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:09.206625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa59467-d3a2-4633-9c8a-7912e4ad8952 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:09.235129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 983/1916] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:08 2022] POST /identity/v3/projects => generated 377 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:09.236974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3b522-037a-46e4-9f34-abe039922269 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:09.242136 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b0f3b522-037a-46e4-9f34-abe039922269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:09.263042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 934/1917] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:08 2022] PUT /identity/v3/projects/0fb19f622740458d906f564413e56170/users/c258f7a4094d4a0ca633a4f101e81c74/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:09.273272 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56b53f-f512-49e3-8bdb-2c8a63ee14dc None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:09.273575 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56b53f-f512-49e3-8bdb-2c8a63ee14dc None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:09.273872 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56b53f-f512-49e3-8bdb-2c8a63ee14dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:09.336201 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ee56b53f-f512-49e3-8bdb-2c8a63ee14dc None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:09.343828 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ee56b53f-f512-49e3-8bdb-2c8a63ee14dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:09.472256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:09.501462 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 935/1918] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:09.503106 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56b53f-f512-49e3-8bdb-2c8a63ee14dc None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:09.525178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56b53f-f512-49e3-8bdb-2c8a63ee14dc None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:09.525382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3b522-037a-46e4-9f34-abe039922269 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:09.533335 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bf1cb-c9c4-4237-afa1-e036c3afdf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:09.535070 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83636a14-ec4e-429a-bf63-d95db43ab66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:09.535658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bf1cb-c9c4-4237-afa1-e036c3afdf31 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:09.535658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bf1cb-c9c4-4237-afa1-e036c3afdf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:09.535976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83636a14-ec4e-429a-bf63-d95db43ab66c admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:09.536116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83636a14-ec4e-429a-bf63-d95db43ab66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:09.536283 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bf1cb-c9c4-4237-afa1-e036c3afdf31 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:09.536447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83636a14-ec4e-429a-bf63-d95db43ab66c admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:09.537082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83636a14-ec4e-429a-bf63-d95db43ab66c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:09.537968 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693bf1cb-c9c4-4237-afa1-e036c3afdf31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:09.539935 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693bf1cb-c9c4-4237-afa1-e036c3afdf31 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:09.550809 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83636a14-ec4e-429a-bf63-d95db43ab66c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:09.572834 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 984/1919] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:09 2022] POST /identity/v3/users => generated 282 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:09.576399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bf1cb-c9c4-4237-afa1-e036c3afdf31 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:09.576399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-693bf1cb-c9c4-4237-afa1-e036c3afdf31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:09.592436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bf1cb-c9c4-4237-afa1-e036c3afdf31 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:09.597419 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb45a93-e5cf-45c5-bad5-4994c937f554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:09.598323 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45a93-e5cf-45c5-bad5-4994c937f554 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:09.598675 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45a93-e5cf-45c5-bad5-4994c937f554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:09.598967 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45a93-e5cf-45c5-bad5-4994c937f554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:09.599696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb45a93-e5cf-45c5-bad5-4994c937f554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:09.601707 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 936/1920] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:09 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:09.602001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb45a93-e5cf-45c5-bad5-4994c937f554 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:09.604102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459d20b-7d3a-45a8-9608-7e8de2e11a48 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:09.604870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459d20b-7d3a-45a8-9608-7e8de2e11a48 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:09.605383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459d20b-7d3a-45a8-9608-7e8de2e11a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:09.616490 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 985/1921] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:09.617614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb45a93-e5cf-45c5-bad5-4994c937f554 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:09.638007 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb45a93-e5cf-45c5-bad5-4994c937f554 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:09.648367 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-2459d20b-7d3a-45a8-9608-7e8de2e11a48 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:09.649650 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2459d20b-7d3a-45a8-9608-7e8de2e11a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:09.654348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460b96c-f843-4747-a1a8-50df43f1a76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:09.657185 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460b96c-f843-4747-a1a8-50df43f1a76b admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:09.658552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460b96c-f843-4747-a1a8-50df43f1a76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:09.659422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460b96c-f843-4747-a1a8-50df43f1a76b admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:09.660147 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 937/1922] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:09.661249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460b96c-f843-4747-a1a8-50df43f1a76b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:09.663086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459d20b-7d3a-45a8-9608-7e8de2e11a48 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:09.664132 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460b96c-f843-4747-a1a8-50df43f1a76b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:09.681771 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459d20b-7d3a-45a8-9608-7e8de2e11a48 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:09.689838 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa056e8-07a8-427a-ad01-7ed0bc051d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:09.690849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa056e8-07a8-427a-ad01-7ed0bc051d10 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:09.691329 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa056e8-07a8-427a-ad01-7ed0bc051d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:09.691747 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa056e8-07a8-427a-ad01-7ed0bc051d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:09.692612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa056e8-07a8-427a-ad01-7ed0bc051d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:09.694351 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 986/1923] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:09.695584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460b96c-f843-4747-a1a8-50df43f1a76b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:09.697977 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa056e8-07a8-427a-ad01-7ed0bc051d10 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:09.711054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 938/1924] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:09.712116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa056e8-07a8-427a-ad01-7ed0bc051d10 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:09.722097 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460b96c-f843-4747-a1a8-50df43f1a76b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:09.727702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa056e8-07a8-427a-ad01-7ed0bc051d10 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:09.728968 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75d08c-80d5-4b16-9db7-677cf475e962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:09.729771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75d08c-80d5-4b16-9db7-677cf475e962 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:09.729992 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75d08c-80d5-4b16-9db7-677cf475e962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:09.730222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75d08c-80d5-4b16-9db7-677cf475e962 admin admin] PATH_INFO: `/v3/projects/0fb19f622740458d906f564413e56170/users/c258f7a4094d4a0ca633a4f101e81c74/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:09.732503 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75d08c-80d5-4b16-9db7-677cf475e962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb19f622740458d906f564413e56170, user_id=c258f7a4094d4a0ca633a4f101e81c74, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:09.734658 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8ca73-597e-4787-8236-f529dfcb5024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:09.735431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8ca73-597e-4787-8236-f529dfcb5024 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:09.735824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8ca73-597e-4787-8236-f529dfcb5024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:09.736274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8ca73-597e-4787-8236-f529dfcb5024 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:09.736468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75d08c-80d5-4b16-9db7-677cf475e962 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:09.737199 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8ca73-597e-4787-8236-f529dfcb5024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:09.737839 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8ca73-597e-4787-8236-f529dfcb5024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:09.739761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8ca73-597e-4787-8236-f529dfcb5024 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:09.762446 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 939/1925] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:09.762649 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 987/1926] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:09 2022] PUT /identity/v3/projects/0fb19f622740458d906f564413e56170/users/c258f7a4094d4a0ca633a4f101e81c74/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:09.764360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75d08c-80d5-4b16-9db7-677cf475e962 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:09.764589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8ca73-597e-4787-8236-f529dfcb5024 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:09.778802 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8ca73-597e-4787-8236-f529dfcb5024 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:09.887102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba06b5-beac-48d0-9a40-fb7231f8581e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:09.887794 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba06b5-beac-48d0-9a40-fb7231f8581e admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:09.888082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba06b5-beac-48d0-9a40-fb7231f8581e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:09.888469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba06b5-beac-48d0-9a40-fb7231f8581e admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:09.888892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75d08c-80d5-4b16-9db7-677cf475e962 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:09.889588 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba06b5-beac-48d0-9a40-fb7231f8581e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:09.890842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba06b5-beac-48d0-9a40-fb7231f8581e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:09.895219 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e090d-ce46-430b-a663-b4cc07d3a563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:09.896493 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e090d-ce46-430b-a663-b4cc07d3a563 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:09.896660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e090d-ce46-430b-a663-b4cc07d3a563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:09.896809 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e090d-ce46-430b-a663-b4cc07d3a563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:09.897543 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e090d-ce46-430b-a663-b4cc07d3a563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:09.899291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e090d-ce46-430b-a663-b4cc07d3a563 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:09.912150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 940/1927] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:09.912913 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba06b5-beac-48d0-9a40-fb7231f8581e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:09.921404 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 988/1928] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:09.921404 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2e8fa-a10b-4e44-ac08-3f23ae390756 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:09.921404 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2e8fa-a10b-4e44-ac08-3f23ae390756 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:09.921404 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2e8fa-a10b-4e44-ac08-3f23ae390756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:09.932616 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba06b5-beac-48d0-9a40-fb7231f8581e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:09.941317 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef2eec-eb41-4231-9997-13af24aebbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:09.943575 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef2eec-eb41-4231-9997-13af24aebbe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:09.944065 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef2eec-eb41-4231-9997-13af24aebbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:09.944681 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef2eec-eb41-4231-9997-13af24aebbe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:09.945998 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef2eec-eb41-4231-9997-13af24aebbe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:09.950188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef2eec-eb41-4231-9997-13af24aebbe8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:09.971010 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f5c2e8fa-a10b-4e44-ac08-3f23ae390756 None None] MFA Rules not processed for user `c258f7a4094d4a0ca633a4f101e81c74`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:09.973317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f5c2e8fa-a10b-4e44-ac08-3f23ae390756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:10.029073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 941/1929] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:09 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:10.030411 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef2eec-eb41-4231-9997-13af24aebbe8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:10.085338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:10.155913 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 989/1930] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:09 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:10.157388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2e8fa-a10b-4e44-ac08-3f23ae390756 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:10.183366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2e8fa-a10b-4e44-ac08-3f23ae390756 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:10.205576 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef2eec-eb41-4231-9997-13af24aebbe8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:10.211450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8a020-741e-438f-9133-bbbc21a0b3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:10.212190 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8a020-741e-438f-9133-bbbc21a0b3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:10.212545 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8a020-741e-438f-9133-bbbc21a0b3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:10.212837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8a020-741e-438f-9133-bbbc21a0b3d6 admin admin] PATH_INFO: `/v3/projects/594f7f4f8de54d45bc47efc18373796f/users/7f64123f9504447dac406b995a5d09b8/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:10.231812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8a020-741e-438f-9133-bbbc21a0b3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=594f7f4f8de54d45bc47efc18373796f, user_id=7f64123f9504447dac406b995a5d09b8, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:10.235869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8a020-741e-438f-9133-bbbc21a0b3d6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:10.268424 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 942/1931] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:10 2022] PUT /identity/v3/projects/594f7f4f8de54d45bc47efc18373796f/users/7f64123f9504447dac406b995a5d09b8/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:10.269747 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8a020-741e-438f-9133-bbbc21a0b3d6 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:10.282648 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:10.294505 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71af15e-5327-4926-b1b6-b47077910516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:10.295893 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71af15e-5327-4926-b1b6-b47077910516 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:10.296701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71af15e-5327-4926-b1b6-b47077910516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:10.297194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71af15e-5327-4926-b1b6-b47077910516 admin admin] PATH_INFO: `/v3/projects/8ed4838014ff4bce98e02d8f85d771ea/users/5b6d4676048d4ddf9136ca13a8e8a4f7/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:10.322640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71af15e-5327-4926-b1b6-b47077910516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed4838014ff4bce98e02d8f85d771ea, user_id=5b6d4676048d4ddf9136ca13a8e8a4f7, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:10.326119 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71af15e-5327-4926-b1b6-b47077910516 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:10.348847 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 990/1932] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:10 2022] PUT /identity/v3/projects/8ed4838014ff4bce98e02d8f85d771ea/users/5b6d4676048d4ddf9136ca13a8e8a4f7/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:10.349465 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71af15e-5327-4926-b1b6-b47077910516 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:10.354601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e71af15e-5327-4926-b1b6-b47077910516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:10.443237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8a020-741e-438f-9133-bbbc21a0b3d6 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:10.476685 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71af15e-5327-4926-b1b6-b47077910516 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:10.484420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdc973-479c-41e3-9474-8c012a939d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:10.485545 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdc973-479c-41e3-9474-8c012a939d60 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:10.486043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdc973-479c-41e3-9474-8c012a939d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:10.486530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdc973-479c-41e3-9474-8c012a939d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:10.589057 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a4d96-4b3a-4c9d-942f-6dfd4941daad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:10.591325 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4d96-4b3a-4c9d-942f-6dfd4941daad admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:10.591788 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4d96-4b3a-4c9d-942f-6dfd4941daad admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:10.592371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a4d96-4b3a-4c9d-942f-6dfd4941daad admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:10.593858 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a4d96-4b3a-4c9d-942f-6dfd4941daad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:10.595986 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a4d96-4b3a-4c9d-942f-6dfd4941daad admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:10.647689 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 943/1933] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:10 2022] POST /identity/v3/users => generated 294 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:10.651564 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f9274-4119-4946-8c57-208da19cd85d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:10.657398 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f9274-4119-4946-8c57-208da19cd85d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:10.657991 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f9274-4119-4946-8c57-208da19cd85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:10.751660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdc973-479c-41e3-9474-8c012a939d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:10.756160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdc973-479c-41e3-9474-8c012a939d60 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:10.767110 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d63f9274-4119-4946-8c57-208da19cd85d None None] MFA Rules not processed for user `7f64123f9504447dac406b995a5d09b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:10.769902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d63f9274-4119-4946-8c57-208da19cd85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:10.799626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 991/1934] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:10.820585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4da2e6-7d6b-43c8-a917-299f0311454f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:10.821081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4da2e6-7d6b-43c8-a917-299f0311454f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:10.823706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4da2e6-7d6b-43c8-a917-299f0311454f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:10.909336 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:10.937324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-ea4da2e6-7d6b-43c8-a917-299f0311454f None None] MFA Rules not processed for user `5b6d4676048d4ddf9136ca13a8e8a4f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:10.939662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ea4da2e6-7d6b-43c8-a917-299f0311454f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:11.073984 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 944/1935] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:11.075650 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f9274-4119-4946-8c57-208da19cd85d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:11.115218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f9274-4119-4946-8c57-208da19cd85d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:11.134972 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4405d-5fd9-432b-83d1-07ff7fe6df3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:11.135983 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4405d-5fd9-432b-83d1-07ff7fe6df3f admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:11.138003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4405d-5fd9-432b-83d1-07ff7fe6df3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:11.138505 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4405d-5fd9-432b-83d1-07ff7fe6df3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:11.140049 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4405d-5fd9-432b-83d1-07ff7fe6df3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:11.147535 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4405d-5fd9-432b-83d1-07ff7fe6df3f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:11.168924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 992/1936] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:11.170381 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4da2e6-7d6b-43c8-a917-299f0311454f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:11.187910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4da2e6-7d6b-43c8-a917-299f0311454f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:11.198128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 945/1937] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:11.198128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4405d-5fd9-432b-83d1-07ff7fe6df3f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:11.209618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3d291-d5b0-4bf1-b0d9-17e1b016f67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:11.209618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3d291-d5b0-4bf1-b0d9-17e1b016f67b admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:11.209618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3d291-d5b0-4bf1-b0d9-17e1b016f67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:11.209618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3d291-d5b0-4bf1-b0d9-17e1b016f67b admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:11.211378 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3d291-d5b0-4bf1-b0d9-17e1b016f67b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:11.212550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3d291-d5b0-4bf1-b0d9-17e1b016f67b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:11.225890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4405d-5fd9-432b-83d1-07ff7fe6df3f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:11.236582 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd0ad9-7e38-4e78-841d-7b78b6f46a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:11.237443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd0ad9-7e38-4e78-841d-7b78b6f46a16 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:11.237893 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd0ad9-7e38-4e78-841d-7b78b6f46a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:11.238345 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd0ad9-7e38-4e78-841d-7b78b6f46a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:11.239616 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd0ad9-7e38-4e78-841d-7b78b6f46a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:11.243611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd0ad9-7e38-4e78-841d-7b78b6f46a16 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:11.276071 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:11.280467 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 993/1938] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:11 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:11.284606 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3d291-d5b0-4bf1-b0d9-17e1b016f67b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:11.306196 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 946/1939] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:11 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:11.307047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd0ad9-7e38-4e78-841d-7b78b6f46a16 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:11.438592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd0ad9-7e38-4e78-841d-7b78b6f46a16 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:11.458804 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3d291-d5b0-4bf1-b0d9-17e1b016f67b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:11.464228 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe900202-3acf-4c50-9e08-965f3ee3e747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:11.465903 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe900202-3acf-4c50-9e08-965f3ee3e747 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:11.466746 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe900202-3acf-4c50-9e08-965f3ee3e747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:11.467369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe900202-3acf-4c50-9e08-965f3ee3e747 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:11.469012 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe900202-3acf-4c50-9e08-965f3ee3e747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:11.471816 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62fac5-975f-4907-bb42-925cb4eb6f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:11.472674 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62fac5-975f-4907-bb42-925cb4eb6f8b admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:11.475344 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe900202-3acf-4c50-9e08-965f3ee3e747 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:11.475608 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62fac5-975f-4907-bb42-925cb4eb6f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:11.475964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62fac5-975f-4907-bb42-925cb4eb6f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:11.484358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62fac5-975f-4907-bb42-925cb4eb6f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:11.488458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62fac5-975f-4907-bb42-925cb4eb6f8b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:11.507664 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 994/1940] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:11.508438 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62fac5-975f-4907-bb42-925cb4eb6f8b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:11.528110 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62fac5-975f-4907-bb42-925cb4eb6f8b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:11.528495 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 947/1941] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:11 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:11.528495 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe900202-3acf-4c50-9e08-965f3ee3e747 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:11.537571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f5e5f-82d1-4600-bc6f-e01a01963846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:11.541238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f5e5f-82d1-4600-bc6f-e01a01963846 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:11.541854 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f5e5f-82d1-4600-bc6f-e01a01963846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:11.543269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe900202-3acf-4c50-9e08-965f3ee3e747 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:11.544591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f5e5f-82d1-4600-bc6f-e01a01963846 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:11.547918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f5e5f-82d1-4600-bc6f-e01a01963846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:11.559128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354b088-f249-467b-8012-e7999987b7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:11.560272 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354b088-f249-467b-8012-e7999987b7d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:11.562699 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354b088-f249-467b-8012-e7999987b7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:11.563111 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354b088-f249-467b-8012-e7999987b7d5 admin admin] PATH_INFO: `/v3/projects/a372f06c5396477b9f07a908a60636c4/users/0dd37feb6a4b4a28b6569fc7a33d35ba/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:11.572253 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f5e5f-82d1-4600-bc6f-e01a01963846 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:11.628255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354b088-f249-467b-8012-e7999987b7d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a372f06c5396477b9f07a908a60636c4, user_id=0dd37feb6a4b4a28b6569fc7a33d35ba, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:11.639596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354b088-f249-467b-8012-e7999987b7d5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:11.646695 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 995/1942] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:11 2022] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:11.646695 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f5e5f-82d1-4600-bc6f-e01a01963846 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:11.657955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f5e5f-82d1-4600-bc6f-e01a01963846 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:11.665478 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fdad0-b2f0-4d31-8df3-82b069d3917c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:11.666843 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fdad0-b2f0-4d31-8df3-82b069d3917c admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:11.667031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fdad0-b2f0-4d31-8df3-82b069d3917c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:11.667253 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fdad0-b2f0-4d31-8df3-82b069d3917c admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:11.668404 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fdad0-b2f0-4d31-8df3-82b069d3917c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:11.672030 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fdad0-b2f0-4d31-8df3-82b069d3917c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:11.677242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 948/1943] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:11 2022] PUT /identity/v3/projects/a372f06c5396477b9f07a908a60636c4/users/0dd37feb6a4b4a28b6569fc7a33d35ba/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:11.679984 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354b088-f249-467b-8012-e7999987b7d5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:11.701958 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 996/1944] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:11.710462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e810de-8eb8-4724-9f42-391f432f7c61 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:11.710784 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e810de-8eb8-4724-9f42-391f432f7c61 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:11.711102 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e810de-8eb8-4724-9f42-391f432f7c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:11.809204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c1e810de-8eb8-4724-9f42-391f432f7c61 None None] MFA Rules not processed for user `0dd37feb6a4b4a28b6569fc7a33d35ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:11.809379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354b088-f249-467b-8012-e7999987b7d5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:11.822413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91623aba-819a-4bf9-97fc-ff14ed1803ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:11.822413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91623aba-819a-4bf9-97fc-ff14ed1803ff admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:11.822413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91623aba-819a-4bf9-97fc-ff14ed1803ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:11.822413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91623aba-819a-4bf9-97fc-ff14ed1803ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:11.823108 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91623aba-819a-4bf9-97fc-ff14ed1803ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:11.823108 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91623aba-819a-4bf9-97fc-ff14ed1803ff admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:11.825010 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c1e810de-8eb8-4724-9f42-391f432f7c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:11.853960 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 949/1945] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:11.855060 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91623aba-819a-4bf9-97fc-ff14ed1803ff admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:11.892887 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91623aba-819a-4bf9-97fc-ff14ed1803ff admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:11.906045 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c33c76-547e-43a2-8a8f-8a0b547f719e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:11.907363 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c33c76-547e-43a2-8a8f-8a0b547f719e admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:11.922471 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c33c76-547e-43a2-8a8f-8a0b547f719e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:11.923327 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c33c76-547e-43a2-8a8f-8a0b547f719e admin admin] PATH_INFO: `/v3/projects/13f1dbb0cebe4a5d84a9b7560a8690b5/users/11c6005ae7fc4fd085985c6a8cadd46f/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:11.937127 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:11.963941 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c33c76-547e-43a2-8a8f-8a0b547f719e admin admin] RBAC: Authorizing `identity:create_grant(project_id=13f1dbb0cebe4a5d84a9b7560a8690b5, user_id=11c6005ae7fc4fd085985c6a8cadd46f, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:11.967718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c33c76-547e-43a2-8a8f-8a0b547f719e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:11.986278 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 997/1946] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:11.986278 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e810de-8eb8-4724-9f42-391f432f7c61 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:11.990846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 950/1947] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:11 2022] PUT /identity/v3/projects/13f1dbb0cebe4a5d84a9b7560a8690b5/users/11c6005ae7fc4fd085985c6a8cadd46f/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:11.992077 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c33c76-547e-43a2-8a8f-8a0b547f719e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:12.002966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e810de-8eb8-4724-9f42-391f432f7c61 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:12.042618 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:12.075582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70b75a-9ce7-4b4d-9052-27a6e87d3835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:12.076303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70b75a-9ce7-4b4d-9052-27a6e87d3835 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:12.076589 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70b75a-9ce7-4b4d-9052-27a6e87d3835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:12.076874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70b75a-9ce7-4b4d-9052-27a6e87d3835 admin admin] PATH_INFO: `/v3/projects/30dabb8449634f2888ccbb7b15b07f76/users/9d1f42f86a3f45ab8b186dba9e4c124a/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:12.082506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c33c76-547e-43a2-8a8f-8a0b547f719e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:12.087679 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e2f7b-abe3-44c3-bed8-d03c866f964c tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c258f7a4094d4a0ca633a4f101e81c74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fb19f622740458d906f564413e56170', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:12.088355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e2f7b-abe3-44c3-bed8-d03c866f964c tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:12.088653 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e2f7b-abe3-44c3-bed8-d03c866f964c tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:12.088935 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e2f7b-abe3-44c3-bed8-d03c866f964c tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:12.089658 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e2f7b-abe3-44c3-bed8-d03c866f964c tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:12.089978 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e2f7b-abe3-44c3-bed8-d03c866f964c tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:12.091613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e2f7b-abe3-44c3-bed8-d03c866f964c tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:12.097661 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70b75a-9ce7-4b4d-9052-27a6e87d3835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30dabb8449634f2888ccbb7b15b07f76, user_id=9d1f42f86a3f45ab8b186dba9e4c124a, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:12.101216 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70b75a-9ce7-4b4d-9052-27a6e87d3835 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:12.105206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 951/1948] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:12.109758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e2f7b-abe3-44c3-bed8-d03c866f964c tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:12.123784 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 998/1949] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:11 2022] PUT /identity/v3/projects/30dabb8449634f2888ccbb7b15b07f76/users/9d1f42f86a3f45ab8b186dba9e4c124a/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:12.125819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e2f7b-abe3-44c3-bed8-d03c866f964c tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:12.126049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70b75a-9ce7-4b4d-9052-27a6e87d3835 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:12.219808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87177b-dfbf-4feb-a119-3fa0c75dae64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:12.221213 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87177b-dfbf-4feb-a119-3fa0c75dae64 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:12.221810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87177b-dfbf-4feb-a119-3fa0c75dae64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:12.222443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87177b-dfbf-4feb-a119-3fa0c75dae64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:12.223971 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70b75a-9ce7-4b4d-9052-27a6e87d3835 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:12.224415 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87177b-dfbf-4feb-a119-3fa0c75dae64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:12.228097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87177b-dfbf-4feb-a119-3fa0c75dae64 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:12.230663 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f16e52-df5f-4e60-aa32-7e8ce03c7936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:12.231435 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f16e52-df5f-4e60-aa32-7e8ce03c7936 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:12.231828 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f16e52-df5f-4e60-aa32-7e8ce03c7936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:12.232245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f16e52-df5f-4e60-aa32-7e8ce03c7936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:12.233085 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f16e52-df5f-4e60-aa32-7e8ce03c7936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:12.234834 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f16e52-df5f-4e60-aa32-7e8ce03c7936 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:12.255563 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 999/1950] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:12.256560 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f16e52-df5f-4e60-aa32-7e8ce03c7936 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:12.291236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 952/1951] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:12 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:12.291236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87177b-dfbf-4feb-a119-3fa0c75dae64 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:12.366790 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:12.389117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f16e52-df5f-4e60-aa32-7e8ce03c7936 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:12.423924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87177b-dfbf-4feb-a119-3fa0c75dae64 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:12.430502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eee664-a189-432c-a4c7-b9efe846d4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:12.431019 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eee664-a189-432c-a4c7-b9efe846d4af admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:12.431310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eee664-a189-432c-a4c7-b9efe846d4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:12.431608 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eee664-a189-432c-a4c7-b9efe846d4af admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:12.433430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eee664-a189-432c-a4c7-b9efe846d4af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:12.434014 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eee664-a189-432c-a4c7-b9efe846d4af admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:12.449413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 953/1952] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:12.450500 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eee664-a189-432c-a4c7-b9efe846d4af admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:12.463483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eee664-a189-432c-a4c7-b9efe846d4af admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:12.468426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542603e-2c67-4771-8b8a-97da750ea69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:12.469213 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542603e-2c67-4771-8b8a-97da750ea69a admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:12.469528 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542603e-2c67-4771-8b8a-97da750ea69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:12.469876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542603e-2c67-4771-8b8a-97da750ea69a admin admin] PATH_INFO: `/v3/projects/13f1dbb0cebe4a5d84a9b7560a8690b5/users/11c6005ae7fc4fd085985c6a8cadd46f/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:12.472297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542603e-2c67-4771-8b8a-97da750ea69a admin admin] RBAC: Authorizing `identity:create_grant(project_id=13f1dbb0cebe4a5d84a9b7560a8690b5, user_id=11c6005ae7fc4fd085985c6a8cadd46f, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:12.476434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542603e-2c67-4771-8b8a-97da750ea69a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:12.482726 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800c521-737f-4b21-8fa0-213232c77be6 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c258f7a4094d4a0ca633a4f101e81c74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fb19f622740458d906f564413e56170', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:12.483479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800c521-737f-4b21-8fa0-213232c77be6 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:12.483840 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800c521-737f-4b21-8fa0-213232c77be6 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:12.484228 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800c521-737f-4b21-8fa0-213232c77be6 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:12.485031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800c521-737f-4b21-8fa0-213232c77be6 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:12.487071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800c521-737f-4b21-8fa0-213232c77be6 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:12.490971 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 954/1953] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:12 2022] PUT /identity/v3/projects/13f1dbb0cebe4a5d84a9b7560a8690b5/users/11c6005ae7fc4fd085985c6a8cadd46f/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:12.491683 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542603e-2c67-4771-8b8a-97da750ea69a admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:12.528780 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1000/1954] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:12 2022] POST /identity/v3/projects => generated 353 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:12.529546 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800c521-737f-4b21-8fa0-213232c77be6 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:12.585670 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:12.627197 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542603e-2c67-4771-8b8a-97da750ea69a admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:12.628027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800c521-737f-4b21-8fa0-213232c77be6 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:12.635519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be987eb7-188f-45b2-8130-67ec90784a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:12.635746 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2bbb3-b217-4971-aef5-2e4e3c8f4aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:12.636627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be987eb7-188f-45b2-8130-67ec90784a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:12.637109 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be987eb7-188f-45b2-8130-67ec90784a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:12.637590 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be987eb7-188f-45b2-8130-67ec90784a33 admin admin] PATH_INFO: `/v3/projects/30dabb8449634f2888ccbb7b15b07f76/users/9d1f42f86a3f45ab8b186dba9e4c124a/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:12.641410 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be987eb7-188f-45b2-8130-67ec90784a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30dabb8449634f2888ccbb7b15b07f76, user_id=9d1f42f86a3f45ab8b186dba9e4c124a, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:12.644804 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2bbb3-b217-4971-aef5-2e4e3c8f4aaa admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:12.645566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2bbb3-b217-4971-aef5-2e4e3c8f4aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:12.646067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2bbb3-b217-4971-aef5-2e4e3c8f4aaa admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:12.646297 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be987eb7-188f-45b2-8130-67ec90784a33 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:12.647595 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2bbb3-b217-4971-aef5-2e4e3c8f4aaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:12.650017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2bbb3-b217-4971-aef5-2e4e3c8f4aaa admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:12.669249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1001/1955] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:12 2022] PUT /identity/v3/projects/30dabb8449634f2888ccbb7b15b07f76/users/9d1f42f86a3f45ab8b186dba9e4c124a/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:12.674467 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04797f2b-27eb-4d85-9ca4-cf63897fba74 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:12.674986 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04797f2b-27eb-4d85-9ca4-cf63897fba74 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:12.675458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04797f2b-27eb-4d85-9ca4-cf63897fba74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:12.709822 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 955/1956] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:12 2022] POST /identity/v3/users => generated 299 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:12.711069 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2bbb3-b217-4971-aef5-2e4e3c8f4aaa admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:12.741275 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-04797f2b-27eb-4d85-9ca4-cf63897fba74 None None] MFA Rules not processed for user `11c6005ae7fc4fd085985c6a8cadd46f`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:12.743250 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-04797f2b-27eb-4d85-9ca4-cf63897fba74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:12.837259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2bbb3-b217-4971-aef5-2e4e3c8f4aaa admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:12.941195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2307b17-4351-4b25-83ba-0ed1535a58e9 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c258f7a4094d4a0ca633a4f101e81c74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fb19f622740458d906f564413e56170', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:12.942919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2307b17-4351-4b25-83ba-0ed1535a58e9 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:12.943409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2307b17-4351-4b25-83ba-0ed1535a58e9 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:12.943773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2307b17-4351-4b25-83ba-0ed1535a58e9 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:12.944758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2307b17-4351-4b25-83ba-0ed1535a58e9 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:12.945769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1002/1957] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:12.948283 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77783932-054c-4df9-a584-b1e4e21ae635 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:12.949275 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77783932-054c-4df9-a584-b1e4e21ae635 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:12.949817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77783932-054c-4df9-a584-b1e4e21ae635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:12.953667 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2307b17-4351-4b25-83ba-0ed1535a58e9 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:12.958286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2307b17-4351-4b25-83ba-0ed1535a58e9 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:12.980750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 956/1958] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:12.981911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2307b17-4351-4b25-83ba-0ed1535a58e9 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:13.003421 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:13.097124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-77783932-054c-4df9-a584-b1e4e21ae635 None None] MFA Rules not processed for user `9d1f42f86a3f45ab8b186dba9e4c124a`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:13.101188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-77783932-054c-4df9-a584-b1e4e21ae635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:13.161877 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2307b17-4351-4b25-83ba-0ed1535a58e9 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:13.184436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae8e7b-b230-4b8e-b13c-0f4465900d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:13.185572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae8e7b-b230-4b8e-b13c-0f4465900d28 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:13.186169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae8e7b-b230-4b8e-b13c-0f4465900d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:13.186750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae8e7b-b230-4b8e-b13c-0f4465900d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:13.189844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae8e7b-b230-4b8e-b13c-0f4465900d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:13.202515 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae8e7b-b230-4b8e-b13c-0f4465900d28 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:13.296483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 957/1959] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:13.297383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae8e7b-b230-4b8e-b13c-0f4465900d28 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:13.306741 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-88ae8e7b-b230-4b8e-b13c-0f4465900d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:13.322210 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:13.400346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1003/1960] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:13.406255 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77783932-054c-4df9-a584-b1e4e21ae635 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:13.441800 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77783932-054c-4df9-a584-b1e4e21ae635 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:13.454802 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f572431-0df6-4d16-bf92-9e4735af1d18 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c258f7a4094d4a0ca633a4f101e81c74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fb19f622740458d906f564413e56170', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:13.455592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f572431-0df6-4d16-bf92-9e4735af1d18 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:13.456027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f572431-0df6-4d16-bf92-9e4735af1d18 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:13.456346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f572431-0df6-4d16-bf92-9e4735af1d18 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] PATH_INFO: `/v3/projects/c60fa3f1d8e04d3cad535d157f13ea30` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:13.459884 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f572431-0df6-4d16-bf92-9e4735af1d18 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c60fa3f1d8e04d3cad535d157f13ea30)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:13.464618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f572431-0df6-4d16-bf92-9e4735af1d18 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:13.513965 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae8e7b-b230-4b8e-b13c-0f4465900d28 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:13.520023 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4394030-aabd-4682-8ad0-71866ef644f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:13.521524 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4394030-aabd-4682-8ad0-71866ef644f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:13.522242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4394030-aabd-4682-8ad0-71866ef644f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:13.523458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4394030-aabd-4682-8ad0-71866ef644f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:13.557193 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4394030-aabd-4682-8ad0-71866ef644f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:13.559049 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4394030-aabd-4682-8ad0-71866ef644f6 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:13.576570 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 958/1961] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:13.577450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4394030-aabd-4682-8ad0-71866ef644f6 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:13.590614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4394030-aabd-4682-8ad0-71866ef644f6 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:13.591587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1f572431-0df6-4d16-bf92-9e4735af1d18 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c60fa3f1d8e04d3cad535d157f13ea30', 'request_id': 'req-1f572431-0df6-4d16-bf92-9e4735af1d18'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:13.610816 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1f572431-0df6-4d16-bf92-9e4735af1d18 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c60fa3f1d8e04d3cad535d157f13ea30', 'request_id': 'req-1f572431-0df6-4d16-bf92-9e4735af1d18'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:13.642694 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1f572431-0df6-4d16-bf92-9e4735af1d18 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c60fa3f1d8e04d3cad535d157f13ea30', 'request_id': 'req-1f572431-0df6-4d16-bf92-9e4735af1d18'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:13.662617 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1f572431-0df6-4d16-bf92-9e4735af1d18 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] The token cache is being invalidate because project c60fa3f1d8e04d3cad535d157f13ea30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:13.662921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1f572431-0df6-4d16-bf92-9e4735af1d18 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:13.663885 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1f572431-0df6-4d16-bf92-9e4735af1d18 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:13.667310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1004/1962] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:13 2022] DELETE /identity/v3/projects/c60fa3f1d8e04d3cad535d157f13ea30 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:13.669122 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f572431-0df6-4d16-bf92-9e4735af1d18 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:13.681009 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1f572431-0df6-4d16-bf92-9e4735af1d18 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:13.770990 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef469d10-eea1-4455-98a6-cfc51ed6ff86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:13.772340 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef469d10-eea1-4455-98a6-cfc51ed6ff86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:13.773251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef469d10-eea1-4455-98a6-cfc51ed6ff86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:13.773801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef469d10-eea1-4455-98a6-cfc51ed6ff86 admin admin] PATH_INFO: `/v3/projects/dbcc12f468e54bb795349b829a58d9ea/users/a0107b9701a14494b2f12e16a99fc74e/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:13.809069 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef469d10-eea1-4455-98a6-cfc51ed6ff86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbcc12f468e54bb795349b829a58d9ea, user_id=a0107b9701a14494b2f12e16a99fc74e, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:13.817457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef469d10-eea1-4455-98a6-cfc51ed6ff86 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:13.846017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 959/1963] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:13 2022] PUT /identity/v3/projects/dbcc12f468e54bb795349b829a58d9ea/users/a0107b9701a14494b2f12e16a99fc74e/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:13.850947 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef469d10-eea1-4455-98a6-cfc51ed6ff86 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:13.853379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ef469d10-eea1-4455-98a6-cfc51ed6ff86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:13.858380 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f572431-0df6-4d16-bf92-9e4735af1d18 tempest-VolumeQuotaClassesTest-445409608 tempest-VolumeQuotaClassesTest-445409608-project-admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:13.907676 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:14.006996 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0118f1a-9754-4f42-9959-c45bc2abf3bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:14.008446 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0118f1a-9754-4f42-9959-c45bc2abf3bb service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:14.008757 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0118f1a-9754-4f42-9959-c45bc2abf3bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:14.009047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0118f1a-9754-4f42-9959-c45bc2abf3bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:14.015926 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c0118f1a-9754-4f42-9959-c45bc2abf3bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:14.038828 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef469d10-eea1-4455-98a6-cfc51ed6ff86 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:14.054120 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f181b9c-6552-455a-b36b-a5fcc4985111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:14.055174 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f181b9c-6552-455a-b36b-a5fcc4985111 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:14.055526 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f181b9c-6552-455a-b36b-a5fcc4985111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:14.055862 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f181b9c-6552-455a-b36b-a5fcc4985111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:14.056692 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f181b9c-6552-455a-b36b-a5fcc4985111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:14.058468 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f181b9c-6552-455a-b36b-a5fcc4985111 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:14.076079 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 960/1964] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:14.077180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f181b9c-6552-455a-b36b-a5fcc4985111 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:14.090534 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f181b9c-6552-455a-b36b-a5fcc4985111 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:14.097048 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd6526-4ebb-4d7f-b02b-2e5f83d0f398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:14.098530 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd6526-4ebb-4d7f-b02b-2e5f83d0f398 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:14.099149 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd6526-4ebb-4d7f-b02b-2e5f83d0f398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:14.099657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd6526-4ebb-4d7f-b02b-2e5f83d0f398 admin admin] PATH_INFO: `/v3/projects/dbcc12f468e54bb795349b829a58d9ea/users/a0107b9701a14494b2f12e16a99fc74e/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:14.102742 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd6526-4ebb-4d7f-b02b-2e5f83d0f398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbcc12f468e54bb795349b829a58d9ea, user_id=a0107b9701a14494b2f12e16a99fc74e, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:14.108882 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd6526-4ebb-4d7f-b02b-2e5f83d0f398 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:14.141233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 961/1965] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:14 2022] PUT /identity/v3/projects/dbcc12f468e54bb795349b829a58d9ea/users/a0107b9701a14494b2f12e16a99fc74e/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:14.143905 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bac3d9-4cf8-4cf1-80d9-b70e00ff842d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:14.144223 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bac3d9-4cf8-4cf1-80d9-b70e00ff842d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:14.144512 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bac3d9-4cf8-4cf1-80d9-b70e00ff842d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:14.180473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:14.191962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-53bac3d9-4cf8-4cf1-80d9-b70e00ff842d None None] MFA Rules not processed for user `a0107b9701a14494b2f12e16a99fc74e`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:14.194236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-53bac3d9-4cf8-4cf1-80d9-b70e00ff842d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:14.261520 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0118f1a-9754-4f42-9959-c45bc2abf3bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:14.264507 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0118f1a-9754-4f42-9959-c45bc2abf3bb service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:14.322980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1005/1966] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:14.361943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 962/1967] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:14.385470 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0118f1a-9754-4f42-9959-c45bc2abf3bb service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:14.387192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c0118f1a-9754-4f42-9959-c45bc2abf3bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:14.412102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bac3d9-4cf8-4cf1-80d9-b70e00ff842d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:14.419238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0118f1a-9754-4f42-9959-c45bc2abf3bb service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:14.564371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bac3d9-4cf8-4cf1-80d9-b70e00ff842d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:14.569935 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775ebc6-11ff-47ae-b1d9-06f92d15011f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:14.570421 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775ebc6-11ff-47ae-b1d9-06f92d15011f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:14.570868 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775ebc6-11ff-47ae-b1d9-06f92d15011f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:14.571289 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775ebc6-11ff-47ae-b1d9-06f92d15011f admin admin] PATH_INFO: `/v3/users/c59b6e85c1164e12918248fa5dc6e78c` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:14.573259 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775ebc6-11ff-47ae-b1d9-06f92d15011f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c59b6e85c1164e12918248fa5dc6e78c)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:14.575444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775ebc6-11ff-47ae-b1d9-06f92d15011f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:14.576337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23a9c0-6ea2-48f5-81a3-b1db5ac06d40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:14.580276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23a9c0-6ea2-48f5-81a3-b1db5ac06d40 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:14.584673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23a9c0-6ea2-48f5-81a3-b1db5ac06d40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:14.587255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23a9c0-6ea2-48f5-81a3-b1db5ac06d40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:14.630084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23a9c0-6ea2-48f5-81a3-b1db5ac06d40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:14.637036 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23a9c0-6ea2-48f5-81a3-b1db5ac06d40 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:14.664381 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 963/1968] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:14.702789 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4775ebc6-11ff-47ae-b1d9-06f92d15011f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c59b6e85c1164e12918248fa5dc6e78c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:14.704068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4775ebc6-11ff-47ae-b1d9-06f92d15011f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c59b6e85c1164e12918248fa5dc6e78c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:14.729349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4775ebc6-11ff-47ae-b1d9-06f92d15011f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c59b6e85c1164e12918248fa5dc6e78c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:14.730936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4775ebc6-11ff-47ae-b1d9-06f92d15011f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c59b6e85c1164e12918248fa5dc6e78c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:14.786611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23a9c0-6ea2-48f5-81a3-b1db5ac06d40 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:14.793746 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4775ebc6-11ff-47ae-b1d9-06f92d15011f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c59b6e85c1164e12918248fa5dc6e78c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:14.804396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23a9c0-6ea2-48f5-81a3-b1db5ac06d40 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:14.813997 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:14.822370 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a21375-af79-4e54-98aa-6b260cc1236f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:14.823949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a21375-af79-4e54-98aa-6b260cc1236f service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:14.824911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1006/1969] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:14 2022] DELETE /identity/v3/users/c59b6e85c1164e12918248fa5dc6e78c => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:26:14.825091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a21375-af79-4e54-98aa-6b260cc1236f service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:14.825444 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a21375-af79-4e54-98aa-6b260cc1236f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:14.830479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c14f9-c553-497b-8a6f-a4251dff693d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:14.830772 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c14f9-c553-497b-8a6f-a4251dff693d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:14.831039 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c14f9-c553-497b-8a6f-a4251dff693d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:14.831402 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-13a21375-af79-4e54-98aa-6b260cc1236f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:14.881974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c70c14f9-c553-497b-8a6f-a4251dff693d None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:14.883385 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c70c14f9-c553-497b-8a6f-a4251dff693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:15.047314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1007/1970] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:15.048419 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c14f9-c553-497b-8a6f-a4251dff693d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:15.054396 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c70c14f9-c553-497b-8a6f-a4251dff693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:15.069273 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c14f9-c553-497b-8a6f-a4251dff693d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:15.075129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246067e5-e7f8-4733-9466-b50fd85278e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:15.076212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246067e5-e7f8-4733-9466-b50fd85278e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:15.076212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246067e5-e7f8-4733-9466-b50fd85278e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:15.076212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246067e5-e7f8-4733-9466-b50fd85278e3 admin admin] PATH_INFO: `/v3/users/0dd37feb6a4b4a28b6569fc7a33d35ba` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:15.077428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246067e5-e7f8-4733-9466-b50fd85278e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd37feb6a4b4a28b6569fc7a33d35ba)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:15.079666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246067e5-e7f8-4733-9466-b50fd85278e3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:15.150352 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a21375-af79-4e54-98aa-6b260cc1236f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:15.155010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a21375-af79-4e54-98aa-6b260cc1236f service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:15.170026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 964/1971] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:26:15.171200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-246067e5-e7f8-4733-9466-b50fd85278e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd37feb6a4b4a28b6569fc7a33d35ba'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:15.171703 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a21375-af79-4e54-98aa-6b260cc1236f service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:15.172439 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-246067e5-e7f8-4733-9466-b50fd85278e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd37feb6a4b4a28b6569fc7a33d35ba'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:15.174092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-13a21375-af79-4e54-98aa-6b260cc1236f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:15.200253 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-246067e5-e7f8-4733-9466-b50fd85278e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd37feb6a4b4a28b6569fc7a33d35ba'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:15.202451 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-246067e5-e7f8-4733-9466-b50fd85278e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd37feb6a4b4a28b6569fc7a33d35ba'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:15.231627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-246067e5-e7f8-4733-9466-b50fd85278e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd37feb6a4b4a28b6569fc7a33d35ba'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:15.275302 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1008/1972] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:15 2022] DELETE /identity/v3/users/0dd37feb6a4b4a28b6569fc7a33d35ba => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:15.282034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fa7d6-0eb9-40db-aaa9-ca9496aa2a87 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:15.284252 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fa7d6-0eb9-40db-aaa9-ca9496aa2a87 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:15.284899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fa7d6-0eb9-40db-aaa9-ca9496aa2a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:15.322367 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:15.333835 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d06fa7d6-0eb9-40db-aaa9-ca9496aa2a87 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:15.336866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d06fa7d6-0eb9-40db-aaa9-ca9496aa2a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:15.381954 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a21375-af79-4e54-98aa-6b260cc1236f service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:15.468349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1009/1973] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:15.494940 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fa7d6-0eb9-40db-aaa9-ca9496aa2a87 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:15.496738 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d06fa7d6-0eb9-40db-aaa9-ca9496aa2a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:15.523866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:15.575159 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04d60-e36e-4df4-9313-98c5eefbff75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:15.576125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04d60-e36e-4df4-9313-98c5eefbff75 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:15.576125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04d60-e36e-4df4-9313-98c5eefbff75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:15.576125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04d60-e36e-4df4-9313-98c5eefbff75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:15.579450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-efd04d60-e36e-4df4-9313-98c5eefbff75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:15.615327 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd04d60-e36e-4df4-9313-98c5eefbff75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:15.621909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd04d60-e36e-4df4-9313-98c5eefbff75 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:15.653449 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fa7d6-0eb9-40db-aaa9-ca9496aa2a87 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:15.664071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ecc4f-1acd-4694-9c14-9bf50bf7865a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:15.664773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ecc4f-1acd-4694-9c14-9bf50bf7865a service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:15.665060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ecc4f-1acd-4694-9c14-9bf50bf7865a service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:15.665339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ecc4f-1acd-4694-9c14-9bf50bf7865a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:15.671193 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 965/1974] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:15.686202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ecc4f-1acd-4694-9c14-9bf50bf7865a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:15.687731 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ecc4f-1acd-4694-9c14-9bf50bf7865a service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:15.723618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1010/1975] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:26:16.077737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04d60-e36e-4df4-9313-98c5eefbff75 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:16.082930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-efd04d60-e36e-4df4-9313-98c5eefbff75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:16.126527 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04d60-e36e-4df4-9313-98c5eefbff75 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:16.161481 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ce91d-bf65-4959-8d90-23354539ac91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:16.162270 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ce91d-bf65-4959-8d90-23354539ac91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:16.162628 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ce91d-bf65-4959-8d90-23354539ac91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:16.162978 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ce91d-bf65-4959-8d90-23354539ac91 admin admin] PATH_INFO: `/v3/users/02c2712413d041d7811a78df30afa978` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:16.165267 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ce91d-bf65-4959-8d90-23354539ac91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c2712413d041d7811a78df30afa978)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:16.167338 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ce91d-bf65-4959-8d90-23354539ac91 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:16.355197 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0a6ce91d-bf65-4959-8d90-23354539ac91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c2712413d041d7811a78df30afa978'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:16.361648 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0a6ce91d-bf65-4959-8d90-23354539ac91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c2712413d041d7811a78df30afa978'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:16.378090 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0a6ce91d-bf65-4959-8d90-23354539ac91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c2712413d041d7811a78df30afa978'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:16.414096 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0a6ce91d-bf65-4959-8d90-23354539ac91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c2712413d041d7811a78df30afa978'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:16.428305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0a6ce91d-bf65-4959-8d90-23354539ac91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c2712413d041d7811a78df30afa978'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:16.440266 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 966/1976] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:16 2022] DELETE /identity/v3/users/02c2712413d041d7811a78df30afa978 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:16.443342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43d4eb-ad3b-448d-b6fc-a528da94b822 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:16.443342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43d4eb-ad3b-448d-b6fc-a528da94b822 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:16.443342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43d4eb-ad3b-448d-b6fc-a528da94b822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:16.469519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-4d43d4eb-ad3b-448d-b6fc-a528da94b822 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:16.471052 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4d43d4eb-ad3b-448d-b6fc-a528da94b822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:16.577243 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1011/1977] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:16.581061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ce91d-bf65-4959-8d90-23354539ac91 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:16.584010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0a6ce91d-bf65-4959-8d90-23354539ac91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:16.592975 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43d4eb-ad3b-448d-b6fc-a528da94b822 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:16.594787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4d43d4eb-ad3b-448d-b6fc-a528da94b822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:16.599985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ce91d-bf65-4959-8d90-23354539ac91 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:16.607044 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a79ff9-7a75-49c9-96a8-949285264412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:16.607725 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a79ff9-7a75-49c9-96a8-949285264412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:16.608009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a79ff9-7a75-49c9-96a8-949285264412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:16.608346 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a79ff9-7a75-49c9-96a8-949285264412 admin admin] PATH_INFO: `/v3/users/7f64123f9504447dac406b995a5d09b8` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:16.610347 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a79ff9-7a75-49c9-96a8-949285264412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f64123f9504447dac406b995a5d09b8)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:16.612941 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a79ff9-7a75-49c9-96a8-949285264412 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:16.706425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43d4eb-ad3b-448d-b6fc-a528da94b822 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:16.706769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d2a79ff9-7a75-49c9-96a8-949285264412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f64123f9504447dac406b995a5d09b8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:16.708806 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d2a79ff9-7a75-49c9-96a8-949285264412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f64123f9504447dac406b995a5d09b8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:16.720194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d379f-3f21-4345-a37c-c15d79d85e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:16.720592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d379f-3f21-4345-a37c-c15d79d85e62 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:16.723438 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d379f-3f21-4345-a37c-c15d79d85e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:16.723781 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d379f-3f21-4345-a37c-c15d79d85e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:16.727180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d2a79ff9-7a75-49c9-96a8-949285264412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f64123f9504447dac406b995a5d09b8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:16.729231 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-111d379f-3f21-4345-a37c-c15d79d85e62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:16.743137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:16.760817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d379f-3f21-4345-a37c-c15d79d85e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:16.762649 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d379f-3f21-4345-a37c-c15d79d85e62 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:16.783254 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d2a79ff9-7a75-49c9-96a8-949285264412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f64123f9504447dac406b995a5d09b8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:16.784710 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1012/1978] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:16.794776 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d2a79ff9-7a75-49c9-96a8-949285264412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f64123f9504447dac406b995a5d09b8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:16.813750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 967/1979] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:16 2022] DELETE /identity/v3/users/7f64123f9504447dac406b995a5d09b8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:16.815415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799436d-f5d4-4020-910f-9a656ba12250 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:16.815773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799436d-f5d4-4020-910f-9a656ba12250 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:16.816060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799436d-f5d4-4020-910f-9a656ba12250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:16.844577 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a79ff9-7a75-49c9-96a8-949285264412 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:16.846677 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d2a79ff9-7a75-49c9-96a8-949285264412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:16.877986 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b799436d-f5d4-4020-910f-9a656ba12250 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:16.879856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b799436d-f5d4-4020-910f-9a656ba12250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:16.998731 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:17.031379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1013/1980] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:17.034805 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799436d-f5d4-4020-910f-9a656ba12250 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:17.042692 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b799436d-f5d4-4020-910f-9a656ba12250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:17.083482 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799436d-f5d4-4020-910f-9a656ba12250 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:17.090462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d7f30-2989-4755-a52d-9d1f054d4847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:17.091569 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d7f30-2989-4755-a52d-9d1f054d4847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:17.092349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d7f30-2989-4755-a52d-9d1f054d4847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:17.092893 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d7f30-2989-4755-a52d-9d1f054d4847 admin admin] PATH_INFO: `/v3/projects/a372f06c5396477b9f07a908a60636c4` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:17.095251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d7f30-2989-4755-a52d-9d1f054d4847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a372f06c5396477b9f07a908a60636c4)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:17.099197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d7f30-2989-4755-a52d-9d1f054d4847 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:17.168018 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a79ff9-7a75-49c9-96a8-949285264412 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:17.179276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f41d7f30-2989-4755-a52d-9d1f054d4847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a372f06c5396477b9f07a908a60636c4', 'request_id': 'req-f41d7f30-2989-4755-a52d-9d1f054d4847'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:17.186840 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f41d7f30-2989-4755-a52d-9d1f054d4847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a372f06c5396477b9f07a908a60636c4', 'request_id': 'req-f41d7f30-2989-4755-a52d-9d1f054d4847'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:17.201693 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f41d7f30-2989-4755-a52d-9d1f054d4847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a372f06c5396477b9f07a908a60636c4', 'request_id': 'req-f41d7f30-2989-4755-a52d-9d1f054d4847'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:17.219374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f41d7f30-2989-4755-a52d-9d1f054d4847 admin admin] The token cache is being invalidate because project a372f06c5396477b9f07a908a60636c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:17.219683 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f41d7f30-2989-4755-a52d-9d1f054d4847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:17.220711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-f41d7f30-2989-4755-a52d-9d1f054d4847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:17.226395 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1014/1981] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:17 2022] DELETE /identity/v3/projects/a372f06c5396477b9f07a908a60636c4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:17.226395 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d7f30-2989-4755-a52d-9d1f054d4847 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:17.226825 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f41d7f30-2989-4755-a52d-9d1f054d4847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:17.308604 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcd7ae-edc1-4140-a9f1-41f6269cc5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:17.309387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcd7ae-edc1-4140-a9f1-41f6269cc5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:17.309924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcd7ae-edc1-4140-a9f1-41f6269cc5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:17.310319 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcd7ae-edc1-4140-a9f1-41f6269cc5f9 admin admin] PATH_INFO: `/v3/projects/448295eaf86a4a9098bcf064c6c128cd` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:17.311578 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcd7ae-edc1-4140-a9f1-41f6269cc5f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=448295eaf86a4a9098bcf064c6c128cd)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:17.313896 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcd7ae-edc1-4140-a9f1-41f6269cc5f9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:17.350304 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d7f30-2989-4755-a52d-9d1f054d4847 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:17.384853 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f8b68-f0d4-4f8c-9e5b-cbfa65db53b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:17.387172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f8b68-f0d4-4f8c-9e5b-cbfa65db53b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:17.387653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f8b68-f0d4-4f8c-9e5b-cbfa65db53b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:17.388225 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f8b68-f0d4-4f8c-9e5b-cbfa65db53b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:17.397942 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ee2f8b68-f0d4-4f8c-9e5b-cbfa65db53b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:17.453877 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f8b68-f0d4-4f8c-9e5b-cbfa65db53b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:17.485144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f8b68-f0d4-4f8c-9e5b-cbfa65db53b9 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:17.522841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1015/1982] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:17.530489 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f8b68-f0d4-4f8c-9e5b-cbfa65db53b9 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:17.547808 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ee2f8b68-f0d4-4f8c-9e5b-cbfa65db53b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:17.550475 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-15dcd7ae-edc1-4140-a9f1-41f6269cc5f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '448295eaf86a4a9098bcf064c6c128cd', 'request_id': 'req-15dcd7ae-edc1-4140-a9f1-41f6269cc5f9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:17.569975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-15dcd7ae-edc1-4140-a9f1-41f6269cc5f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '448295eaf86a4a9098bcf064c6c128cd', 'request_id': 'req-15dcd7ae-edc1-4140-a9f1-41f6269cc5f9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:17.585305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-15dcd7ae-edc1-4140-a9f1-41f6269cc5f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '448295eaf86a4a9098bcf064c6c128cd', 'request_id': 'req-15dcd7ae-edc1-4140-a9f1-41f6269cc5f9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:17.608226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f8b68-f0d4-4f8c-9e5b-cbfa65db53b9 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:17.612399 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-15dcd7ae-edc1-4140-a9f1-41f6269cc5f9 admin admin] The token cache is being invalidate because project 448295eaf86a4a9098bcf064c6c128cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:17.614075 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-15dcd7ae-edc1-4140-a9f1-41f6269cc5f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:17.615539 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-15dcd7ae-edc1-4140-a9f1-41f6269cc5f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:17.619370 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 968/1983] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:16 2022] DELETE /identity/v3/projects/448295eaf86a4a9098bcf064c6c128cd => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:26:17.621808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcd7ae-edc1-4140-a9f1-41f6269cc5f9 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:17.625375 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-15dcd7ae-edc1-4140-a9f1-41f6269cc5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:17.733632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:17.814848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd40170-12d4-4445-9a61-5c288f766cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:17.817092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd40170-12d4-4445-9a61-5c288f766cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:17.817840 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd40170-12d4-4445-9a61-5c288f766cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:17.818873 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd40170-12d4-4445-9a61-5c288f766cdd admin admin] PATH_INFO: `/v3/users/a0107b9701a14494b2f12e16a99fc74e` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:17.822427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd40170-12d4-4445-9a61-5c288f766cdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0107b9701a14494b2f12e16a99fc74e)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:17.827899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd40170-12d4-4445-9a61-5c288f766cdd admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:17.854725 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcd7ae-edc1-4140-a9f1-41f6269cc5f9 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:17.872258 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef18893-a69a-4ff0-9241-e45790e3d81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:17.873168 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef18893-a69a-4ff0-9241-e45790e3d81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:17.878401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef18893-a69a-4ff0-9241-e45790e3d81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:17.878401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef18893-a69a-4ff0-9241-e45790e3d81d admin admin] PATH_INFO: `/v3/projects/6ef9e99586ca4b01a33ae63f50cf7089` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:17.880773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef18893-a69a-4ff0-9241-e45790e3d81d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef9e99586ca4b01a33ae63f50cf7089)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:17.882747 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef18893-a69a-4ff0-9241-e45790e3d81d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:17.904950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:17.945270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5cd40170-12d4-4445-9a61-5c288f766cdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0107b9701a14494b2f12e16a99fc74e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:17.946034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5cd40170-12d4-4445-9a61-5c288f766cdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0107b9701a14494b2f12e16a99fc74e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:17.966964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5cd40170-12d4-4445-9a61-5c288f766cdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0107b9701a14494b2f12e16a99fc74e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:17.968037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5cd40170-12d4-4445-9a61-5c288f766cdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0107b9701a14494b2f12e16a99fc74e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:17.972327 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9ef18893-a69a-4ff0-9241-e45790e3d81d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef9e99586ca4b01a33ae63f50cf7089', 'request_id': 'req-9ef18893-a69a-4ff0-9241-e45790e3d81d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:17.994844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9ef18893-a69a-4ff0-9241-e45790e3d81d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef9e99586ca4b01a33ae63f50cf7089', 'request_id': 'req-9ef18893-a69a-4ff0-9241-e45790e3d81d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:18.013196 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5cd40170-12d4-4445-9a61-5c288f766cdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0107b9701a14494b2f12e16a99fc74e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:18.015476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9ef18893-a69a-4ff0-9241-e45790e3d81d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef9e99586ca4b01a33ae63f50cf7089', 'request_id': 'req-9ef18893-a69a-4ff0-9241-e45790e3d81d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:18.038508 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1016/1984] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:17 2022] DELETE /identity/v3/users/a0107b9701a14494b2f12e16a99fc74e => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:18.038756 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9ef18893-a69a-4ff0-9241-e45790e3d81d admin admin] The token cache is being invalidate because project 6ef9e99586ca4b01a33ae63f50cf7089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:18.038907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd40170-12d4-4445-9a61-5c288f766cdd admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:18.040517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5cd40170-12d4-4445-9a61-5c288f766cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:18.041447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9ef18893-a69a-4ff0-9241-e45790e3d81d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:18.056927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9ef18893-a69a-4ff0-9241-e45790e3d81d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:18.064224 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 969/1985] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:17 2022] DELETE /identity/v3/projects/6ef9e99586ca4b01a33ae63f50cf7089 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:18.069363 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef18893-a69a-4ff0-9241-e45790e3d81d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:18.074186 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9ef18893-a69a-4ff0-9241-e45790e3d81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:18.178620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd40170-12d4-4445-9a61-5c288f766cdd admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:18.180017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef18893-a69a-4ff0-9241-e45790e3d81d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:18.188080 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f24d95-88de-4ea8-86a2-c517671d6d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:18.188924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f24d95-88de-4ea8-86a2-c517671d6d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:18.189209 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f24d95-88de-4ea8-86a2-c517671d6d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:18.189485 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f24d95-88de-4ea8-86a2-c517671d6d1b admin admin] PATH_INFO: `/v3/users/ac00cb9a28774e2d988bf7c1d019fc9d` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:18.191195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b609294-3e95-4a34-85ae-8c737ccfa845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:18.191786 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f24d95-88de-4ea8-86a2-c517671d6d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac00cb9a28774e2d988bf7c1d019fc9d)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:18.193185 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609294-3e95-4a34-85ae-8c737ccfa845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:18.194292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609294-3e95-4a34-85ae-8c737ccfa845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:18.194865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f24d95-88de-4ea8-86a2-c517671d6d1b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:18.195290 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609294-3e95-4a34-85ae-8c737ccfa845 admin admin] PATH_INFO: `/v3/users/c258f7a4094d4a0ca633a4f101e81c74` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:18.198515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b609294-3e95-4a34-85ae-8c737ccfa845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c258f7a4094d4a0ca633a4f101e81c74)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:18.204771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b609294-3e95-4a34-85ae-8c737ccfa845 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:18.317404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-13f24d95-88de-4ea8-86a2-c517671d6d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac00cb9a28774e2d988bf7c1d019fc9d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:18.318356 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-13f24d95-88de-4ea8-86a2-c517671d6d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac00cb9a28774e2d988bf7c1d019fc9d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:18.321939 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:18.361699 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-13f24d95-88de-4ea8-86a2-c517671d6d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac00cb9a28774e2d988bf7c1d019fc9d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:18.376839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4b609294-3e95-4a34-85ae-8c737ccfa845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c258f7a4094d4a0ca633a4f101e81c74'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:18.378107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4b609294-3e95-4a34-85ae-8c737ccfa845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c258f7a4094d4a0ca633a4f101e81c74'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:18.389811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4b609294-3e95-4a34-85ae-8c737ccfa845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c258f7a4094d4a0ca633a4f101e81c74'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:18.390098 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-13f24d95-88de-4ea8-86a2-c517671d6d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac00cb9a28774e2d988bf7c1d019fc9d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:18.390766 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4b609294-3e95-4a34-85ae-8c737ccfa845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c258f7a4094d4a0ca633a4f101e81c74'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:18.404847 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-13f24d95-88de-4ea8-86a2-c517671d6d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac00cb9a28774e2d988bf7c1d019fc9d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:18.418780 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4b609294-3e95-4a34-85ae-8c737ccfa845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c258f7a4094d4a0ca633a4f101e81c74'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:18.428248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 970/1986] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:18 2022] DELETE /identity/v3/users/ac00cb9a28774e2d988bf7c1d019fc9d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:26:18.428248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f24d95-88de-4ea8-86a2-c517671d6d1b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:18.430455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-13f24d95-88de-4ea8-86a2-c517671d6d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:18.461004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1017/1987] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:18 2022] DELETE /identity/v3/users/c258f7a4094d4a0ca633a4f101e81c74 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:18.609514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f24d95-88de-4ea8-86a2-c517671d6d1b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:18.756324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b609294-3e95-4a34-85ae-8c737ccfa845 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:18.758195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4b609294-3e95-4a34-85ae-8c737ccfa845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:18.841900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a5d85-1bd0-44e6-bdd7-8fad85164a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:18.843389 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a5d85-1bd0-44e6-bdd7-8fad85164a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:18.843692 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a5d85-1bd0-44e6-bdd7-8fad85164a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:18.844463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a5d85-1bd0-44e6-bdd7-8fad85164a57 admin admin] PATH_INFO: `/v3/projects/594f7f4f8de54d45bc47efc18373796f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:18.848130 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a5d85-1bd0-44e6-bdd7-8fad85164a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=594f7f4f8de54d45bc47efc18373796f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:18.853723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:18.855031 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a5d85-1bd0-44e6-bdd7-8fad85164a57 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:18.977847 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b609294-3e95-4a34-85ae-8c737ccfa845 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:19.025337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fe7a5d85-1bd0-44e6-bdd7-8fad85164a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594f7f4f8de54d45bc47efc18373796f', 'request_id': 'req-fe7a5d85-1bd0-44e6-bdd7-8fad85164a57'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.042092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fe7a5d85-1bd0-44e6-bdd7-8fad85164a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594f7f4f8de54d45bc47efc18373796f', 'request_id': 'req-fe7a5d85-1bd0-44e6-bdd7-8fad85164a57'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.061157 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fe7a5d85-1bd0-44e6-bdd7-8fad85164a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594f7f4f8de54d45bc47efc18373796f', 'request_id': 'req-fe7a5d85-1bd0-44e6-bdd7-8fad85164a57'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.085765 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fe7a5d85-1bd0-44e6-bdd7-8fad85164a57 admin admin] The token cache is being invalidate because project 594f7f4f8de54d45bc47efc18373796f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:19.086745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fe7a5d85-1bd0-44e6-bdd7-8fad85164a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.089270 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fe7a5d85-1bd0-44e6-bdd7-8fad85164a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.091461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 971/1988] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:18 2022] DELETE /identity/v3/projects/594f7f4f8de54d45bc47efc18373796f => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:19.097262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a5d85-1bd0-44e6-bdd7-8fad85164a57 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:19.099867 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fe7a5d85-1bd0-44e6-bdd7-8fad85164a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:19.110145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:19.153696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99d58d-406f-4376-a6bb-98f48178d723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:19.158635 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99d58d-406f-4376-a6bb-98f48178d723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:19.159212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99d58d-406f-4376-a6bb-98f48178d723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:19.161219 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99d58d-406f-4376-a6bb-98f48178d723 admin admin] PATH_INFO: `/v3/projects/dbcc12f468e54bb795349b829a58d9ea` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:19.168827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99d58d-406f-4376-a6bb-98f48178d723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbcc12f468e54bb795349b829a58d9ea)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:19.177217 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99d58d-406f-4376-a6bb-98f48178d723 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:19.256531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a5d85-1bd0-44e6-bdd7-8fad85164a57 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:19.263564 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f99d36-377a-4731-9e0c-0b66609ac57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:19.265980 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99d36-377a-4731-9e0c-0b66609ac57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:19.266355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99d36-377a-4731-9e0c-0b66609ac57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:19.266659 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99d36-377a-4731-9e0c-0b66609ac57d admin admin] PATH_INFO: `/v3/users/11c6005ae7fc4fd085985c6a8cadd46f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:19.268114 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f99d36-377a-4731-9e0c-0b66609ac57d admin admin] RBAC: Authorizing `identity:delete_user(user_id=11c6005ae7fc4fd085985c6a8cadd46f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:19.283529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f99d36-377a-4731-9e0c-0b66609ac57d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:19.340029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5f99d58d-406f-4376-a6bb-98f48178d723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbcc12f468e54bb795349b829a58d9ea', 'request_id': 'req-5f99d58d-406f-4376-a6bb-98f48178d723'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.354321 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5f99d58d-406f-4376-a6bb-98f48178d723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbcc12f468e54bb795349b829a58d9ea', 'request_id': 'req-5f99d58d-406f-4376-a6bb-98f48178d723'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.371436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5f99d58d-406f-4376-a6bb-98f48178d723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbcc12f468e54bb795349b829a58d9ea', 'request_id': 'req-5f99d58d-406f-4376-a6bb-98f48178d723'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.398311 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a2f99d36-377a-4731-9e0c-0b66609ac57d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11c6005ae7fc4fd085985c6a8cadd46f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.399184 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a2f99d36-377a-4731-9e0c-0b66609ac57d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11c6005ae7fc4fd085985c6a8cadd46f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.413616 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5f99d58d-406f-4376-a6bb-98f48178d723 admin admin] The token cache is being invalidate because project dbcc12f468e54bb795349b829a58d9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:19.414299 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5f99d58d-406f-4376-a6bb-98f48178d723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.415435 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a2f99d36-377a-4731-9e0c-0b66609ac57d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11c6005ae7fc4fd085985c6a8cadd46f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.415697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5f99d58d-406f-4376-a6bb-98f48178d723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.418521 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1018/1989] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:18 2022] DELETE /identity/v3/projects/dbcc12f468e54bb795349b829a58d9ea => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:19.420070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99d58d-406f-4376-a6bb-98f48178d723 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:19.422485 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5f99d58d-406f-4376-a6bb-98f48178d723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:19.462161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a2f99d36-377a-4731-9e0c-0b66609ac57d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11c6005ae7fc4fd085985c6a8cadd46f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.485624 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a2f99d36-377a-4731-9e0c-0b66609ac57d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11c6005ae7fc4fd085985c6a8cadd46f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.496097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 972/1990] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:19 2022] DELETE /identity/v3/users/11c6005ae7fc4fd085985c6a8cadd46f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:26:19.497133 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f99d36-377a-4731-9e0c-0b66609ac57d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:19.498698 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a2f99d36-377a-4731-9e0c-0b66609ac57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:19.623450 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99d58d-406f-4376-a6bb-98f48178d723 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:19.632907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2bbaa-40d1-496b-8653-8ad649b12bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:19.635021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2bbaa-40d1-496b-8653-8ad649b12bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:19.635646 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2bbaa-40d1-496b-8653-8ad649b12bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:19.636286 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2bbaa-40d1-496b-8653-8ad649b12bca admin admin] PATH_INFO: `/v3/projects/799ca87ff14d492099f2fb3a9ac733e4` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:19.638818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2bbaa-40d1-496b-8653-8ad649b12bca admin admin] RBAC: Authorizing `identity:delete_project(project_id=799ca87ff14d492099f2fb3a9ac733e4)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:19.642775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f99d36-377a-4731-9e0c-0b66609ac57d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:19.643888 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2bbaa-40d1-496b-8653-8ad649b12bca admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:19.647703 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:19.651847 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b68ab-2930-486b-bf12-d86e6a104d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:19.652894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b68ab-2930-486b-bf12-d86e6a104d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:19.654053 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b68ab-2930-486b-bf12-d86e6a104d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:19.654318 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b68ab-2930-486b-bf12-d86e6a104d5f admin admin] PATH_INFO: `/v3/projects/0fb19f622740458d906f564413e56170` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:19.656855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b68ab-2930-486b-bf12-d86e6a104d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fb19f622740458d906f564413e56170)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:19.660147 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b68ab-2930-486b-bf12-d86e6a104d5f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:19.702461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:19.731508 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fa8b68ab-2930-486b-bf12-d86e6a104d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fb19f622740458d906f564413e56170', 'request_id': 'req-fa8b68ab-2930-486b-bf12-d86e6a104d5f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.742525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-84a2bbaa-40d1-496b-8653-8ad649b12bca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799ca87ff14d492099f2fb3a9ac733e4', 'request_id': 'req-84a2bbaa-40d1-496b-8653-8ad649b12bca'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.742803 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fa8b68ab-2930-486b-bf12-d86e6a104d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fb19f622740458d906f564413e56170', 'request_id': 'req-fa8b68ab-2930-486b-bf12-d86e6a104d5f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.759148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fa8b68ab-2930-486b-bf12-d86e6a104d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fb19f622740458d906f564413e56170', 'request_id': 'req-fa8b68ab-2930-486b-bf12-d86e6a104d5f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.759367 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-84a2bbaa-40d1-496b-8653-8ad649b12bca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799ca87ff14d492099f2fb3a9ac733e4', 'request_id': 'req-84a2bbaa-40d1-496b-8653-8ad649b12bca'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.773554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-84a2bbaa-40d1-496b-8653-8ad649b12bca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799ca87ff14d492099f2fb3a9ac733e4', 'request_id': 'req-84a2bbaa-40d1-496b-8653-8ad649b12bca'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.784314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fa8b68ab-2930-486b-bf12-d86e6a104d5f admin admin] The token cache is being invalidate because project 0fb19f622740458d906f564413e56170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:19.784711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fa8b68ab-2930-486b-bf12-d86e6a104d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.786881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fa8b68ab-2930-486b-bf12-d86e6a104d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.790389 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 973/1991] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:19 2022] DELETE /identity/v3/projects/0fb19f622740458d906f564413e56170 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:19.793395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e6cc9-1a60-4d4c-8e6f-fb5530af18bb None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:19.793727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e6cc9-1a60-4d4c-8e6f-fb5530af18bb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:19.794101 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e6cc9-1a60-4d4c-8e6f-fb5530af18bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:19.808401 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-84a2bbaa-40d1-496b-8653-8ad649b12bca admin admin] The token cache is being invalidate because project 799ca87ff14d492099f2fb3a9ac733e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:19.808778 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-84a2bbaa-40d1-496b-8653-8ad649b12bca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.809729 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-84a2bbaa-40d1-496b-8653-8ad649b12bca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:19.812330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1019/1992] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:19 2022] DELETE /identity/v3/projects/799ca87ff14d492099f2fb3a9ac733e4 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:19.813809 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2bbaa-40d1-496b-8653-8ad649b12bca admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:19.817345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-84a2bbaa-40d1-496b-8653-8ad649b12bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:19.823219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ef5e6cc9-1a60-4d4c-8e6f-fb5530af18bb None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:19.824914 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ef5e6cc9-1a60-4d4c-8e6f-fb5530af18bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:19.968660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2bbaa-40d1-496b-8653-8ad649b12bca admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:19.969457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 974/1993] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:19.970912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b86cc-a94e-44d6-8065-4161f83f1166 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:19.971211 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b86cc-a94e-44d6-8065-4161f83f1166 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:19.971499 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b86cc-a94e-44d6-8065-4161f83f1166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:19.981221 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afdd129-3168-4741-b6d8-3f75a4816fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:19.981906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afdd129-3168-4741-b6d8-3f75a4816fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:19.982195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afdd129-3168-4741-b6d8-3f75a4816fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:19.982497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afdd129-3168-4741-b6d8-3f75a4816fd3 admin admin] PATH_INFO: `/v3/users/169db502e9bd463c8423f74bc6e0818e` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:19.983823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afdd129-3168-4741-b6d8-3f75a4816fd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=169db502e9bd463c8423f74bc6e0818e)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:19.985848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afdd129-3168-4741-b6d8-3f75a4816fd3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:19.998618 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-df9b86cc-a94e-44d6-8065-4161f83f1166 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:19.999892 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-df9b86cc-a94e-44d6-8065-4161f83f1166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:20.009693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 975/1994] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:20.011002 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f96e3e-36ca-46c9-825e-4504b3a872b7 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:20.011267 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f96e3e-36ca-46c9-825e-4504b3a872b7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:20.011562 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f96e3e-36ca-46c9-825e-4504b3a872b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:20.042732 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-64f96e3e-36ca-46c9-825e-4504b3a872b7 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:20.044198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-64f96e3e-36ca-46c9-825e-4504b3a872b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:20.053696 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 976/1995] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:20.054573 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f96e3e-36ca-46c9-825e-4504b3a872b7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:20.067703 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-64f96e3e-36ca-46c9-825e-4504b3a872b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:20.070794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5afdd129-3168-4741-b6d8-3f75a4816fd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '169db502e9bd463c8423f74bc6e0818e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:20.072194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5afdd129-3168-4741-b6d8-3f75a4816fd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '169db502e9bd463c8423f74bc6e0818e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:20.084891 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f96e3e-36ca-46c9-825e-4504b3a872b7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:20.085688 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5afdd129-3168-4741-b6d8-3f75a4816fd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '169db502e9bd463c8423f74bc6e0818e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:20.086671 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5afdd129-3168-4741-b6d8-3f75a4816fd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '169db502e9bd463c8423f74bc6e0818e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:20.094392 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be340bb1-ae87-4b7e-8fb1-a6843202b053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:20.095705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be340bb1-ae87-4b7e-8fb1-a6843202b053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:20.096737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be340bb1-ae87-4b7e-8fb1-a6843202b053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:20.098150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be340bb1-ae87-4b7e-8fb1-a6843202b053 admin admin] PATH_INFO: `/v3/projects/13f1dbb0cebe4a5d84a9b7560a8690b5` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:20.100636 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be340bb1-ae87-4b7e-8fb1-a6843202b053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13f1dbb0cebe4a5d84a9b7560a8690b5)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:20.106330 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be340bb1-ae87-4b7e-8fb1-a6843202b053 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:20.111033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5afdd129-3168-4741-b6d8-3f75a4816fd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '169db502e9bd463c8423f74bc6e0818e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:20.130989 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1020/1996] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:19 2022] DELETE /identity/v3/users/169db502e9bd463c8423f74bc6e0818e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:20.131991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3d129-1c43-4d9d-8f3d-6b50cc44708e None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:20.132345 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3d129-1c43-4d9d-8f3d-6b50cc44708e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:20.133996 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3d129-1c43-4d9d-8f3d-6b50cc44708e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:20.155179 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d6a3d129-1c43-4d9d-8f3d-6b50cc44708e None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:20.156466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d6a3d129-1c43-4d9d-8f3d-6b50cc44708e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:20.162606 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:20.208666 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-be340bb1-ae87-4b7e-8fb1-a6843202b053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13f1dbb0cebe4a5d84a9b7560a8690b5', 'request_id': 'req-be340bb1-ae87-4b7e-8fb1-a6843202b053'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:20.217758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-be340bb1-ae87-4b7e-8fb1-a6843202b053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13f1dbb0cebe4a5d84a9b7560a8690b5', 'request_id': 'req-be340bb1-ae87-4b7e-8fb1-a6843202b053'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:20.228718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-be340bb1-ae87-4b7e-8fb1-a6843202b053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13f1dbb0cebe4a5d84a9b7560a8690b5', 'request_id': 'req-be340bb1-ae87-4b7e-8fb1-a6843202b053'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:20.243531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-be340bb1-ae87-4b7e-8fb1-a6843202b053 admin admin] The token cache is being invalidate because project 13f1dbb0cebe4a5d84a9b7560a8690b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:20.244014 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-be340bb1-ae87-4b7e-8fb1-a6843202b053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:20.244832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-be340bb1-ae87-4b7e-8fb1-a6843202b053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:20.246898 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 977/1997] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:20 2022] DELETE /identity/v3/projects/13f1dbb0cebe4a5d84a9b7560a8690b5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:20.248202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e70263-e550-4812-8a21-b043d946f9f4 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:20.248548 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e70263-e550-4812-8a21-b043d946f9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:20.248886 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e70263-e550-4812-8a21-b043d946f9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:20.265033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1021/1998] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:20.266266 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ec319-c3a5-44b9-94a8-7d02e9431841 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:20.266559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ec319-c3a5-44b9-94a8-7d02e9431841 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:20.266841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ec319-c3a5-44b9-94a8-7d02e9431841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:20.286450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-37e70263-e550-4812-8a21-b043d946f9f4 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:20.289440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-37e70263-e550-4812-8a21-b043d946f9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:20.291971 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-113ec319-c3a5-44b9-94a8-7d02e9431841 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:20.293433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-113ec319-c3a5-44b9-94a8-7d02e9431841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:20.334160 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:20.395003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1022/1999] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:20.397074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cd431-fd42-4d7e-b8ae-d50369d02b98 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:20.397359 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cd431-fd42-4d7e-b8ae-d50369d02b98 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:20.397641 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cd431-fd42-4d7e-b8ae-d50369d02b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:20.406513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 978/2000] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:20.408669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c62a9c-0d09-41b7-892e-9d3ac826e120 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:20.408981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c62a9c-0d09-41b7-892e-9d3ac826e120 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:20.409227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c62a9c-0d09-41b7-892e-9d3ac826e120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:20.421360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-602cd431-fd42-4d7e-b8ae-d50369d02b98 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:20.423264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-602cd431-fd42-4d7e-b8ae-d50369d02b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:20.434336 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1023/2001] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:20.434627 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-63c62a9c-0d09-41b7-892e-9d3ac826e120 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:20.435721 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cd431-fd42-4d7e-b8ae-d50369d02b98 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:20.436497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-63c62a9c-0d09-41b7-892e-9d3ac826e120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:20.452781 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cd431-fd42-4d7e-b8ae-d50369d02b98 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:20.453721 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 979/2002] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:20.454877 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c62a9c-0d09-41b7-892e-9d3ac826e120 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:20.462660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736326f9-aa9a-4649-b854-82f1f14d2925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:20.465266 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736326f9-aa9a-4649-b854-82f1f14d2925 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:20.465757 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736326f9-aa9a-4649-b854-82f1f14d2925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:20.466511 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736326f9-aa9a-4649-b854-82f1f14d2925 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:20.467635 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736326f9-aa9a-4649-b854-82f1f14d2925 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:20.468096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736326f9-aa9a-4649-b854-82f1f14d2925 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:20.469535 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c62a9c-0d09-41b7-892e-9d3ac826e120 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:20.470307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736326f9-aa9a-4649-b854-82f1f14d2925 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:20.475861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bd0a0-4334-49b9-a0cb-7e24aece347e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:20.476715 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bd0a0-4334-49b9-a0cb-7e24aece347e admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:20.477186 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bd0a0-4334-49b9-a0cb-7e24aece347e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:20.477597 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bd0a0-4334-49b9-a0cb-7e24aece347e admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:20.478526 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bd0a0-4334-49b9-a0cb-7e24aece347e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:20.479016 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bd0a0-4334-49b9-a0cb-7e24aece347e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:20.481826 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bd0a0-4334-49b9-a0cb-7e24aece347e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:20.486368 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1024/2003] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:20.487183 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736326f9-aa9a-4649-b854-82f1f14d2925 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:20.496636 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 980/2004] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:20.497538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bd0a0-4334-49b9-a0cb-7e24aece347e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:20.502466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3e2bd0a0-4334-49b9-a0cb-7e24aece347e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:20.504960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736326f9-aa9a-4649-b854-82f1f14d2925 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:20.512885 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08e926-3680-49d2-91e8-77ea6c5753f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:20.513725 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08e926-3680-49d2-91e8-77ea6c5753f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:20.514143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08e926-3680-49d2-91e8-77ea6c5753f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:20.514597 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08e926-3680-49d2-91e8-77ea6c5753f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:20.515786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08e926-3680-49d2-91e8-77ea6c5753f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:20.516340 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08e926-3680-49d2-91e8-77ea6c5753f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:20.519209 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08e926-3680-49d2-91e8-77ea6c5753f9 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:20.542231 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1025/2005] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:20.543615 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b2e1f-1bea-4257-8e4c-9a058168e1da None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:20.543911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b2e1f-1bea-4257-8e4c-9a058168e1da None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:20.544221 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b2e1f-1bea-4257-8e4c-9a058168e1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:20.565424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a06b2e1f-1bea-4257-8e4c-9a058168e1da None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:20.566913 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a06b2e1f-1bea-4257-8e4c-9a058168e1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:20.575743 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1026/2006] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:20.576623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b2e1f-1bea-4257-8e4c-9a058168e1da None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:20.587788 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b2e1f-1bea-4257-8e4c-9a058168e1da None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:20.592803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1fca6-af11-4444-9974-369f5d4c5aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:20.593449 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1fca6-af11-4444-9974-369f5d4c5aae admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:20.593732 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1fca6-af11-4444-9974-369f5d4c5aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:20.594010 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1fca6-af11-4444-9974-369f5d4c5aae admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:20.594409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bd0a0-4334-49b9-a0cb-7e24aece347e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:20.594686 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1fca6-af11-4444-9974-369f5d4c5aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:20.596662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1fca6-af11-4444-9974-369f5d4c5aae admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:20.599234 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802ac93-a979-4ed8-9a0f-c6fc2540f854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:20.600108 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802ac93-a979-4ed8-9a0f-c6fc2540f854 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:20.600605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802ac93-a979-4ed8-9a0f-c6fc2540f854 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:20.600976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802ac93-a979-4ed8-9a0f-c6fc2540f854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:20.620371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802ac93-a979-4ed8-9a0f-c6fc2540f854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:20.624072 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802ac93-a979-4ed8-9a0f-c6fc2540f854 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:20.643214 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 981/2007] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:20.645404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802ac93-a979-4ed8-9a0f-c6fc2540f854 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:20.656514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1027/2008] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:20 2022] POST /identity/v3/projects => generated 393 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:20.658015 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1fca6-af11-4444-9974-369f5d4c5aae admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:20.671331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802ac93-a979-4ed8-9a0f-c6fc2540f854 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:20.765587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:20.786967 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1fca6-af11-4444-9974-369f5d4c5aae admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:20.792484 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1758e4-c580-4fd2-a285-de1c86c1399f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:20.793129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1758e4-c580-4fd2-a285-de1c86c1399f admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:20.793408 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1758e4-c580-4fd2-a285-de1c86c1399f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:20.793667 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1758e4-c580-4fd2-a285-de1c86c1399f admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:20.794453 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1758e4-c580-4fd2-a285-de1c86c1399f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:20.796425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1758e4-c580-4fd2-a285-de1c86c1399f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:20.799735 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe0ae2-14bf-44f3-b65f-59eef1d10f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:20.800827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe0ae2-14bf-44f3-b65f-59eef1d10f1c admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:20.801437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe0ae2-14bf-44f3-b65f-59eef1d10f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:20.802151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe0ae2-14bf-44f3-b65f-59eef1d10f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:20.803125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe0ae2-14bf-44f3-b65f-59eef1d10f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:20.805737 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe0ae2-14bf-44f3-b65f-59eef1d10f1c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:20.840406 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1028/2009] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:20 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:20.841500 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1758e4-c580-4fd2-a285-de1c86c1399f admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:20.865635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 982/2010] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:20 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:20.867227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe0ae2-14bf-44f3-b65f-59eef1d10f1c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:20.944704 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:20.963772 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1758e4-c580-4fd2-a285-de1c86c1399f admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:21.012291 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe0ae2-14bf-44f3-b65f-59eef1d10f1c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:21.022284 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c23e3-2bc9-49fb-ae39-6c7d02bc5486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:21.023473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c23e3-2bc9-49fb-ae39-6c7d02bc5486 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:21.023473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c23e3-2bc9-49fb-ae39-6c7d02bc5486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:21.023811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c23e3-2bc9-49fb-ae39-6c7d02bc5486 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:21.024431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c23e3-2bc9-49fb-ae39-6c7d02bc5486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:21.026404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c23e3-2bc9-49fb-ae39-6c7d02bc5486 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:21.063952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 983/2011] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:20 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:21.064797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c23e3-2bc9-49fb-ae39-6c7d02bc5486 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:21.078582 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c23e3-2bc9-49fb-ae39-6c7d02bc5486 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:21.081696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4b6f2-d46c-4ddd-90d8-1c67229d60f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:21.083235 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4b6f2-d46c-4ddd-90d8-1c67229d60f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:21.083675 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4b6f2-d46c-4ddd-90d8-1c67229d60f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:21.084145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4b6f2-d46c-4ddd-90d8-1c67229d60f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:21.084750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99cbd-a2c1-4e3d-a11e-60c49e9fd346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:21.085281 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4b6f2-d46c-4ddd-90d8-1c67229d60f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:21.085443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99cbd-a2c1-4e3d-a11e-60c49e9fd346 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:21.085689 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99cbd-a2c1-4e3d-a11e-60c49e9fd346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:21.085841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4b6f2-d46c-4ddd-90d8-1c67229d60f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:21.085973 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99cbd-a2c1-4e3d-a11e-60c49e9fd346 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:21.086752 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b99cbd-a2c1-4e3d-a11e-60c49e9fd346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:21.088260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4b6f2-d46c-4ddd-90d8-1c67229d60f1 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:21.089091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b99cbd-a2c1-4e3d-a11e-60c49e9fd346 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:21.106908 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1029/2012] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:21.108674 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4b6f2-d46c-4ddd-90d8-1c67229d60f1 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:21.127720 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 984/2013] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:21 2022] POST /identity/v3/users => generated 292 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:21.127720 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99cbd-a2c1-4e3d-a11e-60c49e9fd346 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:21.128006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4b6f2-d46c-4ddd-90d8-1c67229d60f1 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:21.135892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ac9b1-f838-476e-8873-d7c80af9a943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:21.136853 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ac9b1-f838-476e-8873-d7c80af9a943 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:21.137316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ac9b1-f838-476e-8873-d7c80af9a943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:21.137781 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ac9b1-f838-476e-8873-d7c80af9a943 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:21.139176 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ac9b1-f838-476e-8873-d7c80af9a943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:21.141996 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ac9b1-f838-476e-8873-d7c80af9a943 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:21.146476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99cbd-a2c1-4e3d-a11e-60c49e9fd346 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:21.153936 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47035a7d-6cab-477c-966c-bb3f2a694767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:21.154969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47035a7d-6cab-477c-966c-bb3f2a694767 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:21.155517 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47035a7d-6cab-477c-966c-bb3f2a694767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:21.156061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47035a7d-6cab-477c-966c-bb3f2a694767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:21.157069 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47035a7d-6cab-477c-966c-bb3f2a694767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:21.159826 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47035a7d-6cab-477c-966c-bb3f2a694767 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:21.185170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1030/2014] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:21 2022] POST /identity/v3/users => generated 293 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:21.185170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ac9b1-f838-476e-8873-d7c80af9a943 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:21.185479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 985/2015] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:21.185479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47035a7d-6cab-477c-966c-bb3f2a694767 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:21.200872 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47035a7d-6cab-477c-966c-bb3f2a694767 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:21.204267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ac9b1-f838-476e-8873-d7c80af9a943 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:21.208913 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3ce46-f8d8-437d-9a33-680c752a6b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:21.210019 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3ce46-f8d8-437d-9a33-680c752a6b0a admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:21.210575 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3ce46-f8d8-437d-9a33-680c752a6b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:21.211586 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3ce46-f8d8-437d-9a33-680c752a6b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:21.212255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3ce46-f8d8-437d-9a33-680c752a6b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:21.212912 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558ea34-421a-4928-a1d6-138ae77f57e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:21.214016 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558ea34-421a-4928-a1d6-138ae77f57e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:21.214602 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558ea34-421a-4928-a1d6-138ae77f57e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:21.215172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558ea34-421a-4928-a1d6-138ae77f57e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:21.215667 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3ce46-f8d8-437d-9a33-680c752a6b0a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:21.216719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558ea34-421a-4928-a1d6-138ae77f57e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:21.221594 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558ea34-421a-4928-a1d6-138ae77f57e5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:21.237377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 986/2016] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:21.237377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3ce46-f8d8-437d-9a33-680c752a6b0a admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:21.255517 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3ce46-f8d8-437d-9a33-680c752a6b0a admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:21.263507 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab83ac-e06c-4027-8a9d-b5bb63017249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:21.264797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab83ac-e06c-4027-8a9d-b5bb63017249 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:21.265777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab83ac-e06c-4027-8a9d-b5bb63017249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:21.266219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab83ac-e06c-4027-8a9d-b5bb63017249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:21.267545 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab83ac-e06c-4027-8a9d-b5bb63017249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:21.270867 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab83ac-e06c-4027-8a9d-b5bb63017249 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:21.277027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1031/2017] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:21 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:21.277027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558ea34-421a-4928-a1d6-138ae77f57e5 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:21.295622 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 987/2018] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:21.295622 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab83ac-e06c-4027-8a9d-b5bb63017249 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:21.311932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab83ac-e06c-4027-8a9d-b5bb63017249 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:21.356431 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:21.421291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558ea34-421a-4928-a1d6-138ae77f57e5 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:21.423243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc40c9e-2eea-48e3-97b4-507c300f517f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:21.423995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40c9e-2eea-48e3-97b4-507c300f517f admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:21.424323 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40c9e-2eea-48e3-97b4-507c300f517f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:21.424660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40c9e-2eea-48e3-97b4-507c300f517f admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:21.425549 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc40c9e-2eea-48e3-97b4-507c300f517f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:21.428089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc40c9e-2eea-48e3-97b4-507c300f517f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:21.432654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed92e7-d4a6-476e-b8ab-cccd3916a47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:21.433741 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed92e7-d4a6-476e-b8ab-cccd3916a47b admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:21.434329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed92e7-d4a6-476e-b8ab-cccd3916a47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:21.435668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed92e7-d4a6-476e-b8ab-cccd3916a47b admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:21.437422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed92e7-d4a6-476e-b8ab-cccd3916a47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:21.443576 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed92e7-d4a6-476e-b8ab-cccd3916a47b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:21.455633 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 988/2019] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:21.455633 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc40c9e-2eea-48e3-97b4-507c300f517f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:21.469905 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1032/2020] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:21.471490 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed92e7-d4a6-476e-b8ab-cccd3916a47b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:21.474195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc40c9e-2eea-48e3-97b4-507c300f517f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:21.482290 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c38a27-57df-4c4f-b5f5-d5d39c10f646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:21.483385 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c38a27-57df-4c4f-b5f5-d5d39c10f646 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:21.483836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c38a27-57df-4c4f-b5f5-d5d39c10f646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:21.484346 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c38a27-57df-4c4f-b5f5-d5d39c10f646 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:21.485124 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c38a27-57df-4c4f-b5f5-d5d39c10f646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:21.487445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c38a27-57df-4c4f-b5f5-d5d39c10f646 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:21.493652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed92e7-d4a6-476e-b8ab-cccd3916a47b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:21.499315 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff902274-7200-4c78-bb58-419930c43a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:21.500118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff902274-7200-4c78-bb58-419930c43a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:21.500452 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff902274-7200-4c78-bb58-419930c43a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:21.500737 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff902274-7200-4c78-bb58-419930c43a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:21.501452 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff902274-7200-4c78-bb58-419930c43a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:21.503109 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff902274-7200-4c78-bb58-419930c43a32 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:21.521045 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 989/2022] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:21 2022] POST /identity/v3/users => generated 286 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:21.521317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1033/2022] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:21.525153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c38a27-57df-4c4f-b5f5-d5d39c10f646 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:21.526081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff902274-7200-4c78-bb58-419930c43a32 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:21.527247 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b3c38a27-57df-4c4f-b5f5-d5d39c10f646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:21.542520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c38a27-57df-4c4f-b5f5-d5d39c10f646 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:21.549131 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff902274-7200-4c78-bb58-419930c43a32 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:21.551979 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb889d-3871-4778-8c31-0b7b3c9a2afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:21.552711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb889d-3871-4778-8c31-0b7b3c9a2afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:21.553001 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb889d-3871-4778-8c31-0b7b3c9a2afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:21.553363 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb889d-3871-4778-8c31-0b7b3c9a2afc admin admin] PATH_INFO: `/v3/projects/3df698c7a78f4084b3d6e90be7ac285f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:21.554633 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb889d-3871-4778-8c31-0b7b3c9a2afc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df698c7a78f4084b3d6e90be7ac285f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:21.556761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb889d-3871-4778-8c31-0b7b3c9a2afc admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:21.560233 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8ef43-0648-44c4-ae8b-a90984e3cc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:21.561223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8ef43-0648-44c4-ae8b-a90984e3cc0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:21.561725 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8ef43-0648-44c4-ae8b-a90984e3cc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:21.562213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8ef43-0648-44c4-ae8b-a90984e3cc0e admin admin] PATH_INFO: `/v3/projects/c899a879a87f4d199e65171a96109f27/users/7c75d546b7214be6a34347d09ee8ebbb/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:21.595789 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8ef43-0648-44c4-ae8b-a90984e3cc0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c899a879a87f4d199e65171a96109f27, user_id=7c75d546b7214be6a34347d09ee8ebbb, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:21.603086 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8ef43-0648-44c4-ae8b-a90984e3cc0e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:21.646254 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1034/2023] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:21 2022] PUT /identity/v3/projects/c899a879a87f4d199e65171a96109f27/users/7c75d546b7214be6a34347d09ee8ebbb/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:21.647856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8ef43-0648-44c4-ae8b-a90984e3cc0e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:21.656295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=88,keystone:INSERT=9,keystone:DELETE=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:21.665301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f7fb889d-3871-4778-8c31-0b7b3c9a2afc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df698c7a78f4084b3d6e90be7ac285f', 'request_id': 'req-f7fb889d-3871-4778-8c31-0b7b3c9a2afc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:21.683295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f7fb889d-3871-4778-8c31-0b7b3c9a2afc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df698c7a78f4084b3d6e90be7ac285f', 'request_id': 'req-f7fb889d-3871-4778-8c31-0b7b3c9a2afc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:21.718394 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f7fb889d-3871-4778-8c31-0b7b3c9a2afc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df698c7a78f4084b3d6e90be7ac285f', 'request_id': 'req-f7fb889d-3871-4778-8c31-0b7b3c9a2afc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:21.741948 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f7fb889d-3871-4778-8c31-0b7b3c9a2afc admin admin] The token cache is being invalidate because project 3df698c7a78f4084b3d6e90be7ac285f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:21.742267 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f7fb889d-3871-4778-8c31-0b7b3c9a2afc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:21.743206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f7fb889d-3871-4778-8c31-0b7b3c9a2afc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:21.745335 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 990/2024] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:21 2022] DELETE /identity/v3/projects/3df698c7a78f4084b3d6e90be7ac285f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:21.746208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb889d-3871-4778-8c31-0b7b3c9a2afc admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:21.751556 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f7fb889d-3871-4778-8c31-0b7b3c9a2afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:21.841574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8ef43-0648-44c4-ae8b-a90984e3cc0e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:21.854125 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001872e1-c9ad-472a-903b-eb4be6b86a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:21.855810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001872e1-c9ad-472a-903b-eb4be6b86a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:21.856660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001872e1-c9ad-472a-903b-eb4be6b86a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:21.857607 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001872e1-c9ad-472a-903b-eb4be6b86a24 admin admin] PATH_INFO: `/v3/projects/5b58be56a4274736a7b7aaa8025bbd4a/users/062e1942bb5a4ddea217e6eda725b140/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:21.866216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb889d-3871-4778-8c31-0b7b3c9a2afc admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:21.876108 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab420c63-0e04-40aa-b109-d1a7b5ad97b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:21.876932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab420c63-0e04-40aa-b109-d1a7b5ad97b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:21.877343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab420c63-0e04-40aa-b109-d1a7b5ad97b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:21.877632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab420c63-0e04-40aa-b109-d1a7b5ad97b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:21.878348 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab420c63-0e04-40aa-b109-d1a7b5ad97b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:21.881363 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab420c63-0e04-40aa-b109-d1a7b5ad97b2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:21.892579 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001872e1-c9ad-472a-903b-eb4be6b86a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b58be56a4274736a7b7aaa8025bbd4a, user_id=062e1942bb5a4ddea217e6eda725b140, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:21.898806 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 991/2025] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:21.899347 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001872e1-c9ad-472a-903b-eb4be6b86a24 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:21.899788 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab420c63-0e04-40aa-b109-d1a7b5ad97b2 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:21.902501 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ab420c63-0e04-40aa-b109-d1a7b5ad97b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:21.925132 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1035/2026] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:21 2022] PUT /identity/v3/projects/5b58be56a4274736a7b7aaa8025bbd4a/users/062e1942bb5a4ddea217e6eda725b140/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:21.928038 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f96961-1ad2-4af7-9b40-02d182bfa842 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:21.928593 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f96961-1ad2-4af7-9b40-02d182bfa842 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:21.929177 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f96961-1ad2-4af7-9b40-02d182bfa842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:21.933982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab420c63-0e04-40aa-b109-d1a7b5ad97b2 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:21.984589 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-72f96961-1ad2-4af7-9b40-02d182bfa842 None None] MFA Rules not processed for user `7c75d546b7214be6a34347d09ee8ebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:21.989109 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-72f96961-1ad2-4af7-9b40-02d182bfa842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:22.015805 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16901711-5eca-488e-9d65-1625ba1c3859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:22.016756 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16901711-5eca-488e-9d65-1625ba1c3859 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:22.017150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16901711-5eca-488e-9d65-1625ba1c3859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:22.017640 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16901711-5eca-488e-9d65-1625ba1c3859 admin admin] PATH_INFO: `/v3/projects/7adf3947c8214ba7a8b740370cb1e1ad/users/866eb77af0374031a2b58efb85cea6eb/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:22.039460 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16901711-5eca-488e-9d65-1625ba1c3859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7adf3947c8214ba7a8b740370cb1e1ad, user_id=866eb77af0374031a2b58efb85cea6eb, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:22.042400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16901711-5eca-488e-9d65-1625ba1c3859 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:22.061126 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 992/2027] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:21 2022] PUT /identity/v3/projects/7adf3947c8214ba7a8b740370cb1e1ad/users/866eb77af0374031a2b58efb85cea6eb/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:22.062115 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16901711-5eca-488e-9d65-1625ba1c3859 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:22.063845 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-16901711-5eca-488e-9d65-1625ba1c3859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:22.149083 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1036/2028] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:22.150425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f96961-1ad2-4af7-9b40-02d182bfa842 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:22.160684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:22.169934 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f96961-1ad2-4af7-9b40-02d182bfa842 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:22.175152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddb400-baa4-47ba-982d-a48637a36327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:22.176804 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddb400-baa4-47ba-982d-a48637a36327 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:22.177093 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddb400-baa4-47ba-982d-a48637a36327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:22.177422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddb400-baa4-47ba-982d-a48637a36327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:22.178249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feddb400-baa4-47ba-982d-a48637a36327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:22.179910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feddb400-baa4-47ba-982d-a48637a36327 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:22.182949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16901711-5eca-488e-9d65-1625ba1c3859 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:22.183138 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:22.191668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f975c-5697-459d-9bbd-e1464026d658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:22.192454 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f975c-5697-459d-9bbd-e1464026d658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:22.192779 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f975c-5697-459d-9bbd-e1464026d658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:22.193084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f975c-5697-459d-9bbd-e1464026d658 admin admin] PATH_INFO: `/v3/users/5b6d4676048d4ddf9136ca13a8e8a4f7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:22.194595 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1037/2029] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:22.196418 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7f680-6684-4f22-88ff-9630aa970416 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:22.197690 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7f680-6684-4f22-88ff-9630aa970416 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:22.197932 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7f680-6684-4f22-88ff-9630aa970416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:22.199679 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f975c-5697-459d-9bbd-e1464026d658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6d4676048d4ddf9136ca13a8e8a4f7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:22.203671 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f975c-5697-459d-9bbd-e1464026d658 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:22.234272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f2a7f680-6684-4f22-88ff-9630aa970416 None None] MFA Rules not processed for user `062e1942bb5a4ddea217e6eda725b140`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:22.235691 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f2a7f680-6684-4f22-88ff-9630aa970416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:22.306333 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c74f975c-5697-459d-9bbd-e1464026d658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6d4676048d4ddf9136ca13a8e8a4f7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:22.307769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c74f975c-5697-459d-9bbd-e1464026d658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6d4676048d4ddf9136ca13a8e8a4f7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:22.321850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c74f975c-5697-459d-9bbd-e1464026d658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6d4676048d4ddf9136ca13a8e8a4f7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:22.338022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1038/2030] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:22.338022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ad8ce-e4d8-4ab0-846e-7ca4d233fb87 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:22.338022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ad8ce-e4d8-4ab0-846e-7ca4d233fb87 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:22.338022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ad8ce-e4d8-4ab0-846e-7ca4d233fb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:22.345330 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c74f975c-5697-459d-9bbd-e1464026d658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6d4676048d4ddf9136ca13a8e8a4f7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:22.358834 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c74f975c-5697-459d-9bbd-e1464026d658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6d4676048d4ddf9136ca13a8e8a4f7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:22.371428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 993/2031] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:22 2022] DELETE /identity/v3/users/5b6d4676048d4ddf9136ca13a8e8a4f7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:22.376216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f975c-5697-459d-9bbd-e1464026d658 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:22.378523 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c74f975c-5697-459d-9bbd-e1464026d658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:22.383564 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6d1ad8ce-e4d8-4ab0-846e-7ca4d233fb87 None None] MFA Rules not processed for user `866eb77af0374031a2b58efb85cea6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:22.386971 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6d1ad8ce-e4d8-4ab0-846e-7ca4d233fb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:22.531639 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f975c-5697-459d-9bbd-e1464026d658 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:22.538812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6807914-744b-474f-8975-ee7ca71201bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:22.539966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6807914-744b-474f-8975-ee7ca71201bc admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:22.540479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6807914-744b-474f-8975-ee7ca71201bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:22.543625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6807914-744b-474f-8975-ee7ca71201bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:22.544476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6807914-744b-474f-8975-ee7ca71201bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:22.546712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6807914-744b-474f-8975-ee7ca71201bc admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:22.551508 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1039/2032] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:22.553551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ad8ce-e4d8-4ab0-846e-7ca4d233fb87 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:22.556010 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6d1ad8ce-e4d8-4ab0-846e-7ca4d233fb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:22.580862 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ad8ce-e4d8-4ab0-846e-7ca4d233fb87 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:22.591488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 994/2033] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:22 2022] POST /identity/v3/projects => generated 381 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:22.591488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6807914-744b-474f-8975-ee7ca71201bc admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:22.597398 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c6807914-744b-474f-8975-ee7ca71201bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:22.600988 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa85ea-cf71-4e80-a1f3-78a184f59366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:22.601704 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa85ea-cf71-4e80-a1f3-78a184f59366 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:22.601983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa85ea-cf71-4e80-a1f3-78a184f59366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:22.602260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa85ea-cf71-4e80-a1f3-78a184f59366 admin admin] PATH_INFO: `/v3/projects/2c9addf0cf4f4f47953a878fabdde91e/users/0067ac43b76b438da40c87e69ec78923/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:22.641410 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa85ea-cf71-4e80-a1f3-78a184f59366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9addf0cf4f4f47953a878fabdde91e, user_id=0067ac43b76b438da40c87e69ec78923, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:22.647027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa85ea-cf71-4e80-a1f3-78a184f59366 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:22.669393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1040/2034] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:22 2022] PUT /identity/v3/projects/2c9addf0cf4f4f47953a878fabdde91e/users/0067ac43b76b438da40c87e69ec78923/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:22.670754 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa85ea-cf71-4e80-a1f3-78a184f59366 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:22.673607 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-17fa85ea-cf71-4e80-a1f3-78a184f59366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:22.737525 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:22.745651 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6807914-744b-474f-8975-ee7ca71201bc admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:22.771337 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa85ea-cf71-4e80-a1f3-78a184f59366 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:22.780033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78dbee-aae1-4f2c-901e-873eb62f1c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:22.781119 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78dbee-aae1-4f2c-901e-873eb62f1c81 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:22.781408 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78dbee-aae1-4f2c-901e-873eb62f1c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:22.781683 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78dbee-aae1-4f2c-901e-873eb62f1c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:22.794810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:22.868384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43915160-c616-4633-af35-5333283d049e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:22.869763 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43915160-c616-4633-af35-5333283d049e admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:22.870338 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43915160-c616-4633-af35-5333283d049e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:22.870986 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43915160-c616-4633-af35-5333283d049e admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:22.872515 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43915160-c616-4633-af35-5333283d049e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:22.876334 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43915160-c616-4633-af35-5333283d049e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:22.884777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78dbee-aae1-4f2c-901e-873eb62f1c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:22.885764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78dbee-aae1-4f2c-901e-873eb62f1c81 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:22.899392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1041/2035] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:22.900515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78dbee-aae1-4f2c-901e-873eb62f1c81 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:22.916403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78dbee-aae1-4f2c-901e-873eb62f1c81 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:22.925009 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4d486-0d7a-4405-ab71-cff1c46a0641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:22.929924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4d486-0d7a-4405-ab71-cff1c46a0641 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:22.930292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4d486-0d7a-4405-ab71-cff1c46a0641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:22.930942 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4d486-0d7a-4405-ab71-cff1c46a0641 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:22.932219 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4d486-0d7a-4405-ab71-cff1c46a0641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:22.935460 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4d486-0d7a-4405-ab71-cff1c46a0641 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:22.940227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 995/2036] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:22 2022] POST /identity/v3/projects => generated 391 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:22.941703 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ea066-107c-4193-a4ca-55c01470ff3d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:22.942357 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ea066-107c-4193-a4ca-55c01470ff3d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:22.942887 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ea066-107c-4193-a4ca-55c01470ff3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:22.963127 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1042/2037] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:22 2022] POST /identity/v3/users => generated 297 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:22.964700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4d486-0d7a-4405-ab71-cff1c46a0641 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:22.967130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-31a4d486-0d7a-4405-ab71-cff1c46a0641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:22.977201 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-384ea066-107c-4193-a4ca-55c01470ff3d None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:22.979282 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-384ea066-107c-4193-a4ca-55c01470ff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:22.982100 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4d486-0d7a-4405-ab71-cff1c46a0641 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:23.074638 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463919e0-5972-43ec-b5cf-6f0e5c4fcc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:23.075313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463919e0-5972-43ec-b5cf-6f0e5c4fcc53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:23.075601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463919e0-5972-43ec-b5cf-6f0e5c4fcc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:23.075879 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463919e0-5972-43ec-b5cf-6f0e5c4fcc53 admin admin] PATH_INFO: `/v3/projects/8ed4838014ff4bce98e02d8f85d771ea` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:23.076631 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 996/2038] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:23.077876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463919e0-5972-43ec-b5cf-6f0e5c4fcc53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed4838014ff4bce98e02d8f85d771ea)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:23.078026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ea066-107c-4193-a4ca-55c01470ff3d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:23.079727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-384ea066-107c-4193-a4ca-55c01470ff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:23.082821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463919e0-5972-43ec-b5cf-6f0e5c4fcc53 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:23.101629 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ea066-107c-4193-a4ca-55c01470ff3d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:23.109077 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7464e-0603-4d75-b318-85783d5269b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:23.110184 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7464e-0603-4d75-b318-85783d5269b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:23.110512 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7464e-0603-4d75-b318-85783d5269b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:23.110790 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7464e-0603-4d75-b318-85783d5269b9 admin admin] PATH_INFO: `/v3/users/866eb77af0374031a2b58efb85cea6eb` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:23.112322 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7464e-0603-4d75-b318-85783d5269b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=866eb77af0374031a2b58efb85cea6eb)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:23.116041 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7464e-0603-4d75-b318-85783d5269b9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:23.148303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-463919e0-5972-43ec-b5cf-6f0e5c4fcc53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed4838014ff4bce98e02d8f85d771ea', 'request_id': 'req-463919e0-5972-43ec-b5cf-6f0e5c4fcc53'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:23.158220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-463919e0-5972-43ec-b5cf-6f0e5c4fcc53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed4838014ff4bce98e02d8f85d771ea', 'request_id': 'req-463919e0-5972-43ec-b5cf-6f0e5c4fcc53'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:23.173687 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-463919e0-5972-43ec-b5cf-6f0e5c4fcc53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed4838014ff4bce98e02d8f85d771ea', 'request_id': 'req-463919e0-5972-43ec-b5cf-6f0e5c4fcc53'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:23.179962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ebb7464e-0603-4d75-b318-85783d5269b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '866eb77af0374031a2b58efb85cea6eb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:23.180730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ebb7464e-0603-4d75-b318-85783d5269b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '866eb77af0374031a2b58efb85cea6eb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:23.189865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ebb7464e-0603-4d75-b318-85783d5269b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '866eb77af0374031a2b58efb85cea6eb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:23.191457 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-463919e0-5972-43ec-b5cf-6f0e5c4fcc53 admin admin] The token cache is being invalidate because project 8ed4838014ff4bce98e02d8f85d771ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:23.191753 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-463919e0-5972-43ec-b5cf-6f0e5c4fcc53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:23.192489 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-463919e0-5972-43ec-b5cf-6f0e5c4fcc53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:23.194879 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1043/2039] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:22 2022] DELETE /identity/v3/projects/8ed4838014ff4bce98e02d8f85d771ea => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:23.198279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463919e0-5972-43ec-b5cf-6f0e5c4fcc53 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:23.198707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-463919e0-5972-43ec-b5cf-6f0e5c4fcc53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:23.214604 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ebb7464e-0603-4d75-b318-85783d5269b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '866eb77af0374031a2b58efb85cea6eb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:23.226778 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ebb7464e-0603-4d75-b318-85783d5269b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '866eb77af0374031a2b58efb85cea6eb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:23.233585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:23.235451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 997/2040] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:23 2022] DELETE /identity/v3/users/866eb77af0374031a2b58efb85cea6eb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:23.236596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7464e-0603-4d75-b318-85783d5269b9 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:23.239124 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ebb7464e-0603-4d75-b318-85783d5269b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:23.247564 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:23.300033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463919e0-5972-43ec-b5cf-6f0e5c4fcc53 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:23.334458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7464e-0603-4d75-b318-85783d5269b9 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:23.339675 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e2e63-9890-468e-8d5e-15ef32a9d113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:23.340371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e2e63-9890-468e-8d5e-15ef32a9d113 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:23.340658 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e2e63-9890-468e-8d5e-15ef32a9d113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:23.340946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e2e63-9890-468e-8d5e-15ef32a9d113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:23.341668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e2e63-9890-468e-8d5e-15ef32a9d113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:23.343692 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e2e63-9890-468e-8d5e-15ef32a9d113 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:23.361911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 998/2041] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:23.361911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e2e63-9890-468e-8d5e-15ef32a9d113 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:23.361911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-297e2e63-9890-468e-8d5e-15ef32a9d113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:23.377384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d664bd7-753e-4685-9910-2e41b6a426f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:23.378213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d664bd7-753e-4685-9910-2e41b6a426f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:23.378544 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d664bd7-753e-4685-9910-2e41b6a426f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:23.379171 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d664bd7-753e-4685-9910-2e41b6a426f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:23.379663 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d664bd7-753e-4685-9910-2e41b6a426f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:23.381775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d664bd7-753e-4685-9910-2e41b6a426f5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:23.413168 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1044/2042] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:23 2022] POST /identity/v3/users => generated 302 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:23.414456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d664bd7-753e-4685-9910-2e41b6a426f5 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:23.416500 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0d664bd7-753e-4685-9910-2e41b6a426f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:23.437270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d664bd7-753e-4685-9910-2e41b6a426f5 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:23.450367 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e2e63-9890-468e-8d5e-15ef32a9d113 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:23.453295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de372e8-e45a-46d4-8ad1-ce2102ddc807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:23.454180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de372e8-e45a-46d4-8ad1-ce2102ddc807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:23.454630 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de372e8-e45a-46d4-8ad1-ce2102ddc807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:23.455113 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91378081-f53d-4136-971f-a01cea14be24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:23.455325 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de372e8-e45a-46d4-8ad1-ce2102ddc807 admin admin] PATH_INFO: `/v3/users/9d1f42f86a3f45ab8b186dba9e4c124a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:23.455918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91378081-f53d-4136-971f-a01cea14be24 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:23.456355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91378081-f53d-4136-971f-a01cea14be24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:23.456674 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de372e8-e45a-46d4-8ad1-ce2102ddc807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d1f42f86a3f45ab8b186dba9e4c124a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:23.457881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91378081-f53d-4136-971f-a01cea14be24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:23.459720 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de372e8-e45a-46d4-8ad1-ce2102ddc807 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:23.459911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-91378081-f53d-4136-971f-a01cea14be24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:23.477753 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91378081-f53d-4136-971f-a01cea14be24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:23.480351 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91378081-f53d-4136-971f-a01cea14be24 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:23.497900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 999/2043] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:23.499843 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff12401-97a2-4512-baa3-0eb6d186ae41 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:23.500497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff12401-97a2-4512-baa3-0eb6d186ae41 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:23.500983 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff12401-97a2-4512-baa3-0eb6d186ae41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:23.530547 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-fff12401-97a2-4512-baa3-0eb6d186ae41 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:23.533228 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fff12401-97a2-4512-baa3-0eb6d186ae41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:23.548694 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4de372e8-e45a-46d4-8ad1-ce2102ddc807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d1f42f86a3f45ab8b186dba9e4c124a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:23.548976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1000/2044] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:23.549717 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4de372e8-e45a-46d4-8ad1-ce2102ddc807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d1f42f86a3f45ab8b186dba9e4c124a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:23.550587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff12401-97a2-4512-baa3-0eb6d186ae41 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:23.553746 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fff12401-97a2-4512-baa3-0eb6d186ae41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:23.573738 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4de372e8-e45a-46d4-8ad1-ce2102ddc807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d1f42f86a3f45ab8b186dba9e4c124a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:23.574945 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4de372e8-e45a-46d4-8ad1-ce2102ddc807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d1f42f86a3f45ab8b186dba9e4c124a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:23.578373 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff12401-97a2-4512-baa3-0eb6d186ae41 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:23.589440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c45cbc-3e71-4fdd-b35e-639455181867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:23.591286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c45cbc-3e71-4fdd-b35e-639455181867 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:23.591765 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c45cbc-3e71-4fdd-b35e-639455181867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:23.592863 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c45cbc-3e71-4fdd-b35e-639455181867 admin admin] PATH_INFO: `/v3/projects/3cf7b42973ed4ab4b37d272606819768/users/f9d556fe812543aa92b084bbbed6f1bb/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:23.602262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4de372e8-e45a-46d4-8ad1-ce2102ddc807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d1f42f86a3f45ab8b186dba9e4c124a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:23.626938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c45cbc-3e71-4fdd-b35e-639455181867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf7b42973ed4ab4b37d272606819768, user_id=f9d556fe812543aa92b084bbbed6f1bb, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:23.634860 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c45cbc-3e71-4fdd-b35e-639455181867 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:23.639578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1045/2045] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:23 2022] DELETE /identity/v3/users/9d1f42f86a3f45ab8b186dba9e4c124a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:23.640979 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de372e8-e45a-46d4-8ad1-ce2102ddc807 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:23.645374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4de372e8-e45a-46d4-8ad1-ce2102ddc807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:23.666365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1001/2046] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:23 2022] PUT /identity/v3/projects/3cf7b42973ed4ab4b37d272606819768/users/f9d556fe812543aa92b084bbbed6f1bb/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:23.668031 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c45cbc-3e71-4fdd-b35e-639455181867 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:23.671154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-79c45cbc-3e71-4fdd-b35e-639455181867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:23.723705 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:23.777294 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c45cbc-3e71-4fdd-b35e-639455181867 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:23.784071 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cbd03-4eaa-4dac-a910-f46527cb2cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:23.785422 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cbd03-4eaa-4dac-a910-f46527cb2cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:23.786847 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cbd03-4eaa-4dac-a910-f46527cb2cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:23.786847 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cbd03-4eaa-4dac-a910-f46527cb2cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:23.790453 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f29cbd03-4eaa-4dac-a910-f46527cb2cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:23.805457 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de372e8-e45a-46d4-8ad1-ce2102ddc807 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:23.851243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:23.926492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29cbd03-4eaa-4dac-a910-f46527cb2cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:23.928236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29cbd03-4eaa-4dac-a910-f46527cb2cc2 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:23.941039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1002/2047] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:23.942571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cbd03-4eaa-4dac-a910-f46527cb2cc2 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:23.944669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f29cbd03-4eaa-4dac-a910-f46527cb2cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:23.962048 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cbd03-4eaa-4dac-a910-f46527cb2cc2 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:23.964146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb7a57-4308-4f89-a9cf-e6bb339db67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:23.966886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb7a57-4308-4f89-a9cf-e6bb339db67d admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:23.967889 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb7a57-4308-4f89-a9cf-e6bb339db67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:23.969932 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb7a57-4308-4f89-a9cf-e6bb339db67d admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:23.970212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929deba-ca59-410a-bcda-ee42b024b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:23.970832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929deba-ca59-410a-bcda-ee42b024b754 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:23.971032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929deba-ca59-410a-bcda-ee42b024b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:23.971495 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929deba-ca59-410a-bcda-ee42b024b754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:23.972374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929deba-ca59-410a-bcda-ee42b024b754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:23.975192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929deba-ca59-410a-bcda-ee42b024b754 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:23.977854 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb7a57-4308-4f89-a9cf-e6bb339db67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:23.984671 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb7a57-4308-4f89-a9cf-e6bb339db67d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:23.993212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1003/2048] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:23.999349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929deba-ca59-410a-bcda-ee42b024b754 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:24.013657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1046/2049] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:24.019099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb7a57-4308-4f89-a9cf-e6bb339db67d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:24.031438 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929deba-ca59-410a-bcda-ee42b024b754 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:24.049309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75533a3-3595-48de-b035-3b030dc00908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:24.052018 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb7a57-4308-4f89-a9cf-e6bb339db67d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:24.052994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75533a3-3595-48de-b035-3b030dc00908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:24.053946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75533a3-3595-48de-b035-3b030dc00908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:24.054570 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75533a3-3595-48de-b035-3b030dc00908 admin admin] PATH_INFO: `/v3/projects/3cf7b42973ed4ab4b37d272606819768/users/f9d556fe812543aa92b084bbbed6f1bb/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:24.059877 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75533a3-3595-48de-b035-3b030dc00908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf7b42973ed4ab4b37d272606819768, user_id=f9d556fe812543aa92b084bbbed6f1bb, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:24.068775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75533a3-3595-48de-b035-3b030dc00908 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:24.082834 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a315e0-1cc9-469e-83cb-8fe73ac0e94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:24.088030 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a315e0-1cc9-469e-83cb-8fe73ac0e94a admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:24.089042 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a315e0-1cc9-469e-83cb-8fe73ac0e94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:24.090587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a315e0-1cc9-469e-83cb-8fe73ac0e94a admin admin] PATH_INFO: `/v3/projects/1c6c906aa7354ccab0b2999e4eee4cf3/users/0d44f2b3b6d24c6cb8386c993a252c83/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:24.100286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1004/2050] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:23 2022] PUT /identity/v3/projects/3cf7b42973ed4ab4b37d272606819768/users/f9d556fe812543aa92b084bbbed6f1bb/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:26:24.109026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd8c3a-ce64-4066-8751-4171fed8e77d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:24.109615 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd8c3a-ce64-4066-8751-4171fed8e77d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:24.109937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd8c3a-ce64-4066-8751-4171fed8e77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:24.187715 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a315e0-1cc9-469e-83cb-8fe73ac0e94a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6c906aa7354ccab0b2999e4eee4cf3, user_id=0d44f2b3b6d24c6cb8386c993a252c83, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:24.194124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a315e0-1cc9-469e-83cb-8fe73ac0e94a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:24.237511 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-f2fd8c3a-ce64-4066-8751-4171fed8e77d None None] MFA Rules not processed for user `f9d556fe812543aa92b084bbbed6f1bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:24.240313 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f2fd8c3a-ce64-4066-8751-4171fed8e77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:24.241318 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1047/2051] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:24 2022] PUT /identity/v3/projects/1c6c906aa7354ccab0b2999e4eee4cf3/users/0d44f2b3b6d24c6cb8386c993a252c83/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:26:24.248050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a315e0-1cc9-469e-83cb-8fe73ac0e94a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:24.458568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a315e0-1cc9-469e-83cb-8fe73ac0e94a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:24.470591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6688f-9b82-4e5d-a9db-38c61afc02d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:24.471620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6688f-9b82-4e5d-a9db-38c61afc02d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:24.472099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6688f-9b82-4e5d-a9db-38c61afc02d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:24.473170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6688f-9b82-4e5d-a9db-38c61afc02d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:24.474923 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6688f-9b82-4e5d-a9db-38c61afc02d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:24.477996 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6688f-9b82-4e5d-a9db-38c61afc02d2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:24.507174 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1048/2052] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:26:24.513710 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6688f-9b82-4e5d-a9db-38c61afc02d2 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:24.533342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6688f-9b82-4e5d-a9db-38c61afc02d2 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:24.540941 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dea849-686f-43c2-9b18-928334098235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:24.542306 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dea849-686f-43c2-9b18-928334098235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:24.543036 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dea849-686f-43c2-9b18-928334098235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:24.543684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dea849-686f-43c2-9b18-928334098235 admin admin] PATH_INFO: `/v3/projects/1c6c906aa7354ccab0b2999e4eee4cf3/users/0d44f2b3b6d24c6cb8386c993a252c83/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:24.548508 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dea849-686f-43c2-9b18-928334098235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6c906aa7354ccab0b2999e4eee4cf3, user_id=0d44f2b3b6d24c6cb8386c993a252c83, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:24.559985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1005/2053] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:24.560306 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dea849-686f-43c2-9b18-928334098235 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:24.572717 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd8c3a-ce64-4066-8751-4171fed8e77d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:24.589364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f2fd8c3a-ce64-4066-8751-4171fed8e77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:24.600037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1049/2054] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:24 2022] PUT /identity/v3/projects/1c6c906aa7354ccab0b2999e4eee4cf3/users/0d44f2b3b6d24c6cb8386c993a252c83/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:24.619621 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b7a10-1f26-48cf-a963-ff7a07d2f7f0 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:24.620105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b7a10-1f26-48cf-a963-ff7a07d2f7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:24.620648 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b7a10-1f26-48cf-a963-ff7a07d2f7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:24.710364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-740b7a10-1f26-48cf-a963-ff7a07d2f7f0 None None] MFA Rules not processed for user `0d44f2b3b6d24c6cb8386c993a252c83`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:24.711772 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-740b7a10-1f26-48cf-a963-ff7a07d2f7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:24.766017 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:24.780003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd8c3a-ce64-4066-8751-4171fed8e77d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:24.855383 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1050/2055] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:24 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:24.855383 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b7a10-1f26-48cf-a963-ff7a07d2f7f0 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:24.855383 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-740b7a10-1f26-48cf-a963-ff7a07d2f7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:24.886429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:24.948234 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b2478-e925-419c-a843-04accd6a9c3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:24.950416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b2478-e925-419c-a843-04accd6a9c3b service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:24.951328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b2478-e925-419c-a843-04accd6a9c3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:24.952594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b2478-e925-419c-a843-04accd6a9c3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:24.958079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b7a10-1f26-48cf-a963-ff7a07d2f7f0 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:24.967567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed85fbf-a8e4-45e3-a8dc-eb781f097ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:24.969278 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed85fbf-a8e4-45e3-a8dc-eb781f097ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:24.969473 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed85fbf-a8e4-45e3-a8dc-eb781f097ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:24.970062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed85fbf-a8e4-45e3-a8dc-eb781f097ac5 admin admin] PATH_INFO: `/v3/projects/7adf3947c8214ba7a8b740370cb1e1ad` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:24.972352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed85fbf-a8e4-45e3-a8dc-eb781f097ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7adf3947c8214ba7a8b740370cb1e1ad)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:24.977985 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed85fbf-a8e4-45e3-a8dc-eb781f097ac5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:25.054910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b2478-e925-419c-a843-04accd6a9c3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:25.056743 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b2478-e925-419c-a843-04accd6a9c3b service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:25.067442 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1ed85fbf-a8e4-45e3-a8dc-eb781f097ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7adf3947c8214ba7a8b740370cb1e1ad', 'request_id': 'req-1ed85fbf-a8e4-45e3-a8dc-eb781f097ac5'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:25.073883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1006/2056] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:25.075513 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1ed85fbf-a8e4-45e3-a8dc-eb781f097ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7adf3947c8214ba7a8b740370cb1e1ad', 'request_id': 'req-1ed85fbf-a8e4-45e3-a8dc-eb781f097ac5'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:25.079399 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b2478-e925-419c-a843-04accd6a9c3b service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:25.081271 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d41b2478-e925-419c-a843-04accd6a9c3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:25.086869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1ed85fbf-a8e4-45e3-a8dc-eb781f097ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7adf3947c8214ba7a8b740370cb1e1ad', 'request_id': 'req-1ed85fbf-a8e4-45e3-a8dc-eb781f097ac5'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:25.101740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1ed85fbf-a8e4-45e3-a8dc-eb781f097ac5 admin admin] The token cache is being invalidate because project 7adf3947c8214ba7a8b740370cb1e1ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:25.102129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1ed85fbf-a8e4-45e3-a8dc-eb781f097ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:25.102657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1ed85fbf-a8e4-45e3-a8dc-eb781f097ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:25.109714 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1051/2057] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:24 2022] DELETE /identity/v3/projects/7adf3947c8214ba7a8b740370cb1e1ad => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:25.109714 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed85fbf-a8e4-45e3-a8dc-eb781f097ac5 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:25.109714 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1ed85fbf-a8e4-45e3-a8dc-eb781f097ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:25.110208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b2478-e925-419c-a843-04accd6a9c3b service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:25.199962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46676670-af0e-4da8-b924-e5fd0e9cbbce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:25.200496 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46676670-af0e-4da8-b924-e5fd0e9cbbce service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:25.200781 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46676670-af0e-4da8-b924-e5fd0e9cbbce service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:25.201284 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46676670-af0e-4da8-b924-e5fd0e9cbbce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:25.203823 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-46676670-af0e-4da8-b924-e5fd0e9cbbce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:25.284861 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:25.319079 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46676670-af0e-4da8-b924-e5fd0e9cbbce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:25.319079 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46676670-af0e-4da8-b924-e5fd0e9cbbce service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:25.326994 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed85fbf-a8e4-45e3-a8dc-eb781f097ac5 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:25.334920 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1007/2058] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:25 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:25.336507 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aa619-b6bc-44d6-8131-8afc583459a2 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:25.337220 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aa619-b6bc-44d6-8131-8afc583459a2 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:25.337956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9aa619-b6bc-44d6-8131-8afc583459a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:25.347982 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff2016-9796-42bb-8177-8f40067fef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:25.351140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff2016-9796-42bb-8177-8f40067fef91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:25.351665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff2016-9796-42bb-8177-8f40067fef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:25.352155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff2016-9796-42bb-8177-8f40067fef91 admin admin] PATH_INFO: `/v3/projects/30dabb8449634f2888ccbb7b15b07f76` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:25.354297 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff2016-9796-42bb-8177-8f40067fef91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30dabb8449634f2888ccbb7b15b07f76)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:25.358908 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff2016-9796-42bb-8177-8f40067fef91 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:25.365639 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ec9aa619-b6bc-44d6-8131-8afc583459a2 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:25.367439 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ec9aa619-b6bc-44d6-8131-8afc583459a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:25.379921 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1008/2059] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:25.381385 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9aa619-b6bc-44d6-8131-8afc583459a2 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:25.383020 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ec9aa619-b6bc-44d6-8131-8afc583459a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:25.404893 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9aa619-b6bc-44d6-8131-8afc583459a2 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:25.409765 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12f765-7964-48bb-9b09-3a0c150176eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:25.410634 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12f765-7964-48bb-9b09-3a0c150176eb service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:25.411084 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12f765-7964-48bb-9b09-3a0c150176eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:25.411476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12f765-7964-48bb-9b09-3a0c150176eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:25.413610 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4c12f765-7964-48bb-9b09-3a0c150176eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:25.469306 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7aff2016-9796-42bb-8177-8f40067fef91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30dabb8449634f2888ccbb7b15b07f76', 'request_id': 'req-7aff2016-9796-42bb-8177-8f40067fef91'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:25.473940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:25.482564 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7aff2016-9796-42bb-8177-8f40067fef91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30dabb8449634f2888ccbb7b15b07f76', 'request_id': 'req-7aff2016-9796-42bb-8177-8f40067fef91'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:25.496634 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7aff2016-9796-42bb-8177-8f40067fef91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30dabb8449634f2888ccbb7b15b07f76', 'request_id': 'req-7aff2016-9796-42bb-8177-8f40067fef91'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:25.518215 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7aff2016-9796-42bb-8177-8f40067fef91 admin admin] The token cache is being invalidate because project 30dabb8449634f2888ccbb7b15b07f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:25.518700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7aff2016-9796-42bb-8177-8f40067fef91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:25.519359 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7aff2016-9796-42bb-8177-8f40067fef91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:25.520627 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12f765-7964-48bb-9b09-3a0c150176eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:25.521434 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1052/2060] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:25 2022] DELETE /identity/v3/projects/30dabb8449634f2888ccbb7b15b07f76 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:25.522783 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61546c22-d40c-437d-b83d-199204e92b1b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:25.523282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61546c22-d40c-437d-b83d-199204e92b1b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:25.523720 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61546c22-d40c-437d-b83d-199204e92b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:25.525772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12f765-7964-48bb-9b09-3a0c150176eb service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:25.538608 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1009/2061] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:25.540458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12f765-7964-48bb-9b09-3a0c150176eb service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:25.542675 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4c12f765-7964-48bb-9b09-3a0c150176eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:25.559162 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12f765-7964-48bb-9b09-3a0c150176eb service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:25.574325 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-61546c22-d40c-437d-b83d-199204e92b1b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:25.577560 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-61546c22-d40c-437d-b83d-199204e92b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:25.663730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726344f8-44c3-4abf-9c1b-b01c82cbcf57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:25.664907 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726344f8-44c3-4abf-9c1b-b01c82cbcf57 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:25.665601 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726344f8-44c3-4abf-9c1b-b01c82cbcf57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:25.666040 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726344f8-44c3-4abf-9c1b-b01c82cbcf57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:25.668252 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-726344f8-44c3-4abf-9c1b-b01c82cbcf57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:25.730467 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1053/2062] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:25.731882 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca429e-9c6a-4102-9af9-a4197b8977fb None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:25.732196 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca429e-9c6a-4102-9af9-a4197b8977fb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:25.732488 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca429e-9c6a-4102-9af9-a4197b8977fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:25.786831 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-0eca429e-9c6a-4102-9af9-a4197b8977fb None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:25.792356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0eca429e-9c6a-4102-9af9-a4197b8977fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:25.802678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726344f8-44c3-4abf-9c1b-b01c82cbcf57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:25.806123 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726344f8-44c3-4abf-9c1b-b01c82cbcf57 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:25.812150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1054/2063] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:25.813965 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca429e-9c6a-4102-9af9-a4197b8977fb None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:25.828366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1010/2064] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:25.830097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b40734-439a-4e4f-9789-010125064c37 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:25.830367 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b40734-439a-4e4f-9789-010125064c37 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:25.830744 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b40734-439a-4e4f-9789-010125064c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:25.857573 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca429e-9c6a-4102-9af9-a4197b8977fb None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:25.865023 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b0b40734-439a-4e4f-9789-010125064c37 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:25.867410 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b0b40734-439a-4e4f-9789-010125064c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:25.871423 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9b95f-3087-46b7-89c8-1b7407db01a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:25.873165 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9b95f-3087-46b7-89c8-1b7407db01a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:25.877151 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9b95f-3087-46b7-89c8-1b7407db01a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:25.877777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9b95f-3087-46b7-89c8-1b7407db01a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:25.879637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9b95f-3087-46b7-89c8-1b7407db01a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:25.880889 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9b95f-3087-46b7-89c8-1b7407db01a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:25.883914 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1011/2065] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:25.885079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9b95f-3087-46b7-89c8-1b7407db01a1 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:25.890390 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b40734-439a-4e4f-9789-010125064c37 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:25.912134 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b40734-439a-4e4f-9789-010125064c37 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:25.920816 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1055/2066] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:25.927862 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9b95f-3087-46b7-89c8-1b7407db01a1 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:25.931533 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1be6c0-bf4e-49e6-bb6c-439072ceab95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:25.932272 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1be6c0-bf4e-49e6-bb6c-439072ceab95 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:25.932565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1be6c0-bf4e-49e6-bb6c-439072ceab95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:25.932888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1be6c0-bf4e-49e6-bb6c-439072ceab95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:25.933787 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1be6c0-bf4e-49e6-bb6c-439072ceab95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:25.934401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1be6c0-bf4e-49e6-bb6c-439072ceab95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:25.936217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1be6c0-bf4e-49e6-bb6c-439072ceab95 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:25.947948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9b95f-3087-46b7-89c8-1b7407db01a1 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:25.968629 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ff3a7-49f0-40d4-9e55-a03268f7d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:25.969669 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ff3a7-49f0-40d4-9e55-a03268f7d800 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:25.969669 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ff3a7-49f0-40d4-9e55-a03268f7d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:25.969997 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ff3a7-49f0-40d4-9e55-a03268f7d800 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:25.970602 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ff3a7-49f0-40d4-9e55-a03268f7d800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:25.975011 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1012/2067] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:26:25.981146 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1be6c0-bf4e-49e6-bb6c-439072ceab95 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:25.983047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ff3a7-49f0-40d4-9e55-a03268f7d800 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:26.011308 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1be6c0-bf4e-49e6-bb6c-439072ceab95 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:26.047365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b69bfc-2e03-4d52-a67d-28b7dbeb060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:26.048480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b69bfc-2e03-4d52-a67d-28b7dbeb060c admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:26.048480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b69bfc-2e03-4d52-a67d-28b7dbeb060c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:26.048779 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b69bfc-2e03-4d52-a67d-28b7dbeb060c admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:26.049505 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b69bfc-2e03-4d52-a67d-28b7dbeb060c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:26.052471 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b69bfc-2e03-4d52-a67d-28b7dbeb060c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:26.117233 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1056/2068] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:25 2022] POST /identity/v3/projects => generated 369 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:26:26.119279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1013/2069] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:25 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:26:26.124630 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ff3a7-49f0-40d4-9e55-a03268f7d800 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:26.125227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b69bfc-2e03-4d52-a67d-28b7dbeb060c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:26.273646 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:26.331479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:26.342821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ff3a7-49f0-40d4-9e55-a03268f7d800 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:26.426137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b69bfc-2e03-4d52-a67d-28b7dbeb060c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:26.434585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4458f7c-6626-4bc8-9319-80f6a55c4855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:26.436320 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4458f7c-6626-4bc8-9319-80f6a55c4855 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:26.436829 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4458f7c-6626-4bc8-9319-80f6a55c4855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:26.437302 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4458f7c-6626-4bc8-9319-80f6a55c4855 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:26.448241 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4458f7c-6626-4bc8-9319-80f6a55c4855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:26.448241 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4458f7c-6626-4bc8-9319-80f6a55c4855 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:26.542530 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1014/2070] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:26 2022] POST /identity/v3/users => generated 290 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:26.547038 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68c8b3-be93-4d9d-9b30-4d1329d5029f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:26.551909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68c8b3-be93-4d9d-9b30-4d1329d5029f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:26.554731 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68c8b3-be93-4d9d-9b30-4d1329d5029f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:26.708531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-5d68c8b3-be93-4d9d-9b30-4d1329d5029f None None] MFA Rules not processed for user `0067ac43b76b438da40c87e69ec78923`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:26.708531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5d68c8b3-be93-4d9d-9b30-4d1329d5029f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:26.742766 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace3dd2-3950-4947-b1b8-80480db6a521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:26.743836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace3dd2-3950-4947-b1b8-80480db6a521 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:26.744397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace3dd2-3950-4947-b1b8-80480db6a521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:26.744890 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace3dd2-3950-4947-b1b8-80480db6a521 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:26.746144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace3dd2-3950-4947-b1b8-80480db6a521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:26.750204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace3dd2-3950-4947-b1b8-80480db6a521 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:26.827588 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1057/2071] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:26 2022] POST /identity/v3/users => generated 285 bytes in 710 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:26.841096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace3dd2-3950-4947-b1b8-80480db6a521 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:26.890048 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace3dd2-3950-4947-b1b8-80480db6a521 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:26.912321 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d3d67-344d-4545-aeea-1a1d1650ae62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:26.914124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d3d67-344d-4545-aeea-1a1d1650ae62 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:26.914412 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d3d67-344d-4545-aeea-1a1d1650ae62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:26.914877 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d3d67-344d-4545-aeea-1a1d1650ae62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:26.916426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d3d67-344d-4545-aeea-1a1d1650ae62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:26.919576 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d3d67-344d-4545-aeea-1a1d1650ae62 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:26.927262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1015/2072] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:26.927262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68c8b3-be93-4d9d-9b30-4d1329d5029f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:26.937426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1058/2073] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:26.938323 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d3d67-344d-4545-aeea-1a1d1650ae62 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:26.942029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d95d3d67-344d-4545-aeea-1a1d1650ae62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:26.954970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68c8b3-be93-4d9d-9b30-4d1329d5029f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:26.970683 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91040db0-2fb6-481e-ad24-3b7b0b9992d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:26.971771 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91040db0-2fb6-481e-ad24-3b7b0b9992d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:26.972028 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d3d67-344d-4545-aeea-1a1d1650ae62 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:26.973195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91040db0-2fb6-481e-ad24-3b7b0b9992d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:26.973195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91040db0-2fb6-481e-ad24-3b7b0b9992d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:26.974343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91040db0-2fb6-481e-ad24-3b7b0b9992d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:26.977424 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91040db0-2fb6-481e-ad24-3b7b0b9992d8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:26.979460 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eb419-7736-478a-99aa-11b5319544b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:26.980311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eb419-7736-478a-99aa-11b5319544b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:26.980783 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eb419-7736-478a-99aa-11b5319544b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:26.981249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eb419-7736-478a-99aa-11b5319544b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:26.982142 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eb419-7736-478a-99aa-11b5319544b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:26.985712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eb419-7736-478a-99aa-11b5319544b9 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:27.003427 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1016/2074] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:27.003427 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91040db0-2fb6-481e-ad24-3b7b0b9992d8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:27.011388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91040db0-2fb6-481e-ad24-3b7b0b9992d8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:27.017213 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbb81b-46d2-49f9-9c02-ec22eecd759f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:27.017874 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbb81b-46d2-49f9-9c02-ec22eecd759f admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:27.018231 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbb81b-46d2-49f9-9c02-ec22eecd759f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:27.018410 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbb81b-46d2-49f9-9c02-ec22eecd759f admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:27.019140 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbb81b-46d2-49f9-9c02-ec22eecd759f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:27.021421 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbb81b-46d2-49f9-9c02-ec22eecd759f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:27.038735 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1017/2075] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:27.044613 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1059/2076] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:26 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:27.044885 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbb81b-46d2-49f9-9c02-ec22eecd759f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:27.045960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eb419-7736-478a-99aa-11b5319544b9 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:27.064252 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbb81b-46d2-49f9-9c02-ec22eecd759f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:27.171056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e1a5f-f80b-4b74-9ca8-a219e27f2c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:27.171056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e1a5f-f80b-4b74-9ca8-a219e27f2c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:27.171056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e1a5f-f80b-4b74-9ca8-a219e27f2c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:27.171709 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e1a5f-f80b-4b74-9ca8-a219e27f2c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:27.173177 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e1a5f-f80b-4b74-9ca8-a219e27f2c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:27.176856 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e1a5f-f80b-4b74-9ca8-a219e27f2c55 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:27.197929 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1018/2077] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:27.199433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e1a5f-f80b-4b74-9ca8-a219e27f2c55 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:27.218700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e1a5f-f80b-4b74-9ca8-a219e27f2c55 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:27.230683 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b56573-b9e8-4beb-a7dd-f0be8f3217a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:27.231905 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eb419-7736-478a-99aa-11b5319544b9 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:27.232116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b56573-b9e8-4beb-a7dd-f0be8f3217a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:27.232616 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b56573-b9e8-4beb-a7dd-f0be8f3217a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:27.233132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b56573-b9e8-4beb-a7dd-f0be8f3217a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:27.235095 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b56573-b9e8-4beb-a7dd-f0be8f3217a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:27.240406 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b56573-b9e8-4beb-a7dd-f0be8f3217a0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:27.242218 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabaab2-15e9-4e57-b426-4b9c68c7801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:27.243794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabaab2-15e9-4e57-b426-4b9c68c7801a admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:27.244711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabaab2-15e9-4e57-b426-4b9c68c7801a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:27.245759 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabaab2-15e9-4e57-b426-4b9c68c7801a admin admin] PATH_INFO: `/v3/projects/1b746ae5f6234caab406d8213a25baeb/users/bd65abe9dde5406a86c2e59ff3473489/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:27.279487 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabaab2-15e9-4e57-b426-4b9c68c7801a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b746ae5f6234caab406d8213a25baeb, user_id=bd65abe9dde5406a86c2e59ff3473489, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:27.284388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabaab2-15e9-4e57-b426-4b9c68c7801a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:27.300080 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1019/2078] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:27 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:27.302885 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b56573-b9e8-4beb-a7dd-f0be8f3217a0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:27.325433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b56573-b9e8-4beb-a7dd-f0be8f3217a0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:27.334656 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1060/2079] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:27 2022] PUT /identity/v3/projects/1b746ae5f6234caab406d8213a25baeb/users/bd65abe9dde5406a86c2e59ff3473489/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:26:27.348604 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabaab2-15e9-4e57-b426-4b9c68c7801a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:27.396119 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:27.408221 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:27.475423 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabaab2-15e9-4e57-b426-4b9c68c7801a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:27.481954 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca54e4-8912-4214-b0a4-63db2f52fda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:27.482971 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca54e4-8912-4214-b0a4-63db2f52fda9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:27.483510 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca54e4-8912-4214-b0a4-63db2f52fda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:27.484515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549927de-d82f-4aa4-9e39-a4f233fce969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:27.485226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549927de-d82f-4aa4-9e39-a4f233fce969 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:27.485529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca54e4-8912-4214-b0a4-63db2f52fda9 admin admin] PATH_INFO: `/v3/projects/52ce013d275045609ec64f42fdaebff8/users/e65d74c114044f569ba2ae1546612f1a/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:27.485730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549927de-d82f-4aa4-9e39-a4f233fce969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:27.486244 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549927de-d82f-4aa4-9e39-a4f233fce969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:27.487539 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549927de-d82f-4aa4-9e39-a4f233fce969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:27.507614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549927de-d82f-4aa4-9e39-a4f233fce969 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:27.532132 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1061/2080] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:27.532634 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca54e4-8912-4214-b0a4-63db2f52fda9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ce013d275045609ec64f42fdaebff8, user_id=e65d74c114044f569ba2ae1546612f1a, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:27.533354 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46eeb7-c199-4987-850d-45207f07bd97 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:27.536534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46eeb7-c199-4987-850d-45207f07bd97 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:27.537295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca54e4-8912-4214-b0a4-63db2f52fda9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:27.537934 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46eeb7-c199-4987-850d-45207f07bd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:27.575451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1020/2081] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:27 2022] PUT /identity/v3/projects/52ce013d275045609ec64f42fdaebff8/users/e65d74c114044f569ba2ae1546612f1a/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:27.576514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca54e4-8912-4214-b0a4-63db2f52fda9 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:27.594663 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-ac46eeb7-c199-4987-850d-45207f07bd97 None None] MFA Rules not processed for user `bd65abe9dde5406a86c2e59ff3473489`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:27.597062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ac46eeb7-c199-4987-850d-45207f07bd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:27.737630 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1062/2082] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:27.739534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4d0f2-d1ef-422a-88b7-2c1a64c19c7f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:27.740025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4d0f2-d1ef-422a-88b7-2c1a64c19c7f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:27.740409 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4d0f2-d1ef-422a-88b7-2c1a64c19c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:27.751341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca54e4-8912-4214-b0a4-63db2f52fda9 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:27.760297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f9325-ea15-4485-a92c-17ecc239b34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:27.761588 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f9325-ea15-4485-a92c-17ecc239b34c admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:27.762093 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f9325-ea15-4485-a92c-17ecc239b34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:27.762523 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f9325-ea15-4485-a92c-17ecc239b34c admin admin] PATH_INFO: `/v3/projects/ab7f9ec3a5484c2c9c9523926aed0df7/users/24aeb123720a4f8ba5c4175a49c31ba3/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:27.799271 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-0ba4d0f2-d1ef-422a-88b7-2c1a64c19c7f None None] MFA Rules not processed for user `e65d74c114044f569ba2ae1546612f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:27.801774 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0ba4d0f2-d1ef-422a-88b7-2c1a64c19c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:27.805584 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f9325-ea15-4485-a92c-17ecc239b34c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7f9ec3a5484c2c9c9523926aed0df7, user_id=24aeb123720a4f8ba5c4175a49c31ba3, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:27.808603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f9325-ea15-4485-a92c-17ecc239b34c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:27.864545 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1021/2083] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:27 2022] PUT /identity/v3/projects/ab7f9ec3a5484c2c9c9523926aed0df7/users/24aeb123720a4f8ba5c4175a49c31ba3/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:27.865574 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f9325-ea15-4485-a92c-17ecc239b34c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:27.985948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1063/2084] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:27.989109 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4d0f2-d1ef-422a-88b7-2c1a64c19c7f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:28.009702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f9325-ea15-4485-a92c-17ecc239b34c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:28.024963 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4d0f2-d1ef-422a-88b7-2c1a64c19c7f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:28.031763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04878c5d-24ce-43be-b8a2-b711f95e0c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:28.032456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04878c5d-24ce-43be-b8a2-b711f95e0c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:28.032763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04878c5d-24ce-43be-b8a2-b711f95e0c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:28.033027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04878c5d-24ce-43be-b8a2-b711f95e0c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:28.033745 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04878c5d-24ce-43be-b8a2-b711f95e0c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:28.039121 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e4e27-b4f6-41a4-a4f8-83d5e53a208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:28.039893 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e4e27-b4f6-41a4-a4f8-83d5e53a208f admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:28.040958 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e4e27-b4f6-41a4-a4f8-83d5e53a208f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:28.056024 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e4e27-b4f6-41a4-a4f8-83d5e53a208f admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:28.056024 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e4e27-b4f6-41a4-a4f8-83d5e53a208f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:28.056823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04878c5d-24ce-43be-b8a2-b711f95e0c51 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:28.056992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e4e27-b4f6-41a4-a4f8-83d5e53a208f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:28.118487 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1064/2085] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:28.125259 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04878c5d-24ce-43be-b8a2-b711f95e0c51 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:28.135909 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-04878c5d-24ce-43be-b8a2-b711f95e0c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:28.185135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1022/2086] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:27 2022] POST /identity/v3/projects => generated 379 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:28.186661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e4e27-b4f6-41a4-a4f8-83d5e53a208f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:28.188839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:28.220576 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:28.341021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04878c5d-24ce-43be-b8a2-b711f95e0c51 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:28.349884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e4e27-b4f6-41a4-a4f8-83d5e53a208f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:28.355898 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ed83a-8374-4461-b735-e07ad4f60324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:28.357018 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ed83a-8374-4461-b735-e07ad4f60324 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:28.357279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ed83a-8374-4461-b735-e07ad4f60324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:28.357689 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ed83a-8374-4461-b735-e07ad4f60324 admin admin] PATH_INFO: `/v3/projects/ab7f9ec3a5484c2c9c9523926aed0df7/users/24aeb123720a4f8ba5c4175a49c31ba3/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:28.360449 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ed83a-8374-4461-b735-e07ad4f60324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7f9ec3a5484c2c9c9523926aed0df7, user_id=24aeb123720a4f8ba5c4175a49c31ba3, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:28.364018 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ed83a-8374-4461-b735-e07ad4f60324 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:28.381989 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1023/2087] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:28 2022] PUT /identity/v3/projects/ab7f9ec3a5484c2c9c9523926aed0df7/users/24aeb123720a4f8ba5c4175a49c31ba3/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:28.383005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ed83a-8374-4461-b735-e07ad4f60324 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:28.525421 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780cdab-ec0b-4534-9c75-1157ccceef7b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc15e64c987488f812d1cdd0c82c7ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:28.526499 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780cdab-ec0b-4534-9c75-1157ccceef7b service glance] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:28.526991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780cdab-ec0b-4534-9c75-1157ccceef7b service glance] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:28.527472 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780cdab-ec0b-4534-9c75-1157ccceef7b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:28.643316 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ed83a-8374-4461-b735-e07ad4f60324 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:28.652138 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab8503-e3ea-453d-b6ab-e04495d702c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:28.652833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab8503-e3ea-453d-b6ab-e04495d702c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:28.653122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab8503-e3ea-453d-b6ab-e04495d702c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:28.653399 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab8503-e3ea-453d-b6ab-e04495d702c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:28.654089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab8503-e3ea-453d-b6ab-e04495d702c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:28.656160 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab8503-e3ea-453d-b6ab-e04495d702c6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:28.698529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1024/2088] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:28 2022] POST /identity/v3/users => generated 296 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:28.700326 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab8503-e3ea-453d-b6ab-e04495d702c6 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:28.731385 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab8503-e3ea-453d-b6ab-e04495d702c6 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:28.752859 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e9a92-bdd0-43da-883c-e46c90108040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:28.753914 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e9a92-bdd0-43da-883c-e46c90108040 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:28.754384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e9a92-bdd0-43da-883c-e46c90108040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:28.754844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e9a92-bdd0-43da-883c-e46c90108040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:28.756071 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e9a92-bdd0-43da-883c-e46c90108040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:28.758374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e9a92-bdd0-43da-883c-e46c90108040 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:28.770385 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780cdab-ec0b-4534-9c75-1157ccceef7b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:28.776760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780cdab-ec0b-4534-9c75-1157ccceef7b service glance] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:28.793487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1025/2089] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:28.797929 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e9a92-bdd0-43da-883c-e46c90108040 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:28.823150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e9a92-bdd0-43da-883c-e46c90108040 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:28.824511 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1065/2090] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:28.830961 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d40e8-ae1b-4c87-be0e-967efc411328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:28.832336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d40e8-ae1b-4c87-be0e-967efc411328 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:28.832859 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d40e8-ae1b-4c87-be0e-967efc411328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:28.833336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d40e8-ae1b-4c87-be0e-967efc411328 admin admin] PATH_INFO: `/v3/projects/4858765d602e473c967a45dc3af660a5/users/bbedeaaecd9b4b8f8990a8e5494472bd/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:28.885334 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d40e8-ae1b-4c87-be0e-967efc411328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4858765d602e473c967a45dc3af660a5, user_id=bbedeaaecd9b4b8f8990a8e5494472bd, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:28.888073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d40e8-ae1b-4c87-be0e-967efc411328 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:28.933033 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1026/2091] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:28 2022] PUT /identity/v3/projects/4858765d602e473c967a45dc3af660a5/users/bbedeaaecd9b4b8f8990a8e5494472bd/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:26:28.937959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780cdab-ec0b-4534-9c75-1157ccceef7b service glance] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:28.960216 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780cdab-ec0b-4534-9c75-1157ccceef7b service glance] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:29.066448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626dac4-3898-4fa7-836e-fc971263f97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:29.067427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626dac4-3898-4fa7-836e-fc971263f97f admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:29.067771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626dac4-3898-4fa7-836e-fc971263f97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:29.068302 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626dac4-3898-4fa7-836e-fc971263f97f admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:29.069430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626dac4-3898-4fa7-836e-fc971263f97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:29.074087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626dac4-3898-4fa7-836e-fc971263f97f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:29.087146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1066/2092] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:29.092373 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d40e8-ae1b-4c87-be0e-967efc411328 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:29.113578 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d40e8-ae1b-4c87-be0e-967efc411328 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:29.124194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be023b8-c810-4149-b95a-d0f76fca6565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:29.124911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be023b8-c810-4149-b95a-d0f76fca6565 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:29.125275 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be023b8-c810-4149-b95a-d0f76fca6565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:29.125734 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be023b8-c810-4149-b95a-d0f76fca6565 admin admin] PATH_INFO: `/v3/projects/4858765d602e473c967a45dc3af660a5/users/bbedeaaecd9b4b8f8990a8e5494472bd/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:29.148206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be023b8-c810-4149-b95a-d0f76fca6565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4858765d602e473c967a45dc3af660a5, user_id=bbedeaaecd9b4b8f8990a8e5494472bd, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:29.148206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be023b8-c810-4149-b95a-d0f76fca6565 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:29.171701 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1027/2093] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:29 2022] PUT /identity/v3/projects/4858765d602e473c967a45dc3af660a5/users/bbedeaaecd9b4b8f8990a8e5494472bd/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:29.197624 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf5d41-feb0-4e06-b51a-f309b2c97d86 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:29.198440 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf5d41-feb0-4e06-b51a-f309b2c97d86 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:29.198938 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf5d41-feb0-4e06-b51a-f309b2c97d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:29.271920 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:29.279579 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b8cf5d41-feb0-4e06-b51a-f309b2c97d86 None None] MFA Rules not processed for user `bbedeaaecd9b4b8f8990a8e5494472bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:29.283072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b8cf5d41-feb0-4e06-b51a-f309b2c97d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:29.372896 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be023b8-c810-4149-b95a-d0f76fca6565 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:29.376237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0be023b8-c810-4149-b95a-d0f76fca6565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:29.472702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1067/2094] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:29.536512 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:29.602637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf5d41-feb0-4e06-b51a-f309b2c97d86 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:29.604635 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b8cf5d41-feb0-4e06-b51a-f309b2c97d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:29.615037 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be023b8-c810-4149-b95a-d0f76fca6565 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:29.635516 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84846fa-2328-43b6-9ad4-0c6770dbe937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:29.636777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84846fa-2328-43b6-9ad4-0c6770dbe937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:29.637269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84846fa-2328-43b6-9ad4-0c6770dbe937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:29.637746 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84846fa-2328-43b6-9ad4-0c6770dbe937 admin admin] PATH_INFO: `/v3/users/7c75d546b7214be6a34347d09ee8ebbb` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:29.642197 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84846fa-2328-43b6-9ad4-0c6770dbe937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c75d546b7214be6a34347d09ee8ebbb)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:29.644653 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84846fa-2328-43b6-9ad4-0c6770dbe937 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:29.736330 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d84846fa-2328-43b6-9ad4-0c6770dbe937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c75d546b7214be6a34347d09ee8ebbb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:29.736651 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d84846fa-2328-43b6-9ad4-0c6770dbe937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c75d546b7214be6a34347d09ee8ebbb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:29.751627 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d84846fa-2328-43b6-9ad4-0c6770dbe937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c75d546b7214be6a34347d09ee8ebbb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:29.756733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf5d41-feb0-4e06-b51a-f309b2c97d86 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:29.767820 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70e183-af7b-4dc4-9576-1bda54d46da4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:29.770300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70e183-af7b-4dc4-9576-1bda54d46da4 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:29.780059 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70e183-af7b-4dc4-9576-1bda54d46da4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:29.780943 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70e183-af7b-4dc4-9576-1bda54d46da4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:29.786074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d84846fa-2328-43b6-9ad4-0c6770dbe937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c75d546b7214be6a34347d09ee8ebbb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:29.789134 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-dd70e183-af7b-4dc4-9576-1bda54d46da4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:29.825211 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d84846fa-2328-43b6-9ad4-0c6770dbe937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c75d546b7214be6a34347d09ee8ebbb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:29.834294 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1028/2095] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:29 2022] DELETE /identity/v3/users/7c75d546b7214be6a34347d09ee8ebbb => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:29.835747 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70e183-af7b-4dc4-9576-1bda54d46da4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:29.842790 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70e183-af7b-4dc4-9576-1bda54d46da4 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:29.843108 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b353aec-adce-4c90-b4de-1adb8f5d25bd None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:29.843631 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b353aec-adce-4c90-b4de-1adb8f5d25bd None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:29.843739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b353aec-adce-4c90-b4de-1adb8f5d25bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:29.870868 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1068/2096] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:26:29.887261 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9b353aec-adce-4c90-b4de-1adb8f5d25bd None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:29.889759 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9b353aec-adce-4c90-b4de-1adb8f5d25bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:30.069531 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a1421-28a0-4de0-9e66-115ff31bb6b1 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:30.070455 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a1421-28a0-4de0-9e66-115ff31bb6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:30.070455 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a1421-28a0-4de0-9e66-115ff31bb6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:30.085934 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1029/2097] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:30.111807 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b353aec-adce-4c90-b4de-1adb8f5d25bd None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:30.113640 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9b353aec-adce-4c90-b4de-1adb8f5d25bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:30.176780 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1b6a1421-28a0-4de0-9e66-115ff31bb6b1 None None] MFA Rules not processed for user `24aeb123720a4f8ba5c4175a49c31ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:30.182432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1b6a1421-28a0-4de0-9e66-115ff31bb6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:30.325837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b353aec-adce-4c90-b4de-1adb8f5d25bd None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:30.348091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542196e3-90e6-435e-9dc5-bf80d7f7fb29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:30.352040 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542196e3-90e6-435e-9dc5-bf80d7f7fb29 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:30.354424 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542196e3-90e6-435e-9dc5-bf80d7f7fb29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:30.355394 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542196e3-90e6-435e-9dc5-bf80d7f7fb29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:30.357106 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1069/2098] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:30.370072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c004e-0d99-4f91-9cb2-baeca09a7cc5 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:30.370387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c004e-0d99-4f91-9cb2-baeca09a7cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:30.370685 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c004e-0d99-4f91-9cb2-baeca09a7cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:30.408594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542196e3-90e6-435e-9dc5-bf80d7f7fb29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:30.410073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542196e3-90e6-435e-9dc5-bf80d7f7fb29 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:30.426447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-472c004e-0d99-4f91-9cb2-baeca09a7cc5 None None] MFA Rules not processed for user `0067ac43b76b438da40c87e69ec78923`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:30.427780 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-472c004e-0d99-4f91-9cb2-baeca09a7cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:30.459896 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1030/2099] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:30.501978 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:30.627426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1070/2100] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:26:30.665687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542196e3-90e6-435e-9dc5-bf80d7f7fb29 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:30.668040 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-542196e3-90e6-435e-9dc5-bf80d7f7fb29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:30.692140 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:30.868076 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542196e3-90e6-435e-9dc5-bf80d7f7fb29 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:30.881754 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51378a-3be2-4d69-8474-566f6af657bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:30.883098 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51378a-3be2-4d69-8474-566f6af657bb service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:30.884968 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51378a-3be2-4d69-8474-566f6af657bb service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:30.885872 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51378a-3be2-4d69-8474-566f6af657bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:30.890526 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7c51378a-3be2-4d69-8474-566f6af657bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:30.922557 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51378a-3be2-4d69-8474-566f6af657bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:30.927433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51378a-3be2-4d69-8474-566f6af657bb service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:30.995292 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1031/2101] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:31.283322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c004e-0d99-4f91-9cb2-baeca09a7cc5 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:31.286537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-472c004e-0d99-4f91-9cb2-baeca09a7cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:31.321457 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c004e-0d99-4f91-9cb2-baeca09a7cc5 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:31.335889 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51378a-3be2-4d69-8474-566f6af657bb service nova] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:31.339310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7c51378a-3be2-4d69-8474-566f6af657bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:31.345788 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72020f6b-e4a3-407e-9653-a2f79f66fee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:31.347775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72020f6b-e4a3-407e-9653-a2f79f66fee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:31.348332 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72020f6b-e4a3-407e-9653-a2f79f66fee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:31.348882 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72020f6b-e4a3-407e-9653-a2f79f66fee2 admin admin] PATH_INFO: `/v3/users/bd65abe9dde5406a86c2e59ff3473489` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:31.352324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72020f6b-e4a3-407e-9653-a2f79f66fee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd65abe9dde5406a86c2e59ff3473489)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:31.356736 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72020f6b-e4a3-407e-9653-a2f79f66fee2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:31.402491 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51378a-3be2-4d69-8474-566f6af657bb service nova] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:31.414513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241dc76-58b6-4ba9-951e-033993cc8da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:31.416973 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241dc76-58b6-4ba9-951e-033993cc8da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:31.417489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241dc76-58b6-4ba9-951e-033993cc8da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:31.417973 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241dc76-58b6-4ba9-951e-033993cc8da2 admin admin] PATH_INFO: `/v3/projects/c899a879a87f4d199e65171a96109f27` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:31.421327 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241dc76-58b6-4ba9-951e-033993cc8da2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c899a879a87f4d199e65171a96109f27)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:31.426161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241dc76-58b6-4ba9-951e-033993cc8da2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:31.560984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-72020f6b-e4a3-407e-9653-a2f79f66fee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd65abe9dde5406a86c2e59ff3473489'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:31.563029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-72020f6b-e4a3-407e-9653-a2f79f66fee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd65abe9dde5406a86c2e59ff3473489'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:31.566254 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e241dc76-58b6-4ba9-951e-033993cc8da2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c899a879a87f4d199e65171a96109f27', 'request_id': 'req-e241dc76-58b6-4ba9-951e-033993cc8da2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:31.587512 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-72020f6b-e4a3-407e-9653-a2f79f66fee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd65abe9dde5406a86c2e59ff3473489'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:31.589250 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e241dc76-58b6-4ba9-951e-033993cc8da2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c899a879a87f4d199e65171a96109f27', 'request_id': 'req-e241dc76-58b6-4ba9-951e-033993cc8da2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:31.589559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-72020f6b-e4a3-407e-9653-a2f79f66fee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd65abe9dde5406a86c2e59ff3473489'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:31.606520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e241dc76-58b6-4ba9-951e-033993cc8da2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c899a879a87f4d199e65171a96109f27', 'request_id': 'req-e241dc76-58b6-4ba9-951e-033993cc8da2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:31.627327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-72020f6b-e4a3-407e-9653-a2f79f66fee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd65abe9dde5406a86c2e59ff3473489'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:31.650886 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e241dc76-58b6-4ba9-951e-033993cc8da2 admin admin] The token cache is being invalidate because project c899a879a87f4d199e65171a96109f27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:31.651730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e241dc76-58b6-4ba9-951e-033993cc8da2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:31.653207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e241dc76-58b6-4ba9-951e-033993cc8da2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:31.662596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1032/2102] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:31 2022] DELETE /identity/v3/projects/c899a879a87f4d199e65171a96109f27 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:31.664558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241dc76-58b6-4ba9-951e-033993cc8da2 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:31.667216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e241dc76-58b6-4ba9-951e-033993cc8da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:31.680449 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1071/2103] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:31 2022] DELETE /identity/v3/users/bd65abe9dde5406a86c2e59ff3473489 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:31.687976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fdf66-33ae-4db8-afd5-4620a0c8f3ec None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:31.688473 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fdf66-33ae-4db8-afd5-4620a0c8f3ec None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:31.688976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fdf66-33ae-4db8-afd5-4620a0c8f3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:31.729547 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-531fdf66-33ae-4db8-afd5-4620a0c8f3ec None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:31.731614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-531fdf66-33ae-4db8-afd5-4620a0c8f3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:31.908023 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241dc76-58b6-4ba9-951e-033993cc8da2 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:31.969475 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:32.016941 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1072/2104] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:32.043300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fdf66-33ae-4db8-afd5-4620a0c8f3ec None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:32.045907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-531fdf66-33ae-4db8-afd5-4620a0c8f3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:32.125582 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a576af3-6f55-4033-a98f-1bce2e1ab3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:32.126743 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a576af3-6f55-4033-a98f-1bce2e1ab3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:32.127224 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a576af3-6f55-4033-a98f-1bce2e1ab3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:32.127947 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a576af3-6f55-4033-a98f-1bce2e1ab3d4 admin admin] PATH_INFO: `/v3/users/f9d556fe812543aa92b084bbbed6f1bb` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:32.130332 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a576af3-6f55-4033-a98f-1bce2e1ab3d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9d556fe812543aa92b084bbbed6f1bb)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:32.134748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a576af3-6f55-4033-a98f-1bce2e1ab3d4 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:32.184618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:32.214256 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fdf66-33ae-4db8-afd5-4620a0c8f3ec None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:32.228502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5415c59-4b88-4c34-b604-f1869514962f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:32.230276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5415c59-4b88-4c34-b604-f1869514962f service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:32.230829 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5415c59-4b88-4c34-b604-f1869514962f service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:32.231622 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5415c59-4b88-4c34-b604-f1869514962f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:32.241922 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7a576af3-6f55-4033-a98f-1bce2e1ab3d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9d556fe812543aa92b084bbbed6f1bb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:32.242850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7a576af3-6f55-4033-a98f-1bce2e1ab3d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9d556fe812543aa92b084bbbed6f1bb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:32.268494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7a576af3-6f55-4033-a98f-1bce2e1ab3d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9d556fe812543aa92b084bbbed6f1bb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:32.276561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5415c59-4b88-4c34-b604-f1869514962f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:32.281647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5415c59-4b88-4c34-b604-f1869514962f service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:32.313526 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1073/2105] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:26:32.315175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5415c59-4b88-4c34-b604-f1869514962f service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:32.318488 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d5415c59-4b88-4c34-b604-f1869514962f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:32.321970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7a576af3-6f55-4033-a98f-1bce2e1ab3d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9d556fe812543aa92b084bbbed6f1bb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:32.342651 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7a576af3-6f55-4033-a98f-1bce2e1ab3d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9d556fe812543aa92b084bbbed6f1bb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:32.353251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5415c59-4b88-4c34-b604-f1869514962f service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:32.359022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1033/2106] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:31 2022] DELETE /identity/v3/users/f9d556fe812543aa92b084bbbed6f1bb => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:32.386405 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6082218-c965-458d-a27d-ec98b2c50590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:32.387411 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6082218-c965-458d-a27d-ec98b2c50590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:32.387929 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6082218-c965-458d-a27d-ec98b2c50590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:32.388484 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6082218-c965-458d-a27d-ec98b2c50590 admin admin] PATH_INFO: `/v3/users/062e1942bb5a4ddea217e6eda725b140` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:32.398722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6082218-c965-458d-a27d-ec98b2c50590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=062e1942bb5a4ddea217e6eda725b140)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:32.404600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6082218-c965-458d-a27d-ec98b2c50590 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:32.523145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d6082218-c965-458d-a27d-ec98b2c50590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062e1942bb5a4ddea217e6eda725b140'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:32.523905 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d6082218-c965-458d-a27d-ec98b2c50590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062e1942bb5a4ddea217e6eda725b140'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:32.568768 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d6082218-c965-458d-a27d-ec98b2c50590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062e1942bb5a4ddea217e6eda725b140'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:32.569593 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d6082218-c965-458d-a27d-ec98b2c50590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062e1942bb5a4ddea217e6eda725b140'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:32.588375 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d6082218-c965-458d-a27d-ec98b2c50590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062e1942bb5a4ddea217e6eda725b140'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:32.614348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1074/2107] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:32 2022] DELETE /identity/v3/users/062e1942bb5a4ddea217e6eda725b140 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:32.623203 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0b945-d507-4c82-bf6f-599eaf2290ba None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:32.623752 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0b945-d507-4c82-bf6f-599eaf2290ba None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:32.624505 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0b945-d507-4c82-bf6f-599eaf2290ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:32.656900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c6b0b945-d507-4c82-bf6f-599eaf2290ba None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:32.660844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c6b0b945-d507-4c82-bf6f-599eaf2290ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:32.813000 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1034/2108] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:32.833337 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6082218-c965-458d-a27d-ec98b2c50590 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:32.835267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d6082218-c965-458d-a27d-ec98b2c50590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:32.937596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6082218-c965-458d-a27d-ec98b2c50590 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:32.945749 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2016187-c740-4aa0-91bc-c3dbad3346f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:32.946960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2016187-c740-4aa0-91bc-c3dbad3346f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:32.947567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2016187-c740-4aa0-91bc-c3dbad3346f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:32.947925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2016187-c740-4aa0-91bc-c3dbad3346f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:32.963585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2016187-c740-4aa0-91bc-c3dbad3346f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:32.966250 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2016187-c740-4aa0-91bc-c3dbad3346f1 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:32.983806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1075/2109] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:26:33.212100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0b945-d507-4c82-bf6f-599eaf2290ba None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:33.215806 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c6b0b945-d507-4c82-bf6f-599eaf2290ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:33.251016 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0b945-d507-4c82-bf6f-599eaf2290ba None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:33.273440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abe3cd-1584-46e2-9869-7a9501b0ad8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:33.274635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abe3cd-1584-46e2-9869-7a9501b0ad8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:33.275203 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abe3cd-1584-46e2-9869-7a9501b0ad8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:33.275707 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abe3cd-1584-46e2-9869-7a9501b0ad8e admin admin] PATH_INFO: `/v3/projects/3cf7b42973ed4ab4b37d272606819768` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:33.280234 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abe3cd-1584-46e2-9869-7a9501b0ad8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf7b42973ed4ab4b37d272606819768)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:33.284089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abe3cd-1584-46e2-9869-7a9501b0ad8e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:33.416952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:33.430409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b8abe3cd-1584-46e2-9869-7a9501b0ad8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf7b42973ed4ab4b37d272606819768', 'request_id': 'req-b8abe3cd-1584-46e2-9869-7a9501b0ad8e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:33.445365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b8abe3cd-1584-46e2-9869-7a9501b0ad8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf7b42973ed4ab4b37d272606819768', 'request_id': 'req-b8abe3cd-1584-46e2-9869-7a9501b0ad8e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:33.466711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b8abe3cd-1584-46e2-9869-7a9501b0ad8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf7b42973ed4ab4b37d272606819768', 'request_id': 'req-b8abe3cd-1584-46e2-9869-7a9501b0ad8e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:33.518748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b8abe3cd-1584-46e2-9869-7a9501b0ad8e admin admin] The token cache is being invalidate because project 3cf7b42973ed4ab4b37d272606819768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:33.519993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b8abe3cd-1584-46e2-9869-7a9501b0ad8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:33.520796 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b8abe3cd-1584-46e2-9869-7a9501b0ad8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:33.523881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1035/2110] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:33 2022] DELETE /identity/v3/projects/3cf7b42973ed4ab4b37d272606819768 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:33.531588 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c423cdf-5c39-42b6-a439-3faf1eba706b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:33.533000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c423cdf-5c39-42b6-a439-3faf1eba706b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:33.534234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c423cdf-5c39-42b6-a439-3faf1eba706b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:33.588221 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1c423cdf-5c39-42b6-a439-3faf1eba706b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:33.591806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1c423cdf-5c39-42b6-a439-3faf1eba706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:33.683717 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abe3cd-1584-46e2-9869-7a9501b0ad8e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:33.693559 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b8abe3cd-1584-46e2-9869-7a9501b0ad8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:33.915543 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1076/2111] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:33.917110 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1906d-a053-4f81-8e05-304ac540873c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:33.917436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1906d-a053-4f81-8e05-304ac540873c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:33.917800 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1906d-a053-4f81-8e05-304ac540873c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:33.937317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:33.962068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6dc1906d-a053-4f81-8e05-304ac540873c None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:33.971808 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6dc1906d-a053-4f81-8e05-304ac540873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:34.013938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abe3cd-1584-46e2-9869-7a9501b0ad8e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:34.028485 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568df2b2-62c9-43dd-b78b-00f888f1ffff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:34.037623 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568df2b2-62c9-43dd-b78b-00f888f1ffff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:34.038347 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568df2b2-62c9-43dd-b78b-00f888f1ffff admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:34.038946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568df2b2-62c9-43dd-b78b-00f888f1ffff admin admin] PATH_INFO: `/v3/projects/1b746ae5f6234caab406d8213a25baeb` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:34.041366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568df2b2-62c9-43dd-b78b-00f888f1ffff admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b746ae5f6234caab406d8213a25baeb)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:34.042277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1077/2112] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:34.043441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1906d-a053-4f81-8e05-304ac540873c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:34.045489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568df2b2-62c9-43dd-b78b-00f888f1ffff admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:34.048025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6dc1906d-a053-4f81-8e05-304ac540873c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:34.073811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1906d-a053-4f81-8e05-304ac540873c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:34.080232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a6b77-caf3-49b9-84b6-1ab04a121ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:34.081397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a6b77-caf3-49b9-84b6-1ab04a121ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:34.081934 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a6b77-caf3-49b9-84b6-1ab04a121ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:34.082415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a6b77-caf3-49b9-84b6-1ab04a121ed6 admin admin] PATH_INFO: `/v3/projects/5b58be56a4274736a7b7aaa8025bbd4a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:34.084523 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a6b77-caf3-49b9-84b6-1ab04a121ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b58be56a4274736a7b7aaa8025bbd4a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:34.090061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a6b77-caf3-49b9-84b6-1ab04a121ed6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:34.191850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-568df2b2-62c9-43dd-b78b-00f888f1ffff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b746ae5f6234caab406d8213a25baeb', 'request_id': 'req-568df2b2-62c9-43dd-b78b-00f888f1ffff'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.200216 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3a1a6b77-caf3-49b9-84b6-1ab04a121ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b58be56a4274736a7b7aaa8025bbd4a', 'request_id': 'req-3a1a6b77-caf3-49b9-84b6-1ab04a121ed6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.207950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-568df2b2-62c9-43dd-b78b-00f888f1ffff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b746ae5f6234caab406d8213a25baeb', 'request_id': 'req-568df2b2-62c9-43dd-b78b-00f888f1ffff'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.219892 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-568df2b2-62c9-43dd-b78b-00f888f1ffff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b746ae5f6234caab406d8213a25baeb', 'request_id': 'req-568df2b2-62c9-43dd-b78b-00f888f1ffff'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.224250 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3a1a6b77-caf3-49b9-84b6-1ab04a121ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b58be56a4274736a7b7aaa8025bbd4a', 'request_id': 'req-3a1a6b77-caf3-49b9-84b6-1ab04a121ed6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.237761 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3a1a6b77-caf3-49b9-84b6-1ab04a121ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b58be56a4274736a7b7aaa8025bbd4a', 'request_id': 'req-3a1a6b77-caf3-49b9-84b6-1ab04a121ed6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.246751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-568df2b2-62c9-43dd-b78b-00f888f1ffff admin admin] The token cache is being invalidate because project 1b746ae5f6234caab406d8213a25baeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:34.247217 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-568df2b2-62c9-43dd-b78b-00f888f1ffff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.248509 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-568df2b2-62c9-43dd-b78b-00f888f1ffff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.252242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1036/2113] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:33 2022] DELETE /identity/v3/projects/1b746ae5f6234caab406d8213a25baeb => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:34.252242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568df2b2-62c9-43dd-b78b-00f888f1ffff admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:34.254122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-568df2b2-62c9-43dd-b78b-00f888f1ffff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:34.274094 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3a1a6b77-caf3-49b9-84b6-1ab04a121ed6 admin admin] The token cache is being invalidate because project 5b58be56a4274736a7b7aaa8025bbd4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:34.275089 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3a1a6b77-caf3-49b9-84b6-1ab04a121ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.277051 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3a1a6b77-caf3-49b9-84b6-1ab04a121ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.281206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1078/2114] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:34 2022] DELETE /identity/v3/projects/5b58be56a4274736a7b7aaa8025bbd4a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:34.283836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a6b77-caf3-49b9-84b6-1ab04a121ed6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:34.297611 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3a1a6b77-caf3-49b9-84b6-1ab04a121ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:34.392066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:34.410416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568df2b2-62c9-43dd-b78b-00f888f1ffff admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:34.415524 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a6b77-caf3-49b9-84b6-1ab04a121ed6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:34.423367 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d7b30-d726-41b2-849a-956a691f3307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:34.424817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d7b30-d726-41b2-849a-956a691f3307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:34.425645 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d7b30-d726-41b2-849a-956a691f3307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:34.427084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d7b30-d726-41b2-849a-956a691f3307 admin admin] PATH_INFO: `/v3/users/bbedeaaecd9b4b8f8990a8e5494472bd` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:34.430220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d7b30-d726-41b2-849a-956a691f3307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbedeaaecd9b4b8f8990a8e5494472bd)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:34.434506 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d7b30-d726-41b2-849a-956a691f3307 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:34.436691 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04caf6-49ee-4fd2-a294-73bacf42c174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:34.439834 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04caf6-49ee-4fd2-a294-73bacf42c174 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:34.439834 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04caf6-49ee-4fd2-a294-73bacf42c174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:34.439834 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04caf6-49ee-4fd2-a294-73bacf42c174 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:34.441994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04caf6-49ee-4fd2-a294-73bacf42c174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:34.442599 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04caf6-49ee-4fd2-a294-73bacf42c174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:34.447404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04caf6-49ee-4fd2-a294-73bacf42c174 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:34.474536 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1037/2115] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:34.475836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04caf6-49ee-4fd2-a294-73bacf42c174 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:34.480763 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-df04caf6-49ee-4fd2-a294-73bacf42c174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:34.507208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04caf6-49ee-4fd2-a294-73bacf42c174 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:34.515125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38294bb-5a27-4e55-94d2-c67882f84ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:34.515766 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38294bb-5a27-4e55-94d2-c67882f84ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:34.516324 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38294bb-5a27-4e55-94d2-c67882f84ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:34.522457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38294bb-5a27-4e55-94d2-c67882f84ed6 admin admin] PATH_INFO: `/v3/users/0d44f2b3b6d24c6cb8386c993a252c83` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:34.522457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38294bb-5a27-4e55-94d2-c67882f84ed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d44f2b3b6d24c6cb8386c993a252c83)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:34.522457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38294bb-5a27-4e55-94d2-c67882f84ed6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:34.651679 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-255d7b30-d726-41b2-849a-956a691f3307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbedeaaecd9b4b8f8990a8e5494472bd'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.652844 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-255d7b30-d726-41b2-849a-956a691f3307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbedeaaecd9b4b8f8990a8e5494472bd'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.672357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-255d7b30-d726-41b2-849a-956a691f3307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbedeaaecd9b4b8f8990a8e5494472bd'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.673190 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-255d7b30-d726-41b2-849a-956a691f3307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbedeaaecd9b4b8f8990a8e5494472bd'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.687248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c38294bb-5a27-4e55-94d2-c67882f84ed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d44f2b3b6d24c6cb8386c993a252c83'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.689831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c38294bb-5a27-4e55-94d2-c67882f84ed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d44f2b3b6d24c6cb8386c993a252c83'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.724828 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c38294bb-5a27-4e55-94d2-c67882f84ed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d44f2b3b6d24c6cb8386c993a252c83'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.757525 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c38294bb-5a27-4e55-94d2-c67882f84ed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d44f2b3b6d24c6cb8386c993a252c83'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.763596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-255d7b30-d726-41b2-849a-956a691f3307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbedeaaecd9b4b8f8990a8e5494472bd'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.810203 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c38294bb-5a27-4e55-94d2-c67882f84ed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d44f2b3b6d24c6cb8386c993a252c83'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:34.811724 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:34.826251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1079/2116] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:34 2022] DELETE /identity/v3/users/bbedeaaecd9b4b8f8990a8e5494472bd => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:34.833366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d7b30-d726-41b2-849a-956a691f3307 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:34.840462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-255d7b30-d726-41b2-849a-956a691f3307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:34.842087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1038/2117] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:34 2022] DELETE /identity/v3/users/0d44f2b3b6d24c6cb8386c993a252c83 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:35.043806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d7b30-d726-41b2-849a-956a691f3307 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:35.226430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f364b-696e-4488-bda8-21b9fff2a264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:35.227517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f364b-696e-4488-bda8-21b9fff2a264 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:35.228195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f364b-696e-4488-bda8-21b9fff2a264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:35.230130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f364b-696e-4488-bda8-21b9fff2a264 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:35.231010 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f364b-696e-4488-bda8-21b9fff2a264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:35.235047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f364b-696e-4488-bda8-21b9fff2a264 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:35.302243 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1080/2118] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:34 2022] POST /identity/v3/projects => generated 389 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:35.323332 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38294bb-5a27-4e55-94d2-c67882f84ed6 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:35.325408 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c38294bb-5a27-4e55-94d2-c67882f84ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:35.353405 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38294bb-5a27-4e55-94d2-c67882f84ed6 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:35.491290 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43914b9a-5a93-40ae-8c5a-a6fa95f6b915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:35.492923 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43914b9a-5a93-40ae-8c5a-a6fa95f6b915 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:35.494144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43914b9a-5a93-40ae-8c5a-a6fa95f6b915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:35.495141 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43914b9a-5a93-40ae-8c5a-a6fa95f6b915 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:35.496227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43914b9a-5a93-40ae-8c5a-a6fa95f6b915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:35.498679 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43914b9a-5a93-40ae-8c5a-a6fa95f6b915 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:35.536242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1039/2119] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:35 2022] POST /identity/v3/users => generated 295 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:35.538405 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f364b-696e-4488-bda8-21b9fff2a264 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:35.559098 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f364b-696e-4488-bda8-21b9fff2a264 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:35.571377 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea35e07-aeb0-484a-a2eb-ef302d9d6f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:35.573162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea35e07-aeb0-484a-a2eb-ef302d9d6f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:35.573610 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea35e07-aeb0-484a-a2eb-ef302d9d6f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:35.575352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea35e07-aeb0-484a-a2eb-ef302d9d6f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:35.576928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea35e07-aeb0-484a-a2eb-ef302d9d6f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:35.581126 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea35e07-aeb0-484a-a2eb-ef302d9d6f0c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:35.619081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1081/2120] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:26:35.621574 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43914b9a-5a93-40ae-8c5a-a6fa95f6b915 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:35.645434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43914b9a-5a93-40ae-8c5a-a6fa95f6b915 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:35.665333 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f52c7-bea0-4a79-84a6-26c1f4bb569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:35.666896 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f52c7-bea0-4a79-84a6-26c1f4bb569e admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:35.667426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f52c7-bea0-4a79-84a6-26c1f4bb569e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:35.667889 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f52c7-bea0-4a79-84a6-26c1f4bb569e admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:35.668056 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea35e07-aeb0-484a-a2eb-ef302d9d6f0c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:35.669578 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f52c7-bea0-4a79-84a6-26c1f4bb569e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:35.670927 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4ea35e07-aeb0-484a-a2eb-ef302d9d6f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:35.673135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f52c7-bea0-4a79-84a6-26c1f4bb569e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:35.689736 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea35e07-aeb0-484a-a2eb-ef302d9d6f0c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:35.696035 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9fc5b-954f-48bd-89ca-a953aba1e9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:35.697076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9fc5b-954f-48bd-89ca-a953aba1e9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:35.697316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9fc5b-954f-48bd-89ca-a953aba1e9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:35.697693 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9fc5b-954f-48bd-89ca-a953aba1e9da admin admin] PATH_INFO: `/v3/projects/4858765d602e473c967a45dc3af660a5` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:35.699152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9fc5b-954f-48bd-89ca-a953aba1e9da admin admin] RBAC: Authorizing `identity:delete_project(project_id=4858765d602e473c967a45dc3af660a5)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:35.701558 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9fc5b-954f-48bd-89ca-a953aba1e9da admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:35.702850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1040/2121] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:35.709710 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f52c7-bea0-4a79-84a6-26c1f4bb569e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:35.744104 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f52c7-bea0-4a79-84a6-26c1f4bb569e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:35.757975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725117d-1200-4815-b435-18a57ef53dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:35.759103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725117d-1200-4815-b435-18a57ef53dad admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:35.759661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725117d-1200-4815-b435-18a57ef53dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:35.760195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725117d-1200-4815-b435-18a57ef53dad admin admin] PATH_INFO: `/v3/projects/546e64d12f5941d58b345fff949af58c/users/1711f2ecebea46b68dc22a05bcc77038/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:35.788238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-81a9fc5b-954f-48bd-89ca-a953aba1e9da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4858765d602e473c967a45dc3af660a5', 'request_id': 'req-81a9fc5b-954f-48bd-89ca-a953aba1e9da'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:35.802995 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-81a9fc5b-954f-48bd-89ca-a953aba1e9da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4858765d602e473c967a45dc3af660a5', 'request_id': 'req-81a9fc5b-954f-48bd-89ca-a953aba1e9da'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:35.814340 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725117d-1200-4815-b435-18a57ef53dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=546e64d12f5941d58b345fff949af58c, user_id=1711f2ecebea46b68dc22a05bcc77038, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:35.819387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-81a9fc5b-954f-48bd-89ca-a953aba1e9da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4858765d602e473c967a45dc3af660a5', 'request_id': 'req-81a9fc5b-954f-48bd-89ca-a953aba1e9da'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:35.822869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725117d-1200-4815-b435-18a57ef53dad admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:35.845241 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-81a9fc5b-954f-48bd-89ca-a953aba1e9da admin admin] The token cache is being invalidate because project 4858765d602e473c967a45dc3af660a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:35.845765 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-81a9fc5b-954f-48bd-89ca-a953aba1e9da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:35.847411 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1041/2122] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:35 2022] PUT /identity/v3/projects/546e64d12f5941d58b345fff949af58c/users/1711f2ecebea46b68dc22a05bcc77038/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:35.847883 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-81a9fc5b-954f-48bd-89ca-a953aba1e9da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:35.855096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1082/2123] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:35 2022] DELETE /identity/v3/projects/4858765d602e473c967a45dc3af660a5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:26:35.858531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e97111-4483-4b52-9bcd-54b6d6044a32 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:35.859091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e97111-4483-4b52-9bcd-54b6d6044a32 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:35.859567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e97111-4483-4b52-9bcd-54b6d6044a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:35.867550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e67f66-a9d2-4d18-9192-d8d6d6fd0da2 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:35.868730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e67f66-a9d2-4d18-9192-d8d6d6fd0da2 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:35.869529 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e67f66-a9d2-4d18-9192-d8d6d6fd0da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:35.889356 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-78e97111-4483-4b52-9bcd-54b6d6044a32 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:35.890525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:35.893291 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-78e97111-4483-4b52-9bcd-54b6d6044a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:35.944966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:36.027254 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-44e67f66-a9d2-4d18-9192-d8d6d6fd0da2 None None] MFA Rules not processed for user `1711f2ecebea46b68dc22a05bcc77038`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:36.029616 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-44e67f66-a9d2-4d18-9192-d8d6d6fd0da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:36.160243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1042/2124] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:36.172968 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f9629-cbd6-4772-8932-e8ef67298ff0 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:36.176663 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f9629-cbd6-4772-8932-e8ef67298ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:36.177072 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f9629-cbd6-4772-8932-e8ef67298ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:36.258141 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-464f9629-cbd6-4772-8932-e8ef67298ff0 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:36.263802 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-464f9629-cbd6-4772-8932-e8ef67298ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:36.299797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1043/2125] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:36.301289 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f9629-cbd6-4772-8932-e8ef67298ff0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:36.305382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1083/2126] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:36.310296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e67f66-a9d2-4d18-9192-d8d6d6fd0da2 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:36.314339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-44e67f66-a9d2-4d18-9192-d8d6d6fd0da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:36.334116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f9629-cbd6-4772-8932-e8ef67298ff0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:36.359249 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d2149-37d9-47b5-8d3f-45ead32b06e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:36.361280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d2149-37d9-47b5-8d3f-45ead32b06e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:36.362178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d2149-37d9-47b5-8d3f-45ead32b06e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:36.362903 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d2149-37d9-47b5-8d3f-45ead32b06e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:36.367269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d2149-37d9-47b5-8d3f-45ead32b06e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:36.369890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d2149-37d9-47b5-8d3f-45ead32b06e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:36.374177 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e67f66-a9d2-4d18-9192-d8d6d6fd0da2 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:36.379995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d2149-37d9-47b5-8d3f-45ead32b06e5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:36.380648 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be924cd-5595-4a79-8fb8-37a05fba7f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:36.381313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be924cd-5595-4a79-8fb8-37a05fba7f02 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:36.381597 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be924cd-5595-4a79-8fb8-37a05fba7f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:36.382062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be924cd-5595-4a79-8fb8-37a05fba7f02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:36.382563 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be924cd-5595-4a79-8fb8-37a05fba7f02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:36.384578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be924cd-5595-4a79-8fb8-37a05fba7f02 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:36.436643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1044/2127] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:36.437703 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1084/2128] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:36 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:36.438645 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be924cd-5595-4a79-8fb8-37a05fba7f02 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:36.441465 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d2149-37d9-47b5-8d3f-45ead32b06e5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:36.450708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e28d2149-37d9-47b5-8d3f-45ead32b06e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:36.500404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d2149-37d9-47b5-8d3f-45ead32b06e5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:36.601246 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be924cd-5595-4a79-8fb8-37a05fba7f02 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:36.609032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba0688-5116-47ff-b531-0c845a719a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:36.609692 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba0688-5116-47ff-b531-0c845a719a3c admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:36.609980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba0688-5116-47ff-b531-0c845a719a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:36.610264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba0688-5116-47ff-b531-0c845a719a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:36.611220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba0688-5116-47ff-b531-0c845a719a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:36.613511 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba0688-5116-47ff-b531-0c845a719a3c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:36.664156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1085/2129] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:36 2022] POST /identity/v3/projects => generated 361 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:36.665144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba0688-5116-47ff-b531-0c845a719a3c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:36.725580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1b0b6-6ac7-491d-801d-72634cab9101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:36.726366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1b0b6-6ac7-491d-801d-72634cab9101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:36.726730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1b0b6-6ac7-491d-801d-72634cab9101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:36.727090 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1b0b6-6ac7-491d-801d-72634cab9101 admin admin] PATH_INFO: `/v3/projects/1c6c906aa7354ccab0b2999e4eee4cf3` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:36.731752 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1b0b6-6ac7-491d-801d-72634cab9101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6c906aa7354ccab0b2999e4eee4cf3)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:36.735950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1b0b6-6ac7-491d-801d-72634cab9101 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:36.815250 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:36.833375 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba0688-5116-47ff-b531-0c845a719a3c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:36.850897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-92f1b0b6-6ac7-491d-801d-72634cab9101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6c906aa7354ccab0b2999e4eee4cf3', 'request_id': 'req-92f1b0b6-6ac7-491d-801d-72634cab9101'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:36.868774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-92f1b0b6-6ac7-491d-801d-72634cab9101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6c906aa7354ccab0b2999e4eee4cf3', 'request_id': 'req-92f1b0b6-6ac7-491d-801d-72634cab9101'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:36.894197 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-92f1b0b6-6ac7-491d-801d-72634cab9101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6c906aa7354ccab0b2999e4eee4cf3', 'request_id': 'req-92f1b0b6-6ac7-491d-801d-72634cab9101'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:36.949023 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-92f1b0b6-6ac7-491d-801d-72634cab9101 admin admin] The token cache is being invalidate because project 1c6c906aa7354ccab0b2999e4eee4cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:36.952129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-92f1b0b6-6ac7-491d-801d-72634cab9101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:36.954262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-92f1b0b6-6ac7-491d-801d-72634cab9101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:36.958616 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1045/2130] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:36 2022] DELETE /identity/v3/projects/1c6c906aa7354ccab0b2999e4eee4cf3 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:36.959905 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1b0b6-6ac7-491d-801d-72634cab9101 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:36.965195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-92f1b0b6-6ac7-491d-801d-72634cab9101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:37.040997 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:37.077055 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398ef2e-5479-4dc0-a7a4-00a3f31685ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:37.078156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398ef2e-5479-4dc0-a7a4-00a3f31685ca admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:37.078655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398ef2e-5479-4dc0-a7a4-00a3f31685ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:37.079142 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398ef2e-5479-4dc0-a7a4-00a3f31685ca admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:37.080501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398ef2e-5479-4dc0-a7a4-00a3f31685ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:37.084561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398ef2e-5479-4dc0-a7a4-00a3f31685ca admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:37.126888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1b0b6-6ac7-491d-801d-72634cab9101 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:37.173602 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3861d-f38a-4864-b730-a7a7bc63d767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:37.174275 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3861d-f38a-4864-b730-a7a7bc63d767 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:37.175136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3861d-f38a-4864-b730-a7a7bc63d767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:37.175136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3861d-f38a-4864-b730-a7a7bc63d767 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:37.176636 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3861d-f38a-4864-b730-a7a7bc63d767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:37.179831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3861d-f38a-4864-b730-a7a7bc63d767 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:37.190198 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1086/2131] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:36 2022] POST /identity/v3/users => generated 299 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:37.204416 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4bcd5-5cfe-4a30-b72e-e479225ffcdc None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:37.205666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4bcd5-5cfe-4a30-b72e-e479225ffcdc None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:37.206243 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4bcd5-5cfe-4a30-b72e-e479225ffcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:37.225990 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1046/2132] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:36 2022] POST /identity/v3/users => generated 281 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:37.227157 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3861d-f38a-4864-b730-a7a7bc63d767 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:37.232381 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cdb3861d-f38a-4864-b730-a7a7bc63d767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:37.261373 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3861d-f38a-4864-b730-a7a7bc63d767 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:37.263012 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e3f4bcd5-5cfe-4a30-b72e-e479225ffcdc None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:37.267158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10da13c-59c8-4876-861c-0ad50db8799d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:37.267388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e3f4bcd5-5cfe-4a30-b72e-e479225ffcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:37.268055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10da13c-59c8-4876-861c-0ad50db8799d admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:37.268477 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10da13c-59c8-4876-861c-0ad50db8799d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:37.268857 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10da13c-59c8-4876-861c-0ad50db8799d admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:37.270354 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10da13c-59c8-4876-861c-0ad50db8799d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:37.272489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10da13c-59c8-4876-861c-0ad50db8799d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:37.290045 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1047/2133] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:37.290045 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10da13c-59c8-4876-861c-0ad50db8799d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:37.297485 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1087/2134] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:37.298616 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4bcd5-5cfe-4a30-b72e-e479225ffcdc None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:37.313133 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10da13c-59c8-4876-861c-0ad50db8799d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:37.321983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4bcd5-5cfe-4a30-b72e-e479225ffcdc None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:37.322198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acece9c8-0783-46a1-a2e4-7b9160903ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:37.322993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acece9c8-0783-46a1-a2e4-7b9160903ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:37.323297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acece9c8-0783-46a1-a2e4-7b9160903ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:37.323578 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acece9c8-0783-46a1-a2e4-7b9160903ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:37.325106 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acece9c8-0783-46a1-a2e4-7b9160903ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:37.337590 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acece9c8-0783-46a1-a2e4-7b9160903ea6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:37.339786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea46868-b0df-4e16-af75-72259ff54242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:37.343717 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46868-b0df-4e16-af75-72259ff54242 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:37.350719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46868-b0df-4e16-af75-72259ff54242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:37.351499 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46868-b0df-4e16-af75-72259ff54242 admin admin] PATH_INFO: `/v3/projects/70363e186f4248e18c51b2dd325857ea/users/96a407f28bbd4543be23fcb280073ad5/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:37.366259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1048/2135] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:37.369355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa653-27cf-403e-9727-372a0d0bcacc None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:37.369848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa653-27cf-403e-9727-372a0d0bcacc None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:37.370317 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa653-27cf-403e-9727-372a0d0bcacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:37.412196 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a92fa653-27cf-403e-9727-372a0d0bcacc None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:37.414486 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a92fa653-27cf-403e-9727-372a0d0bcacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:37.426321 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea46868-b0df-4e16-af75-72259ff54242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70363e186f4248e18c51b2dd325857ea, user_id=96a407f28bbd4543be23fcb280073ad5, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:37.435068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea46868-b0df-4e16-af75-72259ff54242 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:37.467922 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1049/2136] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:37.469162 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa653-27cf-403e-9727-372a0d0bcacc None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:37.524159 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1088/2137] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:37 2022] PUT /identity/v3/projects/70363e186f4248e18c51b2dd325857ea/users/96a407f28bbd4543be23fcb280073ad5/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:37.524159 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea46868-b0df-4e16-af75-72259ff54242 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:37.528563 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa653-27cf-403e-9727-372a0d0bcacc None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:37.809377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb90ff2-a5fd-412e-a2dc-38eedb8dbf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:37.810889 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb90ff2-a5fd-412e-a2dc-38eedb8dbf95 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:37.811584 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb90ff2-a5fd-412e-a2dc-38eedb8dbf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:37.812710 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb90ff2-a5fd-412e-a2dc-38eedb8dbf95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:37.815256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb90ff2-a5fd-412e-a2dc-38eedb8dbf95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:37.826775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb90ff2-a5fd-412e-a2dc-38eedb8dbf95 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:37.855611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1050/2138] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:37.856849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb90ff2-a5fd-412e-a2dc-38eedb8dbf95 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:37.877550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea46868-b0df-4e16-af75-72259ff54242 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:37.878063 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb90ff2-a5fd-412e-a2dc-38eedb8dbf95 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:37.896095 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c964298-c260-429c-b11f-ee96d3eea1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:37.899519 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c964298-c260-429c-b11f-ee96d3eea1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:37.900406 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c964298-c260-429c-b11f-ee96d3eea1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:37.901212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c964298-c260-429c-b11f-ee96d3eea1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:37.902803 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c964298-c260-429c-b11f-ee96d3eea1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:37.905024 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d43505-2f2c-4f4a-a982-a9eb2273ccab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:37.905874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d43505-2f2c-4f4a-a982-a9eb2273ccab admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:37.906168 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d43505-2f2c-4f4a-a982-a9eb2273ccab admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:37.906452 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d43505-2f2c-4f4a-a982-a9eb2273ccab admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:37.906944 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c964298-c260-429c-b11f-ee96d3eea1b5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:37.907204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d43505-2f2c-4f4a-a982-a9eb2273ccab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:37.907521 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d43505-2f2c-4f4a-a982-a9eb2273ccab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:37.909503 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d43505-2f2c-4f4a-a982-a9eb2273ccab admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:37.936692 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1089/2139] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:37.938127 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d43505-2f2c-4f4a-a982-a9eb2273ccab admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:37.941831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1051/2140] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:37.944929 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c964298-c260-429c-b11f-ee96d3eea1b5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:37.966017 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d43505-2f2c-4f4a-a982-a9eb2273ccab admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:37.970342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c964298-c260-429c-b11f-ee96d3eea1b5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:37.977465 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b70415-70c1-4765-9128-aaf3eaed8343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:37.979362 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b70415-70c1-4765-9128-aaf3eaed8343 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:37.979947 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b70415-70c1-4765-9128-aaf3eaed8343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:37.980362 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b70415-70c1-4765-9128-aaf3eaed8343 admin admin] PATH_INFO: `/v3/projects/af89ff0285a54924b1e94c653909fdfa/users/72f19ce07e454307a531e01dd57cd9ff/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:37.981434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac8fe3-47d1-4a87-ad8f-989e2a565b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:37.982746 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac8fe3-47d1-4a87-ad8f-989e2a565b1a admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:37.983602 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac8fe3-47d1-4a87-ad8f-989e2a565b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:37.984300 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac8fe3-47d1-4a87-ad8f-989e2a565b1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:37.985717 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac8fe3-47d1-4a87-ad8f-989e2a565b1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:37.989956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac8fe3-47d1-4a87-ad8f-989e2a565b1a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:38.021781 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b70415-70c1-4765-9128-aaf3eaed8343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af89ff0285a54924b1e94c653909fdfa, user_id=72f19ce07e454307a531e01dd57cd9ff, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:38.029476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b70415-70c1-4765-9128-aaf3eaed8343 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:38.073338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1090/2141] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:37 2022] PUT /identity/v3/projects/af89ff0285a54924b1e94c653909fdfa/users/72f19ce07e454307a531e01dd57cd9ff/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:38.075438 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b70415-70c1-4765-9128-aaf3eaed8343 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:38.126665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1052/2142] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:37 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:38.129440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b71c75-fdf4-4850-aabf-fe484e7561ea None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:38.130230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b71c75-fdf4-4850-aabf-fe484e7561ea None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:38.130922 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b71c75-fdf4-4850-aabf-fe484e7561ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:38.131500 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:38.197840 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b70415-70c1-4765-9128-aaf3eaed8343 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:38.209201 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b2b71c75-fdf4-4850-aabf-fe484e7561ea None None] MFA Rules not processed for user `72f19ce07e454307a531e01dd57cd9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:38.211613 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b2b71c75-fdf4-4850-aabf-fe484e7561ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:38.342193 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f60a0-4957-4c02-900b-c40b20cf3cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:38.343668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f60a0-4957-4c02-900b-c40b20cf3cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:38.345184 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f60a0-4957-4c02-900b-c40b20cf3cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:38.345846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f60a0-4957-4c02-900b-c40b20cf3cf8 admin admin] PATH_INFO: `/v3/projects/70363e186f4248e18c51b2dd325857ea/users/96a407f28bbd4543be23fcb280073ad5/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:38.356695 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f60a0-4957-4c02-900b-c40b20cf3cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70363e186f4248e18c51b2dd325857ea, user_id=96a407f28bbd4543be23fcb280073ad5, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:38.362506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:38.366532 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f60a0-4957-4c02-900b-c40b20cf3cf8 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:38.403826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1091/2143] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:38 2022] PUT /identity/v3/projects/70363e186f4248e18c51b2dd325857ea/users/96a407f28bbd4543be23fcb280073ad5/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:38.405477 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f60a0-4957-4c02-900b-c40b20cf3cf8 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:38.444749 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1053/2144] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:38.448823 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b389a-4d5d-4fa6-aafd-f8aa77dca5bf None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:38.449077 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b389a-4d5d-4fa6-aafd-f8aa77dca5bf None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:38.449749 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b389a-4d5d-4fa6-aafd-f8aa77dca5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:38.587354 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c26b389a-4d5d-4fa6-aafd-f8aa77dca5bf None None] MFA Rules not processed for user `96a407f28bbd4543be23fcb280073ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:38.590634 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c26b389a-4d5d-4fa6-aafd-f8aa77dca5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:38.620633 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f60a0-4957-4c02-900b-c40b20cf3cf8 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:38.645253 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9a610-10c4-490a-a19b-5c425a375625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:38.647555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9a610-10c4-490a-a19b-5c425a375625 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:38.647983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9a610-10c4-490a-a19b-5c425a375625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:38.654145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9a610-10c4-490a-a19b-5c425a375625 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:38.655392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9a610-10c4-490a-a19b-5c425a375625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:38.662484 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9a610-10c4-490a-a19b-5c425a375625 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:38.730362 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1092/2145] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:38 2022] POST /identity/v3/users => generated 293 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:38.730362 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9a610-10c4-490a-a19b-5c425a375625 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:38.737360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-43b9a610-10c4-490a-a19b-5c425a375625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:38.765614 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1054/2146] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:38.767460 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b389a-4d5d-4fa6-aafd-f8aa77dca5bf None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:38.787952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b389a-4d5d-4fa6-aafd-f8aa77dca5bf None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:38.814142 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fc9c6-c141-4054-b881-bdf685b9ac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:38.820387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fc9c6-c141-4054-b881-bdf685b9ac20 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:38.821625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fc9c6-c141-4054-b881-bdf685b9ac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:38.824761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fc9c6-c141-4054-b881-bdf685b9ac20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:38.827014 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fc9c6-c141-4054-b881-bdf685b9ac20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:38.832223 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fc9c6-c141-4054-b881-bdf685b9ac20 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:38.868659 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1055/2147] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:38.870234 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fc9c6-c141-4054-b881-bdf685b9ac20 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:38.875438 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-228fc9c6-c141-4054-b881-bdf685b9ac20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:38.889455 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9a610-10c4-490a-a19b-5c425a375625 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:38.896214 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097abf5-bcb2-4d80-9e2b-5f7b57ba48aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:38.898061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097abf5-bcb2-4d80-9e2b-5f7b57ba48aa service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:38.899535 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097abf5-bcb2-4d80-9e2b-5f7b57ba48aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:38.900485 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097abf5-bcb2-4d80-9e2b-5f7b57ba48aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:38.928758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:38.942079 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fc9c6-c141-4054-b881-bdf685b9ac20 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:38.963396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f4fd8-3d0a-46c9-8f60-fcff081272d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:38.967310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f4fd8-3d0a-46c9-8f60-fcff081272d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:38.967620 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f4fd8-3d0a-46c9-8f60-fcff081272d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:38.968131 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f4fd8-3d0a-46c9-8f60-fcff081272d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:38.998519 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f4fd8-3d0a-46c9-8f60-fcff081272d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:39.000053 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097abf5-bcb2-4d80-9e2b-5f7b57ba48aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:39.001772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f4fd8-3d0a-46c9-8f60-fcff081272d9 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:39.002113 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097abf5-bcb2-4d80-9e2b-5f7b57ba48aa service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:39.017126 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1093/2148] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:39.018713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097abf5-bcb2-4d80-9e2b-5f7b57ba48aa service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:39.034442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1056/2149] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:39.041598 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097abf5-bcb2-4d80-9e2b-5f7b57ba48aa service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:39.047729 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e21c04-d96f-439f-8da0-c2c0c6bb3514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:39.048455 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e21c04-d96f-439f-8da0-c2c0c6bb3514 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:39.049403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e21c04-d96f-439f-8da0-c2c0c6bb3514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:39.049685 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e21c04-d96f-439f-8da0-c2c0c6bb3514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:39.051132 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e21c04-d96f-439f-8da0-c2c0c6bb3514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:39.053265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e21c04-d96f-439f-8da0-c2c0c6bb3514 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:39.072708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1094/2150] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:39.076735 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f4fd8-3d0a-46c9-8f60-fcff081272d9 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:39.078865 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e21c04-d96f-439f-8da0-c2c0c6bb3514 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:39.104642 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f4fd8-3d0a-46c9-8f60-fcff081272d9 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:39.118556 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabfe2eb-54ed-4eca-af0f-a55201680be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:39.119640 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfe2eb-54ed-4eca-af0f-a55201680be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:39.122095 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfe2eb-54ed-4eca-af0f-a55201680be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:39.123539 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabfe2eb-54ed-4eca-af0f-a55201680be9 admin admin] PATH_INFO: `/v3/users/72f19ce07e454307a531e01dd57cd9ff` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:39.127832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabfe2eb-54ed-4eca-af0f-a55201680be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f19ce07e454307a531e01dd57cd9ff)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:39.133537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabfe2eb-54ed-4eca-af0f-a55201680be9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:39.186716 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e21c04-d96f-439f-8da0-c2c0c6bb3514 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:39.244546 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955da3b-0a8a-463d-8613-f41533cefc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:39.248154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fabfe2eb-54ed-4eca-af0f-a55201680be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f19ce07e454307a531e01dd57cd9ff'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:39.248779 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955da3b-0a8a-463d-8613-f41533cefc16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:39.248964 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fabfe2eb-54ed-4eca-af0f-a55201680be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f19ce07e454307a531e01dd57cd9ff'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:39.249437 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955da3b-0a8a-463d-8613-f41533cefc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:39.249879 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955da3b-0a8a-463d-8613-f41533cefc16 admin admin] PATH_INFO: `/v3/projects/2215b8c9e5a146c091da43816d5982a0/users/266569e498d84613acfca220a1920333/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:39.266069 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fabfe2eb-54ed-4eca-af0f-a55201680be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f19ce07e454307a531e01dd57cd9ff'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:39.308938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fabfe2eb-54ed-4eca-af0f-a55201680be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f19ce07e454307a531e01dd57cd9ff'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:39.331347 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fabfe2eb-54ed-4eca-af0f-a55201680be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f19ce07e454307a531e01dd57cd9ff'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:39.349455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1057/2151] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:39 2022] DELETE /identity/v3/users/72f19ce07e454307a531e01dd57cd9ff => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:39.356500 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436b4ab-5380-48ef-86e9-b62f2caf0d93 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:39.356822 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436b4ab-5380-48ef-86e9-b62f2caf0d93 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:39.357053 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436b4ab-5380-48ef-86e9-b62f2caf0d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:39.381643 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955da3b-0a8a-463d-8613-f41533cefc16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2215b8c9e5a146c091da43816d5982a0, user_id=266569e498d84613acfca220a1920333, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:39.387018 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955da3b-0a8a-463d-8613-f41533cefc16 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:39.426814 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9436b4ab-5380-48ef-86e9-b62f2caf0d93 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:39.429098 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9436b4ab-5380-48ef-86e9-b62f2caf0d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:39.456048 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1095/2152] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:39 2022] PUT /identity/v3/projects/2215b8c9e5a146c091da43816d5982a0/users/266569e498d84613acfca220a1920333/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:39.469694 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83ec9-fe84-4a18-82ef-9264a68bbadd None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:39.470266 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83ec9-fe84-4a18-82ef-9264a68bbadd None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:39.470773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83ec9-fe84-4a18-82ef-9264a68bbadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:39.483517 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:39.602420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-91b83ec9-fe84-4a18-82ef-9264a68bbadd None None] MFA Rules not processed for user `266569e498d84613acfca220a1920333`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:39.605004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-91b83ec9-fe84-4a18-82ef-9264a68bbadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:39.674222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1058/2153] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:39.675993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436b4ab-5380-48ef-86e9-b62f2caf0d93 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:39.685397 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9436b4ab-5380-48ef-86e9-b62f2caf0d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:39.714133 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436b4ab-5380-48ef-86e9-b62f2caf0d93 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:39.789567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36840d9-b1b8-4aac-b8c1-2c5821403dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:39.790233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36840d9-b1b8-4aac-b8c1-2c5821403dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:39.790516 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36840d9-b1b8-4aac-b8c1-2c5821403dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:39.790797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36840d9-b1b8-4aac-b8c1-2c5821403dff admin admin] PATH_INFO: `/v3/users/1711f2ecebea46b68dc22a05bcc77038` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:39.792312 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36840d9-b1b8-4aac-b8c1-2c5821403dff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1711f2ecebea46b68dc22a05bcc77038)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:39.794289 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36840d9-b1b8-4aac-b8c1-2c5821403dff admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:39.895572 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1096/2154] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:26:39.895572 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b83ec9-fe84-4a18-82ef-9264a68bbadd None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:39.897610 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f36840d9-b1b8-4aac-b8c1-2c5821403dff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1711f2ecebea46b68dc22a05bcc77038'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:39.899107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-91b83ec9-fe84-4a18-82ef-9264a68bbadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:39.899643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f36840d9-b1b8-4aac-b8c1-2c5821403dff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1711f2ecebea46b68dc22a05bcc77038'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:39.922362 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f36840d9-b1b8-4aac-b8c1-2c5821403dff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1711f2ecebea46b68dc22a05bcc77038'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:39.953486 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f36840d9-b1b8-4aac-b8c1-2c5821403dff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1711f2ecebea46b68dc22a05bcc77038'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:39.972558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f36840d9-b1b8-4aac-b8c1-2c5821403dff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1711f2ecebea46b68dc22a05bcc77038'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:40.014015 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1059/2155] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:39 2022] DELETE /identity/v3/users/1711f2ecebea46b68dc22a05bcc77038 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:40.016848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36840d9-b1b8-4aac-b8c1-2c5821403dff admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:40.021239 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f36840d9-b1b8-4aac-b8c1-2c5821403dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:40.060807 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b83ec9-fe84-4a18-82ef-9264a68bbadd None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:40.174242 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:40.245119 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:40.262531 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa2e44-6e60-4a39-b2ef-9ce4e07ec672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:40.263659 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa2e44-6e60-4a39-b2ef-9ce4e07ec672 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:40.264312 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa2e44-6e60-4a39-b2ef-9ce4e07ec672 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:40.264830 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa2e44-6e60-4a39-b2ef-9ce4e07ec672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:40.272283 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a0fa2e44-6e60-4a39-b2ef-9ce4e07ec672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:40.362984 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36840d9-b1b8-4aac-b8c1-2c5821403dff admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:40.377724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b615383-aade-41ad-9144-f8737606c077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:40.380905 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b615383-aade-41ad-9144-f8737606c077 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:40.381699 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b615383-aade-41ad-9144-f8737606c077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:40.382722 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b615383-aade-41ad-9144-f8737606c077 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:40.384486 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b615383-aade-41ad-9144-f8737606c077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:40.390057 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b615383-aade-41ad-9144-f8737606c077 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:40.431185 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa2e44-6e60-4a39-b2ef-9ce4e07ec672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:40.436813 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa2e44-6e60-4a39-b2ef-9ce4e07ec672 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:40.456405 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1060/2156] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:40 2022] POST /identity/v3/projects => generated 387 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:40.456405 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7af1-0e82-47cd-95f3-b16ec42ee3ce None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:40.456405 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7af1-0e82-47cd-95f3-b16ec42ee3ce None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:40.456405 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7af1-0e82-47cd-95f3-b16ec42ee3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:40.464583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1097/2157] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:40.469308 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa2e44-6e60-4a39-b2ef-9ce4e07ec672 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:40.495754 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa2e44-6e60-4a39-b2ef-9ce4e07ec672 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:40.502482 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-026a7af1-0e82-47cd-95f3-b16ec42ee3ce None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:40.508238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-026a7af1-0e82-47cd-95f3-b16ec42ee3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:40.602620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbb901-a8c7-4643-b8d9-bfe1338b628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:40.603383 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbb901-a8c7-4643-b8d9-bfe1338b628e admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:40.603738 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbb901-a8c7-4643-b8d9-bfe1338b628e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:40.604109 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbb901-a8c7-4643-b8d9-bfe1338b628e admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:40.605256 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cbb901-a8c7-4643-b8d9-bfe1338b628e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:40.607557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cbb901-a8c7-4643-b8d9-bfe1338b628e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:40.641151 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1098/2158] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:40 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:40.648351 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbb901-a8c7-4643-b8d9-bfe1338b628e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:40.661392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbb901-a8c7-4643-b8d9-bfe1338b628e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:40.669889 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31933857-80cf-48bd-ac4d-8631b470a6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:40.670998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31933857-80cf-48bd-ac4d-8631b470a6fe admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:40.670998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31933857-80cf-48bd-ac4d-8631b470a6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:40.671183 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31933857-80cf-48bd-ac4d-8631b470a6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:40.671848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31933857-80cf-48bd-ac4d-8631b470a6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:40.674107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31933857-80cf-48bd-ac4d-8631b470a6fe admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:40.684343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1061/2159] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:40.686977 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1099/2160] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:40.694128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a7af1-0e82-47cd-95f3-b16ec42ee3ce None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:40.697302 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31933857-80cf-48bd-ac4d-8631b470a6fe admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:40.700202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-31933857-80cf-48bd-ac4d-8631b470a6fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:40.706649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a7af1-0e82-47cd-95f3-b16ec42ee3ce None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:40.714535 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbcd43-10a3-4b2e-9d3d-a11b032c4292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:40.715410 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbcd43-10a3-4b2e-9d3d-a11b032c4292 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:40.715757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbcd43-10a3-4b2e-9d3d-a11b032c4292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:40.716447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbcd43-10a3-4b2e-9d3d-a11b032c4292 admin admin] PATH_INFO: `/v3/projects/af87b7b90a894baa963ca1ed92057d9d/users/3dff48bd15924f7ea4505cd2bfa8d5d7/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:40.740820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbcd43-10a3-4b2e-9d3d-a11b032c4292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af87b7b90a894baa963ca1ed92057d9d, user_id=3dff48bd15924f7ea4505cd2bfa8d5d7, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:40.745765 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbcd43-10a3-4b2e-9d3d-a11b032c4292 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:40.773714 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1062/2161] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:40 2022] PUT /identity/v3/projects/af87b7b90a894baa963ca1ed92057d9d/users/3dff48bd15924f7ea4505cd2bfa8d5d7/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:40.779647 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbcd43-10a3-4b2e-9d3d-a11b032c4292 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:40.820728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31933857-80cf-48bd-ac4d-8631b470a6fe admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:40.839148 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:40.916434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbcd43-10a3-4b2e-9d3d-a11b032c4292 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:40.921566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0a63d-c7ed-4a93-a22f-ebd4efcea184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:40.922272 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0a63d-c7ed-4a93-a22f-ebd4efcea184 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:40.922716 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0a63d-c7ed-4a93-a22f-ebd4efcea184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:40.922920 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0a63d-c7ed-4a93-a22f-ebd4efcea184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:40.923698 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0a63d-c7ed-4a93-a22f-ebd4efcea184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:40.925457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0a63d-c7ed-4a93-a22f-ebd4efcea184 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:40.943453 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1063/2162] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:26:40.944779 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0a63d-c7ed-4a93-a22f-ebd4efcea184 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:40.948423 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb138af-fe29-4ae3-9185-4e71863b9821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:40.949566 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb138af-fe29-4ae3-9185-4e71863b9821 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:40.950562 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb138af-fe29-4ae3-9185-4e71863b9821 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:40.951150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb138af-fe29-4ae3-9185-4e71863b9821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:40.959004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0a63d-c7ed-4a93-a22f-ebd4efcea184 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:40.966147 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd82168-19e3-4fdb-9e7d-ebe702fab855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:40.967383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd82168-19e3-4fdb-9e7d-ebe702fab855 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:40.967829 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd82168-19e3-4fdb-9e7d-ebe702fab855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:40.968476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd82168-19e3-4fdb-9e7d-ebe702fab855 admin admin] PATH_INFO: `/v3/projects/af87b7b90a894baa963ca1ed92057d9d/users/3dff48bd15924f7ea4505cd2bfa8d5d7/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:40.969794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb138af-fe29-4ae3-9185-4e71863b9821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:40.970849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd82168-19e3-4fdb-9e7d-ebe702fab855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af87b7b90a894baa963ca1ed92057d9d, user_id=3dff48bd15924f7ea4505cd2bfa8d5d7, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:40.971940 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb138af-fe29-4ae3-9185-4e71863b9821 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:40.974254 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd82168-19e3-4fdb-9e7d-ebe702fab855 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:40.987433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1100/2163] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:40.990131 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb138af-fe29-4ae3-9185-4e71863b9821 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:40.991975 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-edb138af-fe29-4ae3-9185-4e71863b9821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:41.001592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1064/2164] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:40 2022] PUT /identity/v3/projects/af87b7b90a894baa963ca1ed92057d9d/users/3dff48bd15924f7ea4505cd2bfa8d5d7/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:26:41.014870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e3a93-9869-46d8-9d77-993269869df4 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:41.015391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e3a93-9869-46d8-9d77-993269869df4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:41.020426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e3a93-9869-46d8-9d77-993269869df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:41.029389 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb138af-fe29-4ae3-9185-4e71863b9821 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:41.074460 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-2c6e3a93-9869-46d8-9d77-993269869df4 None None] MFA Rules not processed for user `3dff48bd15924f7ea4505cd2bfa8d5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:41.076624 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2c6e3a93-9869-46d8-9d77-993269869df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:41.085408 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:41.220253 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007d322-2345-4191-8d0d-1916f73c60e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:41.222114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007d322-2345-4191-8d0d-1916f73c60e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:41.222927 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007d322-2345-4191-8d0d-1916f73c60e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:41.223420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007d322-2345-4191-8d0d-1916f73c60e2 admin admin] PATH_INFO: `/v3/users/a7faaaa36a964813b0d9ec887fabb6ee` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:41.227292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007d322-2345-4191-8d0d-1916f73c60e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7faaaa36a964813b0d9ec887fabb6ee)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:41.230670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007d322-2345-4191-8d0d-1916f73c60e2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:41.240037 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1065/2165] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:26:41.262491 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e3a93-9869-46d8-9d77-993269869df4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:41.264242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2c6e3a93-9869-46d8-9d77-993269869df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:41.369028 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7007d322-2345-4191-8d0d-1916f73c60e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7faaaa36a964813b0d9ec887fabb6ee'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:41.377578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7007d322-2345-4191-8d0d-1916f73c60e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7faaaa36a964813b0d9ec887fabb6ee'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:41.401242 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7007d322-2345-4191-8d0d-1916f73c60e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7faaaa36a964813b0d9ec887fabb6ee'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:41.414606 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7007d322-2345-4191-8d0d-1916f73c60e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7faaaa36a964813b0d9ec887fabb6ee'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:41.436148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e3a93-9869-46d8-9d77-993269869df4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:41.459434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752b56f-0982-427c-aeca-09c1d680c7eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:41.462321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752b56f-0982-427c-aeca-09c1d680c7eb service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:41.464930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752b56f-0982-427c-aeca-09c1d680c7eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:41.468790 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752b56f-0982-427c-aeca-09c1d680c7eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:41.471389 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7007d322-2345-4191-8d0d-1916f73c60e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7faaaa36a964813b0d9ec887fabb6ee'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:41.477481 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d752b56f-0982-427c-aeca-09c1d680c7eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:41.515357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1101/2166] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:40 2022] DELETE /identity/v3/users/a7faaaa36a964813b0d9ec887fabb6ee => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:41.529505 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752b56f-0982-427c-aeca-09c1d680c7eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:41.532884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752b56f-0982-427c-aeca-09c1d680c7eb service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:41.557043 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1066/2167] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:41.788537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007d322-2345-4191-8d0d-1916f73c60e2 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:41.788537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7007d322-2345-4191-8d0d-1916f73c60e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:41.914143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:41.995470 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007d322-2345-4191-8d0d-1916f73c60e2 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:42.020790 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade7da3-a077-4a37-a697-97d658c4cdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:42.021604 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade7da3-a077-4a37-a697-97d658c4cdff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:42.021929 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade7da3-a077-4a37-a697-97d658c4cdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:42.022843 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade7da3-a077-4a37-a697-97d658c4cdff admin admin] PATH_INFO: `/v3/projects/af89ff0285a54924b1e94c653909fdfa` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:42.024463 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade7da3-a077-4a37-a697-97d658c4cdff admin admin] RBAC: Authorizing `identity:delete_project(project_id=af89ff0285a54924b1e94c653909fdfa)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:42.033552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade7da3-a077-4a37-a697-97d658c4cdff admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:42.060466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752b56f-0982-427c-aeca-09c1d680c7eb service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:42.065404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d752b56f-0982-427c-aeca-09c1d680c7eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:42.127611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752b56f-0982-427c-aeca-09c1d680c7eb service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:42.140000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5ade7da3-a077-4a37-a697-97d658c4cdff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af89ff0285a54924b1e94c653909fdfa', 'request_id': 'req-5ade7da3-a077-4a37-a697-97d658c4cdff'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.150522 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5ade7da3-a077-4a37-a697-97d658c4cdff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af89ff0285a54924b1e94c653909fdfa', 'request_id': 'req-5ade7da3-a077-4a37-a697-97d658c4cdff'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.162911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5ade7da3-a077-4a37-a697-97d658c4cdff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af89ff0285a54924b1e94c653909fdfa', 'request_id': 'req-5ade7da3-a077-4a37-a697-97d658c4cdff'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.202085 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5ade7da3-a077-4a37-a697-97d658c4cdff admin admin] The token cache is being invalidate because project af89ff0285a54924b1e94c653909fdfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:42.202653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5ade7da3-a077-4a37-a697-97d658c4cdff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.203985 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5ade7da3-a077-4a37-a697-97d658c4cdff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.207076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1102/2168] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:41 2022] DELETE /identity/v3/projects/af89ff0285a54924b1e94c653909fdfa => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:42.208529 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade7da3-a077-4a37-a697-97d658c4cdff admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:42.224776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5ade7da3-a077-4a37-a697-97d658c4cdff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:42.292723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8432a-8c3c-4ff5-9614-1c814db52e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:42.295731 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8432a-8c3c-4ff5-9614-1c814db52e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:42.296196 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8432a-8c3c-4ff5-9614-1c814db52e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:42.296573 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8432a-8c3c-4ff5-9614-1c814db52e9e admin admin] PATH_INFO: `/v3/projects/546e64d12f5941d58b345fff949af58c` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:42.298003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8432a-8c3c-4ff5-9614-1c814db52e9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=546e64d12f5941d58b345fff949af58c)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:42.300106 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8432a-8c3c-4ff5-9614-1c814db52e9e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:42.404619 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade7da3-a077-4a37-a697-97d658c4cdff admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:42.413801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:42.416500 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2ef8432a-8c3c-4ff5-9614-1c814db52e9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546e64d12f5941d58b345fff949af58c', 'request_id': 'req-2ef8432a-8c3c-4ff5-9614-1c814db52e9e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.449554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2ef8432a-8c3c-4ff5-9614-1c814db52e9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546e64d12f5941d58b345fff949af58c', 'request_id': 'req-2ef8432a-8c3c-4ff5-9614-1c814db52e9e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.468149 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2ef8432a-8c3c-4ff5-9614-1c814db52e9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546e64d12f5941d58b345fff949af58c', 'request_id': 'req-2ef8432a-8c3c-4ff5-9614-1c814db52e9e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.498470 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2ef8432a-8c3c-4ff5-9614-1c814db52e9e admin admin] The token cache is being invalidate because project 546e64d12f5941d58b345fff949af58c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:42.499000 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2ef8432a-8c3c-4ff5-9614-1c814db52e9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.499844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2ef8432a-8c3c-4ff5-9614-1c814db52e9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.501630 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1067/2169] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:42 2022] DELETE /identity/v3/projects/546e64d12f5941d58b345fff949af58c => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:42.504338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c0682-de41-4aaf-9a38-679b47fe89ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:42.505205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c0682-de41-4aaf-9a38-679b47fe89ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:42.505504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c0682-de41-4aaf-9a38-679b47fe89ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:42.505848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c0682-de41-4aaf-9a38-679b47fe89ab admin admin] PATH_INFO: `/v3/projects/19f6eb44b4b24d82bfe97d3e8cce3bd7` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:42.506089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8432a-8c3c-4ff5-9614-1c814db52e9e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:42.507676 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2ef8432a-8c3c-4ff5-9614-1c814db52e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:42.508106 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c0682-de41-4aaf-9a38-679b47fe89ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f6eb44b4b24d82bfe97d3e8cce3bd7)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:42.513907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c0682-de41-4aaf-9a38-679b47fe89ab admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:42.521596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8432a-8c3c-4ff5-9614-1c814db52e9e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:42.528432 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b04cee-ba48-422f-9ab6-015bbdb79b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:42.529143 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04cee-ba48-422f-9ab6-015bbdb79b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:42.529646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04cee-ba48-422f-9ab6-015bbdb79b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:42.530143 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04cee-ba48-422f-9ab6-015bbdb79b16 admin admin] PATH_INFO: `/v3/users/96a407f28bbd4543be23fcb280073ad5` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:42.531780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b04cee-ba48-422f-9ab6-015bbdb79b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96a407f28bbd4543be23fcb280073ad5)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:42.534035 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b04cee-ba48-422f-9ab6-015bbdb79b16 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:42.543864 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:42.625790 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-53b04cee-ba48-422f-9ab6-015bbdb79b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96a407f28bbd4543be23fcb280073ad5'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.626355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-53b04cee-ba48-422f-9ab6-015bbdb79b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96a407f28bbd4543be23fcb280073ad5'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.636016 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5f1c0682-de41-4aaf-9a38-679b47fe89ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f6eb44b4b24d82bfe97d3e8cce3bd7', 'request_id': 'req-5f1c0682-de41-4aaf-9a38-679b47fe89ab'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.642250 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-53b04cee-ba48-422f-9ab6-015bbdb79b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96a407f28bbd4543be23fcb280073ad5'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.646368 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5f1c0682-de41-4aaf-9a38-679b47fe89ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f6eb44b4b24d82bfe97d3e8cce3bd7', 'request_id': 'req-5f1c0682-de41-4aaf-9a38-679b47fe89ab'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.660888 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5f1c0682-de41-4aaf-9a38-679b47fe89ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f6eb44b4b24d82bfe97d3e8cce3bd7', 'request_id': 'req-5f1c0682-de41-4aaf-9a38-679b47fe89ab'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.662473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-53b04cee-ba48-422f-9ab6-015bbdb79b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96a407f28bbd4543be23fcb280073ad5'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.674077 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-53b04cee-ba48-422f-9ab6-015bbdb79b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96a407f28bbd4543be23fcb280073ad5'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.676458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5f1c0682-de41-4aaf-9a38-679b47fe89ab admin admin] The token cache is being invalidate because project 19f6eb44b4b24d82bfe97d3e8cce3bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:42.677002 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5f1c0682-de41-4aaf-9a38-679b47fe89ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.678081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5f1c0682-de41-4aaf-9a38-679b47fe89ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:42.684273 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1103/2170] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:42 2022] DELETE /identity/v3/projects/19f6eb44b4b24d82bfe97d3e8cce3bd7 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:42.687071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4d13e-4da1-4ae5-83d1-3b21e9afc91a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:42.687369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4d13e-4da1-4ae5-83d1-3b21e9afc91a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:42.688004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1068/2171] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:42 2022] DELETE /identity/v3/users/96a407f28bbd4543be23fcb280073ad5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:26:42.688219 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4d13e-4da1-4ae5-83d1-3b21e9afc91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:42.735970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c5d4d13e-4da1-4ae5-83d1-3b21e9afc91a None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:42.737310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c5d4d13e-4da1-4ae5-83d1-3b21e9afc91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:42.758775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b04cee-ba48-422f-9ab6-015bbdb79b16 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:42.760538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-53b04cee-ba48-422f-9ab6-015bbdb79b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:42.899625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1104/2172] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:26:42.901689 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7247c0-4da6-47f5-a936-d93fc6cb9894 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:42.902082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7247c0-4da6-47f5-a936-d93fc6cb9894 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:42.902571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7247c0-4da6-47f5-a936-d93fc6cb9894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:42.914932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b04cee-ba48-422f-9ab6-015bbdb79b16 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:42.937999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ed39e-a4c2-4da7-8071-22dc7944371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:42.939003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ed39e-a4c2-4da7-8071-22dc7944371c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:42.939509 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ed39e-a4c2-4da7-8071-22dc7944371c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:42.940034 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ed39e-a4c2-4da7-8071-22dc7944371c admin admin] PATH_INFO: `/v3/users/266569e498d84613acfca220a1920333` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:42.945189 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ed39e-a4c2-4da7-8071-22dc7944371c admin admin] RBAC: Authorizing `identity:delete_user(user_id=266569e498d84613acfca220a1920333)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:42.947465 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ed39e-a4c2-4da7-8071-22dc7944371c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:42.952101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-bd7247c0-4da6-47f5-a936-d93fc6cb9894 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:42.953390 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-bd7247c0-4da6-47f5-a936-d93fc6cb9894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:42.972234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1105/2173] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:42.976396 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7247c0-4da6-47f5-a936-d93fc6cb9894 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:42.986556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7247c0-4da6-47f5-a936-d93fc6cb9894 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:42.995746 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e4d4b-806d-40d0-bd6b-b539f5715bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:42.998244 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e4d4b-806d-40d0-bd6b-b539f5715bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:42.999167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e4d4b-806d-40d0-bd6b-b539f5715bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:42.999846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e4d4b-806d-40d0-bd6b-b539f5715bf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:43.001231 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e4d4b-806d-40d0-bd6b-b539f5715bf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:43.001800 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e4d4b-806d-40d0-bd6b-b539f5715bf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:43.006056 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e4d4b-806d-40d0-bd6b-b539f5715bf7 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:43.023350 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1106/2174] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:43.028849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e4d4b-806d-40d0-bd6b-b539f5715bf7 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:43.037022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d33ed39e-a4c2-4da7-8071-22dc7944371c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '266569e498d84613acfca220a1920333'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:43.038354 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d33ed39e-a4c2-4da7-8071-22dc7944371c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '266569e498d84613acfca220a1920333'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:43.043213 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=78,keystone:INSERT=2,keystone:DELETE=20 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:43.056776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e4d4b-806d-40d0-bd6b-b539f5715bf7 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:43.061739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d33ed39e-a4c2-4da7-8071-22dc7944371c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '266569e498d84613acfca220a1920333'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:43.085626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77895eee-0129-4f7d-b8c1-3d4895bd28bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:43.086765 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77895eee-0129-4f7d-b8c1-3d4895bd28bd admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:43.087154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77895eee-0129-4f7d-b8c1-3d4895bd28bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:43.087434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d33ed39e-a4c2-4da7-8071-22dc7944371c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '266569e498d84613acfca220a1920333'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:43.087618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77895eee-0129-4f7d-b8c1-3d4895bd28bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:43.088451 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77895eee-0129-4f7d-b8c1-3d4895bd28bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:43.090815 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77895eee-0129-4f7d-b8c1-3d4895bd28bd admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:43.100963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d33ed39e-a4c2-4da7-8071-22dc7944371c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '266569e498d84613acfca220a1920333'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:43.114870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1069/2175] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:42 2022] DELETE /identity/v3/users/266569e498d84613acfca220a1920333 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:43.119551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02d9a3-e6bd-42dd-99dd-9c8b2ec9410c None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:43.120710 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02d9a3-e6bd-42dd-99dd-9c8b2ec9410c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:43.121001 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02d9a3-e6bd-42dd-99dd-9c8b2ec9410c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:43.158024 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1107/2176] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:43 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:26:43.163614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77895eee-0129-4f7d-b8c1-3d4895bd28bd admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:43.166745 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-77895eee-0129-4f7d-b8c1-3d4895bd28bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:43.168593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-5a02d9a3-e6bd-42dd-99dd-9c8b2ec9410c None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:43.171171 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5a02d9a3-e6bd-42dd-99dd-9c8b2ec9410c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:43.286584 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1070/2177] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:43.290694 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77895eee-0129-4f7d-b8c1-3d4895bd28bd admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:43.295653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f583cc-e0ef-4c19-9060-e17dce49c5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:43.296340 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f583cc-e0ef-4c19-9060-e17dce49c5d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:43.296642 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f583cc-e0ef-4c19-9060-e17dce49c5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:43.296903 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f583cc-e0ef-4c19-9060-e17dce49c5d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:43.297681 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f583cc-e0ef-4c19-9060-e17dce49c5d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:43.299230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02d9a3-e6bd-42dd-99dd-9c8b2ec9410c None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:43.299755 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f583cc-e0ef-4c19-9060-e17dce49c5d4 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:43.301488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5a02d9a3-e6bd-42dd-99dd-9c8b2ec9410c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:43.308885 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:43.341390 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1108/2178] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:43 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:26:43.344294 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f583cc-e0ef-4c19-9060-e17dce49c5d4 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:43.352135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-70f583cc-e0ef-4c19-9060-e17dce49c5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:43.367331 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f583cc-e0ef-4c19-9060-e17dce49c5d4 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:43.375107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115063fc-62ae-42ed-b04b-c3030d6054ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:43.376316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115063fc-62ae-42ed-b04b-c3030d6054ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:43.376838 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115063fc-62ae-42ed-b04b-c3030d6054ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:43.377364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115063fc-62ae-42ed-b04b-c3030d6054ea admin admin] PATH_INFO: `/v3/projects/70363e186f4248e18c51b2dd325857ea` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:43.380647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115063fc-62ae-42ed-b04b-c3030d6054ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=70363e186f4248e18c51b2dd325857ea)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:43.383024 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115063fc-62ae-42ed-b04b-c3030d6054ea admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:43.402054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02d9a3-e6bd-42dd-99dd-9c8b2ec9410c None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:43.407848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317405e-83d7-4f22-a18e-86fa7224409a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:43.408608 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317405e-83d7-4f22-a18e-86fa7224409a service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:43.408897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317405e-83d7-4f22-a18e-86fa7224409a service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:43.409183 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317405e-83d7-4f22-a18e-86fa7224409a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:43.420517 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317405e-83d7-4f22-a18e-86fa7224409a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:43.422827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317405e-83d7-4f22-a18e-86fa7224409a service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:43.435999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1071/2179] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:26:43.437131 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317405e-83d7-4f22-a18e-86fa7224409a service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:43.451601 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317405e-83d7-4f22-a18e-86fa7224409a service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:43.467822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-115063fc-62ae-42ed-b04b-c3030d6054ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70363e186f4248e18c51b2dd325857ea', 'request_id': 'req-115063fc-62ae-42ed-b04b-c3030d6054ea'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:43.478112 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-115063fc-62ae-42ed-b04b-c3030d6054ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70363e186f4248e18c51b2dd325857ea', 'request_id': 'req-115063fc-62ae-42ed-b04b-c3030d6054ea'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:43.493495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-115063fc-62ae-42ed-b04b-c3030d6054ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70363e186f4248e18c51b2dd325857ea', 'request_id': 'req-115063fc-62ae-42ed-b04b-c3030d6054ea'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:43.520876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-115063fc-62ae-42ed-b04b-c3030d6054ea admin admin] The token cache is being invalidate because project 70363e186f4248e18c51b2dd325857ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:43.521415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-115063fc-62ae-42ed-b04b-c3030d6054ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:43.522653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-115063fc-62ae-42ed-b04b-c3030d6054ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:43.526546 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1109/2180] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:43 2022] DELETE /identity/v3/projects/70363e186f4248e18c51b2dd325857ea => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:43.533094 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519dd02-a5b8-4281-9b51-fab075ab7cc4 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:43.533598 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519dd02-a5b8-4281-9b51-fab075ab7cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:43.534096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519dd02-a5b8-4281-9b51-fab075ab7cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:43.564462 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6a45e-985a-4b9f-ae0b-0e812486bbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:43.565490 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6a45e-985a-4b9f-ae0b-0e812486bbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:43.565490 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6a45e-985a-4b9f-ae0b-0e812486bbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:43.566043 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6a45e-985a-4b9f-ae0b-0e812486bbf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:43.568161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6a45e-985a-4b9f-ae0b-0e812486bbf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:43.570889 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6a45e-985a-4b9f-ae0b-0e812486bbf0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:43.573003 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8519dd02-a5b8-4281-9b51-fab075ab7cc4 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:43.575208 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8519dd02-a5b8-4281-9b51-fab075ab7cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:43.586611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1072/2181] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:43.592757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6a45e-985a-4b9f-ae0b-0e812486bbf0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:43.596140 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9ae6a45e-985a-4b9f-ae0b-0e812486bbf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:43.601398 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1110/2182] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:26:43.603782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8bd7d-33be-4a1d-9f5e-824907a514de None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:43.604312 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8bd7d-33be-4a1d-9f5e-824907a514de None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:43.605618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8bd7d-33be-4a1d-9f5e-824907a514de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:43.624544 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6a45e-985a-4b9f-ae0b-0e812486bbf0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:43.637298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b184d-5a4b-4220-b081-e79d3512391e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:43.639635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b184d-5a4b-4220-b081-e79d3512391e admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:43.639635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b184d-5a4b-4220-b081-e79d3512391e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:43.639966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b184d-5a4b-4220-b081-e79d3512391e admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:43.641163 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b184d-5a4b-4220-b081-e79d3512391e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:43.643564 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b184d-5a4b-4220-b081-e79d3512391e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:43.646166 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:43.649934 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a5d8bd7d-33be-4a1d-9f5e-824907a514de None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:43.651669 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a5d8bd7d-33be-4a1d-9f5e-824907a514de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:43.665720 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1111/2183] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:43.668451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1073/2184] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:26:43.669835 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8bd7d-33be-4a1d-9f5e-824907a514de None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:43.671245 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b184d-5a4b-4220-b081-e79d3512391e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:43.683180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b184d-5a4b-4220-b081-e79d3512391e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:43.687133 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8bd7d-33be-4a1d-9f5e-824907a514de None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:43.694329 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671303b-ed7b-4eb3-b099-cb4d2ae8fa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:43.694697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16776dae-051b-4413-96b8-99e869ee7f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:43.694873 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671303b-ed7b-4eb3-b099-cb4d2ae8fa3c admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:43.694873 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671303b-ed7b-4eb3-b099-cb4d2ae8fa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:43.694873 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671303b-ed7b-4eb3-b099-cb4d2ae8fa3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:43.695286 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16776dae-051b-4413-96b8-99e869ee7f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:43.695286 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16776dae-051b-4413-96b8-99e869ee7f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:43.695286 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16776dae-051b-4413-96b8-99e869ee7f5f admin admin] PATH_INFO: `/v3/projects/03b3482913a44b679af648efb5343693/users/39ebd08d379447a194b3c03011abf433/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:43.695684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671303b-ed7b-4eb3-b099-cb4d2ae8fa3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:43.695684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671303b-ed7b-4eb3-b099-cb4d2ae8fa3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:43.697684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671303b-ed7b-4eb3-b099-cb4d2ae8fa3c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:43.724001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16776dae-051b-4413-96b8-99e869ee7f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b3482913a44b679af648efb5343693, user_id=39ebd08d379447a194b3c03011abf433, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:43.725934 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1074/2185] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:43.726892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16776dae-051b-4413-96b8-99e869ee7f5f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:43.731750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671303b-ed7b-4eb3-b099-cb4d2ae8fa3c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:43.754283 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1112/2186] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:43 2022] PUT /identity/v3/projects/03b3482913a44b679af648efb5343693/users/39ebd08d379447a194b3c03011abf433/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:43.754541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671303b-ed7b-4eb3-b099-cb4d2ae8fa3c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:43.765527 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d483507-7809-4e8b-8460-1e0e07e7238a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:43.765878 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d483507-7809-4e8b-8460-1e0e07e7238a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:43.766116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d483507-7809-4e8b-8460-1e0e07e7238a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:43.816858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8d483507-7809-4e8b-8460-1e0e07e7238a None None] MFA Rules not processed for user `39ebd08d379447a194b3c03011abf433`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:43.818985 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8d483507-7809-4e8b-8460-1e0e07e7238a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:43.872272 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f8724-fd2f-44e1-8487-919e231fb221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:43.873308 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f8724-fd2f-44e1-8487-919e231fb221 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:43.873921 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f8724-fd2f-44e1-8487-919e231fb221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:43.874316 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f8724-fd2f-44e1-8487-919e231fb221 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:43.875469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f8724-fd2f-44e1-8487-919e231fb221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:43.878023 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f8724-fd2f-44e1-8487-919e231fb221 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:43.929915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1075/2187] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:43 2022] POST /identity/v3/projects => generated 365 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:26:43.935041 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f8724-fd2f-44e1-8487-919e231fb221 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:43.937404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c96f8724-fd2f-44e1-8487-919e231fb221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:43.952409 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1113/2188] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:43.958000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d483507-7809-4e8b-8460-1e0e07e7238a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:43.971574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d483507-7809-4e8b-8460-1e0e07e7238a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:43.999249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:44.045057 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f8724-fd2f-44e1-8487-919e231fb221 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:44.046149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a2bf7-5dbd-431b-b668-0bd3cda9fdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:44.046811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a2bf7-5dbd-431b-b668-0bd3cda9fdc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:44.047092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a2bf7-5dbd-431b-b668-0bd3cda9fdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:44.047373 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a2bf7-5dbd-431b-b668-0bd3cda9fdc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:44.048070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a2bf7-5dbd-431b-b668-0bd3cda9fdc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:44.050203 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af80cd-389d-45e2-b5b4-2457f07e5b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:44.051269 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a2bf7-5dbd-431b-b668-0bd3cda9fdc2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:44.051531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af80cd-389d-45e2-b5b4-2457f07e5b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:44.051684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af80cd-389d-45e2-b5b4-2457f07e5b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:44.052405 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af80cd-389d-45e2-b5b4-2457f07e5b8a admin admin] PATH_INFO: `/v3/projects/2215b8c9e5a146c091da43816d5982a0` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:44.053845 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af80cd-389d-45e2-b5b4-2457f07e5b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2215b8c9e5a146c091da43816d5982a0)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:44.055858 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af80cd-389d-45e2-b5b4-2457f07e5b8a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:44.081493 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1114/2189] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:43 2022] POST /identity/v3/users => generated 283 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:44.083013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a2bf7-5dbd-431b-b668-0bd3cda9fdc2 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:44.085242 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c44a2bf7-5dbd-431b-b668-0bd3cda9fdc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:44.143744 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-83af80cd-389d-45e2-b5b4-2457f07e5b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2215b8c9e5a146c091da43816d5982a0', 'request_id': 'req-83af80cd-389d-45e2-b5b4-2457f07e5b8a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:44.153990 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-83af80cd-389d-45e2-b5b4-2457f07e5b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2215b8c9e5a146c091da43816d5982a0', 'request_id': 'req-83af80cd-389d-45e2-b5b4-2457f07e5b8a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:44.165950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-83af80cd-389d-45e2-b5b4-2457f07e5b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2215b8c9e5a146c091da43816d5982a0', 'request_id': 'req-83af80cd-389d-45e2-b5b4-2457f07e5b8a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:44.180218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:44.187708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-83af80cd-389d-45e2-b5b4-2457f07e5b8a admin admin] The token cache is being invalidate because project 2215b8c9e5a146c091da43816d5982a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:44.188477 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-83af80cd-389d-45e2-b5b4-2457f07e5b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:44.192273 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-83af80cd-389d-45e2-b5b4-2457f07e5b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:44.200083 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1076/2190] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:43 2022] DELETE /identity/v3/projects/2215b8c9e5a146c091da43816d5982a0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:44.200083 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af80cd-389d-45e2-b5b4-2457f07e5b8a admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:44.200083 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-83af80cd-389d-45e2-b5b4-2457f07e5b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:44.256198 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a2bf7-5dbd-431b-b668-0bd3cda9fdc2 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:44.350531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af80cd-389d-45e2-b5b4-2457f07e5b8a admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:44.365443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cdb79-fedc-4283-bde1-dc802434e59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:44.366123 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cdb79-fedc-4283-bde1-dc802434e59e admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:44.366623 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cdb79-fedc-4283-bde1-dc802434e59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:44.366898 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cdb79-fedc-4283-bde1-dc802434e59e admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:44.367979 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122cdb79-fedc-4283-bde1-dc802434e59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:44.369704 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122cdb79-fedc-4283-bde1-dc802434e59e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:44.386424 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1077/2191] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:44.387728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cdb79-fedc-4283-bde1-dc802434e59e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:44.390645 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-122cdb79-fedc-4283-bde1-dc802434e59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:44.405876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cdb79-fedc-4283-bde1-dc802434e59e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:44.410221 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7265a1e-0b97-42cc-8cf8-0ab940ea57e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:44.411099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7265a1e-0b97-42cc-8cf8-0ab940ea57e7 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:44.411511 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7265a1e-0b97-42cc-8cf8-0ab940ea57e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:44.411890 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7265a1e-0b97-42cc-8cf8-0ab940ea57e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:44.413042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24098bb9-c479-45c4-8e78-325287878acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:44.413723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24098bb9-c479-45c4-8e78-325287878acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:44.414076 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24098bb9-c479-45c4-8e78-325287878acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:44.414426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24098bb9-c479-45c4-8e78-325287878acb admin admin] PATH_INFO: `/v3/users/3dff48bd15924f7ea4505cd2bfa8d5d7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:44.414739 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e7265a1e-0b97-42cc-8cf8-0ab940ea57e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:44.415991 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24098bb9-c479-45c4-8e78-325287878acb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dff48bd15924f7ea4505cd2bfa8d5d7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:44.418039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24098bb9-c479-45c4-8e78-325287878acb admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:44.513670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:44.525582 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-24098bb9-c479-45c4-8e78-325287878acb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dff48bd15924f7ea4505cd2bfa8d5d7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:44.525582 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-24098bb9-c479-45c4-8e78-325287878acb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dff48bd15924f7ea4505cd2bfa8d5d7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:44.539419 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-24098bb9-c479-45c4-8e78-325287878acb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dff48bd15924f7ea4505cd2bfa8d5d7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:44.541988 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7265a1e-0b97-42cc-8cf8-0ab940ea57e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:44.543839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7265a1e-0b97-42cc-8cf8-0ab940ea57e7 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:44.556069 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1115/2192] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:44.557085 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7265a1e-0b97-42cc-8cf8-0ab940ea57e7 service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:44.571307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7265a1e-0b97-42cc-8cf8-0ab940ea57e7 service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:44.576834 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e679b-c9eb-41bd-8655-ca5f83795b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:44.577531 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e679b-c9eb-41bd-8655-ca5f83795b2f admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:44.577813 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e679b-c9eb-41bd-8655-ca5f83795b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:44.578090 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e679b-c9eb-41bd-8655-ca5f83795b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:44.578947 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e679b-c9eb-41bd-8655-ca5f83795b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:44.580783 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e679b-c9eb-41bd-8655-ca5f83795b2f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:44.585003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-24098bb9-c479-45c4-8e78-325287878acb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dff48bd15924f7ea4505cd2bfa8d5d7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:44.594116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1116/2193] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:44.600534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e679b-c9eb-41bd-8655-ca5f83795b2f admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:44.600970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-24098bb9-c479-45c4-8e78-325287878acb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dff48bd15924f7ea4505cd2bfa8d5d7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:44.606331 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c61e679b-c9eb-41bd-8655-ca5f83795b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:44.613903 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1078/2194] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:44 2022] DELETE /identity/v3/users/3dff48bd15924f7ea4505cd2bfa8d5d7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:44.651573 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e679b-c9eb-41bd-8655-ca5f83795b2f admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:44.773665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e96b47-79d1-42ec-9f93-1bbee2bba389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:44.774640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e96b47-79d1-42ec-9f93-1bbee2bba389 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:44.775053 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e96b47-79d1-42ec-9f93-1bbee2bba389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:44.775403 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e96b47-79d1-42ec-9f93-1bbee2bba389 admin admin] PATH_INFO: `/v3/projects/9530532a56d5437ba055c948e01d8eb7/users/98e82008f7ec4a51a23e7c6cacd0190c/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:44.796647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e96b47-79d1-42ec-9f93-1bbee2bba389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9530532a56d5437ba055c948e01d8eb7, user_id=98e82008f7ec4a51a23e7c6cacd0190c, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:44.802142 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e96b47-79d1-42ec-9f93-1bbee2bba389 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:44.827553 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1117/2195] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:44 2022] PUT /identity/v3/projects/9530532a56d5437ba055c948e01d8eb7/users/98e82008f7ec4a51a23e7c6cacd0190c/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:44.846585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3ba50-10d4-48fd-97b6-052046648966 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:44.847412 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3ba50-10d4-48fd-97b6-052046648966 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:44.848209 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3ba50-10d4-48fd-97b6-052046648966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:44.914503 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4ad3ba50-10d4-48fd-97b6-052046648966 None None] MFA Rules not processed for user `98e82008f7ec4a51a23e7c6cacd0190c`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:44.919510 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4ad3ba50-10d4-48fd-97b6-052046648966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:45.051761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:45.083875 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1079/2196] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:45.091054 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e96b47-79d1-42ec-9f93-1bbee2bba389 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:45.093291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e4e96b47-79d1-42ec-9f93-1bbee2bba389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:45.145314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3ba50-10d4-48fd-97b6-052046648966 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:45.148453 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4ad3ba50-10d4-48fd-97b6-052046648966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:45.276398 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e96b47-79d1-42ec-9f93-1bbee2bba389 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:45.282878 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6214931-5f58-4a2f-91f7-a31db7f5139a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:45.283888 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6214931-5f58-4a2f-91f7-a31db7f5139a service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:45.284541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6214931-5f58-4a2f-91f7-a31db7f5139a service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:45.285074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6214931-5f58-4a2f-91f7-a31db7f5139a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:45.298541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3ba50-10d4-48fd-97b6-052046648966 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:45.301172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6214931-5f58-4a2f-91f7-a31db7f5139a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:45.303891 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6214931-5f58-4a2f-91f7-a31db7f5139a service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:45.305407 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39baa2-66f7-4ba1-a0b1-0651aff2407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:45.306168 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39baa2-66f7-4ba1-a0b1-0651aff2407f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:45.306470 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39baa2-66f7-4ba1-a0b1-0651aff2407f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:45.306740 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39baa2-66f7-4ba1-a0b1-0651aff2407f admin admin] PATH_INFO: `/v3/projects/af87b7b90a894baa963ca1ed92057d9d` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:45.308192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39baa2-66f7-4ba1-a0b1-0651aff2407f admin admin] RBAC: Authorizing `identity:delete_project(project_id=af87b7b90a894baa963ca1ed92057d9d)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:45.316885 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39baa2-66f7-4ba1-a0b1-0651aff2407f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:45.322889 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1118/2197] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:45.398488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3d39baa2-66f7-4ba1-a0b1-0651aff2407f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af87b7b90a894baa963ca1ed92057d9d', 'request_id': 'req-3d39baa2-66f7-4ba1-a0b1-0651aff2407f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:45.408818 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3d39baa2-66f7-4ba1-a0b1-0651aff2407f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af87b7b90a894baa963ca1ed92057d9d', 'request_id': 'req-3d39baa2-66f7-4ba1-a0b1-0651aff2407f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:45.421114 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3d39baa2-66f7-4ba1-a0b1-0651aff2407f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af87b7b90a894baa963ca1ed92057d9d', 'request_id': 'req-3d39baa2-66f7-4ba1-a0b1-0651aff2407f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:45.446253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3d39baa2-66f7-4ba1-a0b1-0651aff2407f admin admin] The token cache is being invalidate because project af87b7b90a894baa963ca1ed92057d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:45.446740 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3d39baa2-66f7-4ba1-a0b1-0651aff2407f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:45.448468 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3d39baa2-66f7-4ba1-a0b1-0651aff2407f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:45.450876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1080/2198] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:45 2022] DELETE /identity/v3/projects/af87b7b90a894baa963ca1ed92057d9d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:26:45.457352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccaf9d-86a6-46f1-b4b1-14a09c6b7a31 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:45.457856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccaf9d-86a6-46f1-b4b1-14a09c6b7a31 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:45.458346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccaf9d-86a6-46f1-b4b1-14a09c6b7a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:45.493550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a7ccaf9d-86a6-46f1-b4b1-14a09c6b7a31 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:45.494811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a7ccaf9d-86a6-46f1-b4b1-14a09c6b7a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:45.594796 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1119/2199] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:45.604587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ccfc3-8944-4547-b74c-a9a9215cbc6b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:45.604883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ccfc3-8944-4547-b74c-a9a9215cbc6b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:45.605169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ccfc3-8944-4547-b74c-a9a9215cbc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:45.642187 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-2b2ccfc3-8944-4547-b74c-a9a9215cbc6b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:45.643631 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2b2ccfc3-8944-4547-b74c-a9a9215cbc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:45.660732 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1081/2200] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:45.664648 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccaf9d-86a6-46f1-b4b1-14a09c6b7a31 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:45.677157 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:45.681888 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccaf9d-86a6-46f1-b4b1-14a09c6b7a31 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:45.699869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211bf76-89dd-4f28-bcaa-3c4bf060d17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:45.700964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211bf76-89dd-4f28-bcaa-3c4bf060d17a admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:45.716501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211bf76-89dd-4f28-bcaa-3c4bf060d17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:45.716501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211bf76-89dd-4f28-bcaa-3c4bf060d17a admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:45.716501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211bf76-89dd-4f28-bcaa-3c4bf060d17a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:45.716501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211bf76-89dd-4f28-bcaa-3c4bf060d17a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:45.720431 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211bf76-89dd-4f28-bcaa-3c4bf060d17a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:45.756231 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1120/2201] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:45.761276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ccfc3-8944-4547-b74c-a9a9215cbc6b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:45.786042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ccfc3-8944-4547-b74c-a9a9215cbc6b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:45.801672 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490aeefd-2510-4ed9-882f-c62b3964401b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:45.802545 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490aeefd-2510-4ed9-882f-c62b3964401b admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:45.803054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490aeefd-2510-4ed9-882f-c62b3964401b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:45.803471 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490aeefd-2510-4ed9-882f-c62b3964401b admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:45.804576 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490aeefd-2510-4ed9-882f-c62b3964401b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:45.813861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490aeefd-2510-4ed9-882f-c62b3964401b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:45.875023 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1082/2202] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:45 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:26:45.881203 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211bf76-89dd-4f28-bcaa-3c4bf060d17a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:45.896257 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211bf76-89dd-4f28-bcaa-3c4bf060d17a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:45.976723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b7feb-6bcc-42c4-abb6-e0cded3d58e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:45.977499 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b7feb-6bcc-42c4-abb6-e0cded3d58e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:45.978045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b7feb-6bcc-42c4-abb6-e0cded3d58e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:45.978634 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b7feb-6bcc-42c4-abb6-e0cded3d58e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:45.980025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b7feb-6bcc-42c4-abb6-e0cded3d58e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:45.983620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b7feb-6bcc-42c4-abb6-e0cded3d58e3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:46.017011 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1121/2203] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:45 2022] POST /identity/v3/users => generated 284 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:26:46.024454 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490aeefd-2510-4ed9-882f-c62b3964401b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:46.039010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490aeefd-2510-4ed9-882f-c62b3964401b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:46.045154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50d44a-306c-45b2-b034-079c6522ccfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:46.045822 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50d44a-306c-45b2-b034-079c6522ccfe admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:46.046207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50d44a-306c-45b2-b034-079c6522ccfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:46.046483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50d44a-306c-45b2-b034-079c6522ccfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:46.047243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50d44a-306c-45b2-b034-079c6522ccfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:46.049377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50d44a-306c-45b2-b034-079c6522ccfe admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:46.062794 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1083/2204] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:26:46.068695 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b7feb-6bcc-42c4-abb6-e0cded3d58e3 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:46.087527 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b7feb-6bcc-42c4-abb6-e0cded3d58e3 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:46.093785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572c7a4-9f6d-49f9-b8ae-20a9bb166d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:46.094380 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572c7a4-9f6d-49f9-b8ae-20a9bb166d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:46.094742 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572c7a4-9f6d-49f9-b8ae-20a9bb166d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:46.095065 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572c7a4-9f6d-49f9-b8ae-20a9bb166d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:46.095859 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572c7a4-9f6d-49f9-b8ae-20a9bb166d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:46.098424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572c7a4-9f6d-49f9-b8ae-20a9bb166d6f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:46.110914 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1122/2205] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:46.117665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50d44a-306c-45b2-b034-079c6522ccfe admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:46.135879 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50d44a-306c-45b2-b034-079c6522ccfe admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:46.145096 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e974831-865c-42fa-9d10-eb08885d7f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:46.146293 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e974831-865c-42fa-9d10-eb08885d7f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:46.147046 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e974831-865c-42fa-9d10-eb08885d7f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:46.147215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e974831-865c-42fa-9d10-eb08885d7f34 admin admin] PATH_INFO: `/v3/projects/21dee20f14684dfdb6b65ae385d3e494/users/8e400a4b26bd4394aac6573f02165bd0/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:46.174018 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e974831-865c-42fa-9d10-eb08885d7f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21dee20f14684dfdb6b65ae385d3e494, user_id=8e400a4b26bd4394aac6573f02165bd0, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:46.179938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e974831-865c-42fa-9d10-eb08885d7f34 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:46.204952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1084/2206] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:46 2022] PUT /identity/v3/projects/21dee20f14684dfdb6b65ae385d3e494/users/8e400a4b26bd4394aac6573f02165bd0/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:46.222891 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab591f3-62c2-4f81-9633-8d7d0631d9e3 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:46.223211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab591f3-62c2-4f81-9633-8d7d0631d9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:46.223493 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab591f3-62c2-4f81-9633-8d7d0631d9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:46.258465 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8ab591f3-62c2-4f81-9633-8d7d0631d9e3 None None] MFA Rules not processed for user `8e400a4b26bd4394aac6573f02165bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:46.259872 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8ab591f3-62c2-4f81-9633-8d7d0631d9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:46.372319 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1123/2207] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:46.390567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e974831-865c-42fa-9d10-eb08885d7f34 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:46.393516 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1e974831-865c-42fa-9d10-eb08885d7f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:46.444413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:46.506404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e974831-865c-42fa-9d10-eb08885d7f34 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:46.519913 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6be5e-f9e9-4528-93a0-c80e761b87c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc15e64c987488f812d1cdd0c82c7ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:46.521021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6be5e-f9e9-4528-93a0-c80e761b87c0 service glance] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:46.521581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6be5e-f9e9-4528-93a0-c80e761b87c0 service glance] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:46.521970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6be5e-f9e9-4528-93a0-c80e761b87c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:46.541130 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6be5e-f9e9-4528-93a0-c80e761b87c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:46.545124 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6be5e-f9e9-4528-93a0-c80e761b87c0 service glance] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:46.561288 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1085/2208] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:51.827682 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab591f3-62c2-4f81-9633-8d7d0631d9e3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:51.830953 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8ab591f3-62c2-4f81-9633-8d7d0631d9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:51.990032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab591f3-62c2-4f81-9633-8d7d0631d9e3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:51.997661 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8d4b5-ac54-4beb-bebf-319f2975411d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:51.998457 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8d4b5-ac54-4beb-bebf-319f2975411d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:51.998744 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8d4b5-ac54-4beb-bebf-319f2975411d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:51.999164 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8d4b5-ac54-4beb-bebf-319f2975411d admin admin] PATH_INFO: `/v3/users/39ebd08d379447a194b3c03011abf433` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:52.000818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8d4b5-ac54-4beb-bebf-319f2975411d admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ebd08d379447a194b3c03011abf433)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:52.004116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8d4b5-ac54-4beb-bebf-319f2975411d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:52.006496 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:52.087869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6ed8d4b5-ac54-4beb-bebf-319f2975411d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ebd08d379447a194b3c03011abf433'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:52.088556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6ed8d4b5-ac54-4beb-bebf-319f2975411d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ebd08d379447a194b3c03011abf433'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:52.096134 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6ed8d4b5-ac54-4beb-bebf-319f2975411d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ebd08d379447a194b3c03011abf433'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:52.097527 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6ed8d4b5-ac54-4beb-bebf-319f2975411d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ebd08d379447a194b3c03011abf433'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:52.111654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6ed8d4b5-ac54-4beb-bebf-319f2975411d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ebd08d379447a194b3c03011abf433'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:52.129863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1124/2209] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:51 2022] DELETE /identity/v3/users/39ebd08d379447a194b3c03011abf433 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:52.136425 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46155b-ffa4-4bff-a0c1-a4b036fccff2 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:52.138299 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46155b-ffa4-4bff-a0c1-a4b036fccff2 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:52.138607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46155b-ffa4-4bff-a0c1-a4b036fccff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:52.174945 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-2a46155b-ffa4-4bff-a0c1-a4b036fccff2 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:52.177804 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2a46155b-ffa4-4bff-a0c1-a4b036fccff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:52.324595 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1086/2210] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:26:52.338520 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8d4b5-ac54-4beb-bebf-319f2975411d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:52.340733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6ed8d4b5-ac54-4beb-bebf-319f2975411d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:52.463758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8d4b5-ac54-4beb-bebf-319f2975411d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:52.466372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00581f06-179f-419e-9cdf-0e47a48a4649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:52.467193 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00581f06-179f-419e-9cdf-0e47a48a4649 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:52.467486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00581f06-179f-419e-9cdf-0e47a48a4649 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:52.467758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00581f06-179f-419e-9cdf-0e47a48a4649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:52.481077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00581f06-179f-419e-9cdf-0e47a48a4649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:52.482736 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00581f06-179f-419e-9cdf-0e47a48a4649 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:52.499930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1125/2211] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:26:52.853164 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46155b-ffa4-4bff-a0c1-a4b036fccff2 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:52.855568 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2a46155b-ffa4-4bff-a0c1-a4b036fccff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:52.886918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46155b-ffa4-4bff-a0c1-a4b036fccff2 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:52.903038 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d05c2-1b60-41b9-8619-696df2035053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:52.904865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d05c2-1b60-41b9-8619-696df2035053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:52.906122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d05c2-1b60-41b9-8619-696df2035053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:52.906945 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d05c2-1b60-41b9-8619-696df2035053 admin admin] PATH_INFO: `/v3/projects/03b3482913a44b679af648efb5343693` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:52.911418 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d05c2-1b60-41b9-8619-696df2035053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b3482913a44b679af648efb5343693)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:52.917267 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d05c2-1b60-41b9-8619-696df2035053 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:53.005211 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd6d05c2-1b60-41b9-8619-696df2035053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b3482913a44b679af648efb5343693', 'request_id': 'req-bd6d05c2-1b60-41b9-8619-696df2035053'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:53.013630 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd6d05c2-1b60-41b9-8619-696df2035053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b3482913a44b679af648efb5343693', 'request_id': 'req-bd6d05c2-1b60-41b9-8619-696df2035053'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:53.027686 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd6d05c2-1b60-41b9-8619-696df2035053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b3482913a44b679af648efb5343693', 'request_id': 'req-bd6d05c2-1b60-41b9-8619-696df2035053'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:53.057928 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd6d05c2-1b60-41b9-8619-696df2035053 admin admin] The token cache is being invalidate because project 03b3482913a44b679af648efb5343693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:53.058247 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd6d05c2-1b60-41b9-8619-696df2035053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:53.058963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd6d05c2-1b60-41b9-8619-696df2035053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:53.060595 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1087/2212] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:52 2022] DELETE /identity/v3/projects/03b3482913a44b679af648efb5343693 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:26:53.066547 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdd011-23b6-4014-9ddf-9ead36f24d08 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:53.067339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdd011-23b6-4014-9ddf-9ead36f24d08 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:53.067582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdd011-23b6-4014-9ddf-9ead36f24d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:53.091163 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f1bdd011-23b6-4014-9ddf-9ead36f24d08 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:53.092466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f1bdd011-23b6-4014-9ddf-9ead36f24d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:53.158105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1126/2213] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:53.167040 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b0cd7-942d-4af2-b067-a1f2f73e2afc None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:53.169644 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b0cd7-942d-4af2-b067-a1f2f73e2afc None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:53.169644 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b0cd7-942d-4af2-b067-a1f2f73e2afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:53.188470 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-982b0cd7-942d-4af2-b067-a1f2f73e2afc None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:53.189696 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-982b0cd7-942d-4af2-b067-a1f2f73e2afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:53.198565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1088/2214] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:53.203081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdd011-23b6-4014-9ddf-9ead36f24d08 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:53.213747 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdd011-23b6-4014-9ddf-9ead36f24d08 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:53.218406 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ec6ae-f190-4a57-9089-c89afec24f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:53.219034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ec6ae-f190-4a57-9089-c89afec24f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:53.219315 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ec6ae-f190-4a57-9089-c89afec24f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:53.219596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ec6ae-f190-4a57-9089-c89afec24f44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:53.220350 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ec6ae-f190-4a57-9089-c89afec24f44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:53.220681 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ec6ae-f190-4a57-9089-c89afec24f44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:53.222907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ec6ae-f190-4a57-9089-c89afec24f44 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:53.235376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1127/2215] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:53.240465 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b0cd7-942d-4af2-b067-a1f2f73e2afc None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:53.251693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b0cd7-942d-4af2-b067-a1f2f73e2afc None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:53.256711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31242a06-bcc8-4e48-95bf-34baaae333f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:53.257342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31242a06-bcc8-4e48-95bf-34baaae333f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:53.257625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31242a06-bcc8-4e48-95bf-34baaae333f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:53.257898 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31242a06-bcc8-4e48-95bf-34baaae333f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:53.258570 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31242a06-bcc8-4e48-95bf-34baaae333f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:53.260550 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31242a06-bcc8-4e48-95bf-34baaae333f2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:53.291558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1089/2216] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:53 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:53.296081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ec6ae-f190-4a57-9089-c89afec24f44 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:53.309285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ec6ae-f190-4a57-9089-c89afec24f44 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:53.314401 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:53.370425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b5b51-391a-4d11-a07c-ab8183e25352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:53.371061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b5b51-391a-4d11-a07c-ab8183e25352 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:53.371343 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b5b51-391a-4d11-a07c-ab8183e25352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:53.371621 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b5b51-391a-4d11-a07c-ab8183e25352 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:53.372341 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b5b51-391a-4d11-a07c-ab8183e25352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:53.374280 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b5b51-391a-4d11-a07c-ab8183e25352 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:53.401424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1128/2217] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:53 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:53.403486 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31242a06-bcc8-4e48-95bf-34baaae333f2 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:53.421715 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31242a06-bcc8-4e48-95bf-34baaae333f2 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:53.429915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe82585-8db5-45f0-aa51-5ef5e4fd274c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:53.431005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe82585-8db5-45f0-aa51-5ef5e4fd274c admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:53.431489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe82585-8db5-45f0-aa51-5ef5e4fd274c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:53.431982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe82585-8db5-45f0-aa51-5ef5e4fd274c admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:53.433368 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe82585-8db5-45f0-aa51-5ef5e4fd274c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:53.436535 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe82585-8db5-45f0-aa51-5ef5e4fd274c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:53.456096 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1090/2218] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:53.461418 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b5b51-391a-4d11-a07c-ab8183e25352 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:53.473050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b5b51-391a-4d11-a07c-ab8183e25352 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:53.478021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e40766-96bb-4a3f-94e1-44888ee771c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:53.478662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e40766-96bb-4a3f-94e1-44888ee771c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:53.478948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e40766-96bb-4a3f-94e1-44888ee771c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:53.479227 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e40766-96bb-4a3f-94e1-44888ee771c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:53.479938 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e40766-96bb-4a3f-94e1-44888ee771c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:53.481624 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e40766-96bb-4a3f-94e1-44888ee771c3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:53.494323 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1129/2219] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:53.498799 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe82585-8db5-45f0-aa51-5ef5e4fd274c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:53.516663 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe82585-8db5-45f0-aa51-5ef5e4fd274c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:53.526749 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb447f8-5620-487b-b138-f5a2a538301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:53.527459 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb447f8-5620-487b-b138-f5a2a538301e admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:53.527740 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb447f8-5620-487b-b138-f5a2a538301e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:53.528021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb447f8-5620-487b-b138-f5a2a538301e admin admin] PATH_INFO: `/v3/projects/af09fc9cf8a24a02950ec67ab18ac767/users/760ce877e00e4675892baad0e6f333a9/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:53.531811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:53.571513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb447f8-5620-487b-b138-f5a2a538301e admin admin] RBAC: Authorizing `identity:create_grant(project_id=af09fc9cf8a24a02950ec67ab18ac767, user_id=760ce877e00e4675892baad0e6f333a9, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:53.574572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb447f8-5620-487b-b138-f5a2a538301e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:53.596650 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1091/2220] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:53 2022] PUT /identity/v3/projects/af09fc9cf8a24a02950ec67ab18ac767/users/760ce877e00e4675892baad0e6f333a9/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:53.613889 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39185c47-7559-4bce-ab70-b6aa3b09c0cb None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:53.614219 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39185c47-7559-4bce-ab70-b6aa3b09c0cb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:53.614530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39185c47-7559-4bce-ab70-b6aa3b09c0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:53.677120 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-39185c47-7559-4bce-ab70-b6aa3b09c0cb None None] MFA Rules not processed for user `760ce877e00e4675892baad0e6f333a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:53.678609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-39185c47-7559-4bce-ab70-b6aa3b09c0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:53.776817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1130/2221] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:53.781660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb447f8-5620-487b-b138-f5a2a538301e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:53.890263 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb447f8-5620-487b-b138-f5a2a538301e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:53.908061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b93b0b-62b1-45ff-9805-48285e3d48e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:53.908804 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b93b0b-62b1-45ff-9805-48285e3d48e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:53.909104 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b93b0b-62b1-45ff-9805-48285e3d48e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:53.909919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b93b0b-62b1-45ff-9805-48285e3d48e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:53.913012 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b93b0b-62b1-45ff-9805-48285e3d48e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:53.920082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b93b0b-62b1-45ff-9805-48285e3d48e1 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:53.982144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1092/2222] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:53 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:53.987083 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39185c47-7559-4bce-ab70-b6aa3b09c0cb None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:54.022070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39185c47-7559-4bce-ab70-b6aa3b09c0cb None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:54.130752 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f0582-d923-467f-920d-9d075ad397c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:54.133732 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f0582-d923-467f-920d-9d075ad397c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:54.134034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f0582-d923-467f-920d-9d075ad397c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:54.136633 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f0582-d923-467f-920d-9d075ad397c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:54.137736 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f0582-d923-467f-920d-9d075ad397c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:54.143334 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f0582-d923-467f-920d-9d075ad397c0 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:54.192452 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1131/2223] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:26:53 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:26:54.198371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b93b0b-62b1-45ff-9805-48285e3d48e1 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:54.213080 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b93b0b-62b1-45ff-9805-48285e3d48e1 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:54.218499 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5765c4-54c3-45de-bf2c-ebed418a3022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:54.219764 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5765c4-54c3-45de-bf2c-ebed418a3022 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:54.219764 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5765c4-54c3-45de-bf2c-ebed418a3022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:54.220629 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5765c4-54c3-45de-bf2c-ebed418a3022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:54.220629 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5765c4-54c3-45de-bf2c-ebed418a3022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:54.222466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5765c4-54c3-45de-bf2c-ebed418a3022 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:54.235932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1093/2224] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:26:54.242024 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f0582-d923-467f-920d-9d075ad397c0 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:54.252539 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f0582-d923-467f-920d-9d075ad397c0 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:54.258692 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0e406-97c0-474c-a791-85a923baa6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:54.259886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0e406-97c0-474c-a791-85a923baa6f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:54.260419 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0e406-97c0-474c-a791-85a923baa6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:54.260922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0e406-97c0-474c-a791-85a923baa6f8 admin admin] PATH_INFO: `/v3/projects/bd7f880ff8c94f85a7b303c7cc460746/users/14de2d39696742049277a2fd8685950b/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:54.264961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:54.285489 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0e406-97c0-474c-a791-85a923baa6f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7f880ff8c94f85a7b303c7cc460746, user_id=14de2d39696742049277a2fd8685950b, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:54.289296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0e406-97c0-474c-a791-85a923baa6f8 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:54.307565 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1132/2225] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:54 2022] PUT /identity/v3/projects/bd7f880ff8c94f85a7b303c7cc460746/users/14de2d39696742049277a2fd8685950b/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:54.311429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5765c4-54c3-45de-bf2c-ebed418a3022 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:54.323618 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5765c4-54c3-45de-bf2c-ebed418a3022 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:54.399819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78467923-f737-4917-b05f-57c3de6f2912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:54.400661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78467923-f737-4917-b05f-57c3de6f2912 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:54.400956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78467923-f737-4917-b05f-57c3de6f2912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:54.401392 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78467923-f737-4917-b05f-57c3de6f2912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:54.402536 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78467923-f737-4917-b05f-57c3de6f2912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:54.404454 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78467923-f737-4917-b05f-57c3de6f2912 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:54.416607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1094/2226] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:26:54.421334 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0e406-97c0-474c-a791-85a923baa6f8 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:54.433543 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0e406-97c0-474c-a791-85a923baa6f8 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:54.438409 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874a47f-eaae-444d-b8e6-e1f113cd9db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:54.439101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874a47f-eaae-444d-b8e6-e1f113cd9db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:54.439386 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874a47f-eaae-444d-b8e6-e1f113cd9db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:54.439661 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874a47f-eaae-444d-b8e6-e1f113cd9db2 admin admin] PATH_INFO: `/v3/projects/bd7f880ff8c94f85a7b303c7cc460746/users/14de2d39696742049277a2fd8685950b/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:54.443188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874a47f-eaae-444d-b8e6-e1f113cd9db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7f880ff8c94f85a7b303c7cc460746, user_id=14de2d39696742049277a2fd8685950b, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:54.445949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874a47f-eaae-444d-b8e6-e1f113cd9db2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:54.468274 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1133/2227] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:26:54 2022] PUT /identity/v3/projects/bd7f880ff8c94f85a7b303c7cc460746/users/14de2d39696742049277a2fd8685950b/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:54.475336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c28689-5401-4eba-b55d-19828844e415 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:54.475848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c28689-5401-4eba-b55d-19828844e415 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:54.476410 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c28689-5401-4eba-b55d-19828844e415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:54.515083 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-67c28689-5401-4eba-b55d-19828844e415 None None] MFA Rules not processed for user `14de2d39696742049277a2fd8685950b`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:54.516266 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-67c28689-5401-4eba-b55d-19828844e415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:54.574834 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:54.625451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1095/2228] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:54.631453 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874a47f-eaae-444d-b8e6-e1f113cd9db2 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:54.633219 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1874a47f-eaae-444d-b8e6-e1f113cd9db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:54.715869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874a47f-eaae-444d-b8e6-e1f113cd9db2 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:54.720688 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb6ec9-78d1-4b7f-9572-ad4c38e5295e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:54.720961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb6ec9-78d1-4b7f-9572-ad4c38e5295e service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:54.721105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb6ec9-78d1-4b7f-9572-ad4c38e5295e service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:54.721294 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb6ec9-78d1-4b7f-9572-ad4c38e5295e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:54.732190 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb6ec9-78d1-4b7f-9572-ad4c38e5295e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:54.734078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb6ec9-78d1-4b7f-9572-ad4c38e5295e service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:54.746231 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1134/2229] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:56.109541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c28689-5401-4eba-b55d-19828844e415 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:56.111137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-67c28689-5401-4eba-b55d-19828844e415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:56.127070 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c28689-5401-4eba-b55d-19828844e415 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:56.132597 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e140e-5744-4b2f-a44d-39f20811a357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:56.133398 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e140e-5744-4b2f-a44d-39f20811a357 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:56.133897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e140e-5744-4b2f-a44d-39f20811a357 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:56.134280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e140e-5744-4b2f-a44d-39f20811a357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:56.136673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4c8e140e-5744-4b2f-a44d-39f20811a357 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:56.241659 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e140e-5744-4b2f-a44d-39f20811a357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:56.243330 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e140e-5744-4b2f-a44d-39f20811a357 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:56.279190 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1096/2230] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:57.603044 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb6ec9-78d1-4b7f-9572-ad4c38e5295e service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:57.695518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb6ec9-78d1-4b7f-9572-ad4c38e5295e service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:57.704037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cbc89-59f4-4de5-8d8a-4deb8eabfb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:57.704876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cbc89-59f4-4de5-8d8a-4deb8eabfb3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:57.705614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cbc89-59f4-4de5-8d8a-4deb8eabfb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:57.706912 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cbc89-59f4-4de5-8d8a-4deb8eabfb3a admin admin] PATH_INFO: `/v3/users/760ce877e00e4675892baad0e6f333a9` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:57.709572 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cbc89-59f4-4de5-8d8a-4deb8eabfb3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=760ce877e00e4675892baad0e6f333a9)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:57.713523 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cbc89-59f4-4de5-8d8a-4deb8eabfb3a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:57.802904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-030cbc89-59f4-4de5-8d8a-4deb8eabfb3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '760ce877e00e4675892baad0e6f333a9'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:57.804144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-030cbc89-59f4-4de5-8d8a-4deb8eabfb3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '760ce877e00e4675892baad0e6f333a9'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:57.822936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-030cbc89-59f4-4de5-8d8a-4deb8eabfb3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '760ce877e00e4675892baad0e6f333a9'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:57.823924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-030cbc89-59f4-4de5-8d8a-4deb8eabfb3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '760ce877e00e4675892baad0e6f333a9'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:57.845276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-030cbc89-59f4-4de5-8d8a-4deb8eabfb3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '760ce877e00e4675892baad0e6f333a9'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:57.849725 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:57.875811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1135/2231] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:57 2022] DELETE /identity/v3/users/760ce877e00e4675892baad0e6f333a9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:57.883697 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c040af3-7c08-4330-b5b4-ab00bed39740 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:57.884381 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c040af3-7c08-4330-b5b4-ab00bed39740 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:57.885136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c040af3-7c08-4330-b5b4-ab00bed39740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:57.924298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4c040af3-7c08-4330-b5b4-ab00bed39740 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:57.928058 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4c040af3-7c08-4330-b5b4-ab00bed39740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:58.056197 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1097/2232] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:26:58.071779 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cbc89-59f4-4de5-8d8a-4deb8eabfb3a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:58.074399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-030cbc89-59f4-4de5-8d8a-4deb8eabfb3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:58.244964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cbc89-59f4-4de5-8d8a-4deb8eabfb3a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:58.251253 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b031c9-aa66-4bf0-9510-22f5ab025c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:58.252378 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b031c9-aa66-4bf0-9510-22f5ab025c4a service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:58.252927 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b031c9-aa66-4bf0-9510-22f5ab025c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:58.253938 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b031c9-aa66-4bf0-9510-22f5ab025c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:58.272388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b031c9-aa66-4bf0-9510-22f5ab025c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:58.275101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b031c9-aa66-4bf0-9510-22f5ab025c4a service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:58.292152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1136/2233] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:58.697619 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c040af3-7c08-4330-b5b4-ab00bed39740 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:58.699826 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4c040af3-7c08-4330-b5b4-ab00bed39740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:58.734214 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c040af3-7c08-4330-b5b4-ab00bed39740 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:58.742184 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13e2c2-8f95-49ec-a863-3326cd360f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:58.743973 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13e2c2-8f95-49ec-a863-3326cd360f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:58.744725 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13e2c2-8f95-49ec-a863-3326cd360f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:58.745391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13e2c2-8f95-49ec-a863-3326cd360f03 admin admin] PATH_INFO: `/v3/projects/af09fc9cf8a24a02950ec67ab18ac767` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:58.748842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13e2c2-8f95-49ec-a863-3326cd360f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af09fc9cf8a24a02950ec67ab18ac767)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:58.756851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13e2c2-8f95-49ec-a863-3326cd360f03 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:58.844118 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-cf13e2c2-8f95-49ec-a863-3326cd360f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af09fc9cf8a24a02950ec67ab18ac767', 'request_id': 'req-cf13e2c2-8f95-49ec-a863-3326cd360f03'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:58.855377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-cf13e2c2-8f95-49ec-a863-3326cd360f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af09fc9cf8a24a02950ec67ab18ac767', 'request_id': 'req-cf13e2c2-8f95-49ec-a863-3326cd360f03'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:58.876547 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-cf13e2c2-8f95-49ec-a863-3326cd360f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af09fc9cf8a24a02950ec67ab18ac767', 'request_id': 'req-cf13e2c2-8f95-49ec-a863-3326cd360f03'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:58.885749 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:58.894280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-cf13e2c2-8f95-49ec-a863-3326cd360f03 admin admin] The token cache is being invalidate because project af09fc9cf8a24a02950ec67ab18ac767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:58.894776 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-cf13e2c2-8f95-49ec-a863-3326cd360f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:58.895801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-cf13e2c2-8f95-49ec-a863-3326cd360f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:58.897747 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1098/2234] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:58 2022] DELETE /identity/v3/projects/af09fc9cf8a24a02950ec67ab18ac767 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:58.902467 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b031c9-aa66-4bf0-9510-22f5ab025c4a service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:58.914298 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b031c9-aa66-4bf0-9510-22f5ab025c4a service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:58.985723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55e8f0-fb52-42b2-aa28-2fca12445be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:58.986387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55e8f0-fb52-42b2-aa28-2fca12445be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:58.986778 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55e8f0-fb52-42b2-aa28-2fca12445be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:58.987068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55e8f0-fb52-42b2-aa28-2fca12445be3 admin admin] PATH_INFO: `/v3/users/14de2d39696742049277a2fd8685950b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:58.989595 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55e8f0-fb52-42b2-aa28-2fca12445be3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14de2d39696742049277a2fd8685950b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:58.991727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55e8f0-fb52-42b2-aa28-2fca12445be3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:59.052422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4c55e8f0-fb52-42b2-aa28-2fca12445be3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14de2d39696742049277a2fd8685950b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:59.053270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4c55e8f0-fb52-42b2-aa28-2fca12445be3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14de2d39696742049277a2fd8685950b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:59.062300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4c55e8f0-fb52-42b2-aa28-2fca12445be3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14de2d39696742049277a2fd8685950b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:59.063695 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4c55e8f0-fb52-42b2-aa28-2fca12445be3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14de2d39696742049277a2fd8685950b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:59.079760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4c55e8f0-fb52-42b2-aa28-2fca12445be3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14de2d39696742049277a2fd8685950b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:59.095544 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1137/2235] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:26:58 2022] DELETE /identity/v3/users/14de2d39696742049277a2fd8685950b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:26:59.507379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13e2c2-8f95-49ec-a863-3326cd360f03 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:59.508876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cf13e2c2-8f95-49ec-a863-3326cd360f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:59.527662 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13e2c2-8f95-49ec-a863-3326cd360f03 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:59.631805 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba884b-3608-4d0a-b635-dc96ddb67485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:59.632732 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba884b-3608-4d0a-b635-dc96ddb67485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:59.633190 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba884b-3608-4d0a-b635-dc96ddb67485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:59.633657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba884b-3608-4d0a-b635-dc96ddb67485 admin admin] PATH_INFO: `/v3/projects/bd7f880ff8c94f85a7b303c7cc460746` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:59.642252 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba884b-3608-4d0a-b635-dc96ddb67485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7f880ff8c94f85a7b303c7cc460746)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:59.647383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba884b-3608-4d0a-b635-dc96ddb67485 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:59.700698 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ceba884b-3608-4d0a-b635-dc96ddb67485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7f880ff8c94f85a7b303c7cc460746', 'request_id': 'req-ceba884b-3608-4d0a-b635-dc96ddb67485'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:59.708309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ceba884b-3608-4d0a-b635-dc96ddb67485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7f880ff8c94f85a7b303c7cc460746', 'request_id': 'req-ceba884b-3608-4d0a-b635-dc96ddb67485'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:59.716976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ceba884b-3608-4d0a-b635-dc96ddb67485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7f880ff8c94f85a7b303c7cc460746', 'request_id': 'req-ceba884b-3608-4d0a-b635-dc96ddb67485'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:59.728208 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ceba884b-3608-4d0a-b635-dc96ddb67485 admin admin] The token cache is being invalidate because project bd7f880ff8c94f85a7b303c7cc460746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:26:59.728503 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ceba884b-3608-4d0a-b635-dc96ddb67485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:59.729139 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ceba884b-3608-4d0a-b635-dc96ddb67485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:26:59.730689 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1099/2236] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:26:59 2022] DELETE /identity/v3/projects/bd7f880ff8c94f85a7b303c7cc460746 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:26:59.735794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcba8d-9d2f-415a-a2c6-98de62dc0ef6 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:59.736280 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcba8d-9d2f-415a-a2c6-98de62dc0ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:59.736660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcba8d-9d2f-415a-a2c6-98de62dc0ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:59.759332 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-16dcba8d-9d2f-415a-a2c6-98de62dc0ef6 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:59.760634 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-16dcba8d-9d2f-415a-a2c6-98de62dc0ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:59.771211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:59.843523 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1138/2237] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:59.853204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa634e0-fde7-4ca6-85dd-b6e065c53da6 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:59.853494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa634e0-fde7-4ca6-85dd-b6e065c53da6 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:59.853779 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa634e0-fde7-4ca6-85dd-b6e065c53da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:59.874246 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4aa634e0-fde7-4ca6-85dd-b6e065c53da6 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:26:59.875491 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4aa634e0-fde7-4ca6-85dd-b6e065c53da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:26:59.885245 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1100/2238] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:26:59.889953 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcba8d-9d2f-415a-a2c6-98de62dc0ef6 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:59.904276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcba8d-9d2f-415a-a2c6-98de62dc0ef6 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:59.911687 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe0897-1530-4552-b1e1-c8fb5292021b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:59.913014 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe0897-1530-4552-b1e1-c8fb5292021b admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:59.913438 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe0897-1530-4552-b1e1-c8fb5292021b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:59.913817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe0897-1530-4552-b1e1-c8fb5292021b admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:59.914714 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe0897-1530-4552-b1e1-c8fb5292021b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:26:59.915226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe0897-1530-4552-b1e1-c8fb5292021b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:59.921766 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe0897-1530-4552-b1e1-c8fb5292021b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:26:59.939388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1139/2239] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:26:59.944680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa634e0-fde7-4ca6-85dd-b6e065c53da6 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:26:59.955974 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa634e0-fde7-4ca6-85dd-b6e065c53da6 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:26:59.961930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f304a-463b-47d4-a57e-5c8a24005ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:26:59.962521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f304a-463b-47d4-a57e-5c8a24005ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:26:59.962804 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f304a-463b-47d4-a57e-5c8a24005ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:26:59.963075 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f304a-463b-47d4-a57e-5c8a24005ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:26:59.963884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f304a-463b-47d4-a57e-5c8a24005ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:26:59.965968 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f304a-463b-47d4-a57e-5c8a24005ab0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:00.008295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1101/2240] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:26:59 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:00.009822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe0897-1530-4552-b1e1-c8fb5292021b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:00.031511 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe0897-1530-4552-b1e1-c8fb5292021b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:00.140128 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69aa852-891d-41a5-8e30-3d95d9aa06f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:00.141162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aa852-891d-41a5-8e30-3d95d9aa06f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:00.141598 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aa852-891d-41a5-8e30-3d95d9aa06f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:00.141956 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aa852-891d-41a5-8e30-3d95d9aa06f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:00.142695 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69aa852-891d-41a5-8e30-3d95d9aa06f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:00.145959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69aa852-891d-41a5-8e30-3d95d9aa06f6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:00.179997 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1140/2241] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:27:00 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:00.185341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f304a-463b-47d4-a57e-5c8a24005ab0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:00.203496 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f304a-463b-47d4-a57e-5c8a24005ab0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:00.210177 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a7f74-7e6b-459b-9155-25972292d0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:00.210853 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a7f74-7e6b-459b-9155-25972292d0cf admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:00.211262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a7f74-7e6b-459b-9155-25972292d0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:00.211662 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a7f74-7e6b-459b-9155-25972292d0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:00.212822 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a7f74-7e6b-459b-9155-25972292d0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:00.214679 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a7f74-7e6b-459b-9155-25972292d0cf admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:00.227939 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1102/2242] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:00.232122 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69aa852-891d-41a5-8e30-3d95d9aa06f6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:00.242730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69aa852-891d-41a5-8e30-3d95d9aa06f6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:00.247586 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68210a27-68a2-46ac-b317-787d6373b394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:00.248290 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68210a27-68a2-46ac-b317-787d6373b394 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:00.248599 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68210a27-68a2-46ac-b317-787d6373b394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:00.248872 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68210a27-68a2-46ac-b317-787d6373b394 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:00.249585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68210a27-68a2-46ac-b317-787d6373b394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:00.251282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68210a27-68a2-46ac-b317-787d6373b394 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:00.267087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1141/2243] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:27:00.275057 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a7f74-7e6b-459b-9155-25972292d0cf admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:00.294881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a7f74-7e6b-459b-9155-25972292d0cf admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:00.303998 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1e816-fb65-4fc6-86dd-2cbeceac62e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:00.304796 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1e816-fb65-4fc6-86dd-2cbeceac62e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:00.305146 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1e816-fb65-4fc6-86dd-2cbeceac62e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:00.305512 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1e816-fb65-4fc6-86dd-2cbeceac62e6 admin admin] PATH_INFO: `/v3/projects/cc910f2ad850411ea3b51c2fdad71ee6/users/4995a70489a347bdb25de7c49e656ddc/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:00.328346 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1e816-fb65-4fc6-86dd-2cbeceac62e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc910f2ad850411ea3b51c2fdad71ee6, user_id=4995a70489a347bdb25de7c49e656ddc, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:00.333988 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1e816-fb65-4fc6-86dd-2cbeceac62e6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:00.357834 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1103/2244] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:27:00 2022] PUT /identity/v3/projects/cc910f2ad850411ea3b51c2fdad71ee6/users/4995a70489a347bdb25de7c49e656ddc/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:27:00.375412 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91389b02-d7ca-4cbb-9ec2-48c73749873f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:00.375690 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91389b02-d7ca-4cbb-9ec2-48c73749873f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:00.376021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91389b02-d7ca-4cbb-9ec2-48c73749873f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:00.449616 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-91389b02-d7ca-4cbb-9ec2-48c73749873f None None] MFA Rules not processed for user `4995a70489a347bdb25de7c49e656ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:00.451770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-91389b02-d7ca-4cbb-9ec2-48c73749873f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:00.597396 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1142/2245] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:00.604350 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1e816-fb65-4fc6-86dd-2cbeceac62e6 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:00.718422 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:00.860677 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1e816-fb65-4fc6-86dd-2cbeceac62e6 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:00.868721 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750877c-1152-428b-bcde-3cecf9193d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:00.869444 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750877c-1152-428b-bcde-3cecf9193d3b admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:00.869734 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750877c-1152-428b-bcde-3cecf9193d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:00.870014 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750877c-1152-428b-bcde-3cecf9193d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:00.870707 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750877c-1152-428b-bcde-3cecf9193d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:00.872795 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750877c-1152-428b-bcde-3cecf9193d3b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:00.914903 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1104/2246] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:27:00 2022] POST /identity/v3/projects => generated 375 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:00.919477 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91389b02-d7ca-4cbb-9ec2-48c73749873f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:00.945177 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91389b02-d7ca-4cbb-9ec2-48c73749873f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:00.959663 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:01.036514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb1fed-c167-43dc-98e6-faeb7033e5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:01.037239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb1fed-c167-43dc-98e6-faeb7033e5fd admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:01.037519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb1fed-c167-43dc-98e6-faeb7033e5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:01.037793 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb1fed-c167-43dc-98e6-faeb7033e5fd admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:01.038481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb1fed-c167-43dc-98e6-faeb7033e5fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:01.040486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb1fed-c167-43dc-98e6-faeb7033e5fd admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:01.063787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1143/2247] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:27:00 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:01.070179 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750877c-1152-428b-bcde-3cecf9193d3b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:01.082088 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750877c-1152-428b-bcde-3cecf9193d3b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:01.087567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c37a71-abad-493a-8309-2b2ae691b4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:01.088520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c37a71-abad-493a-8309-2b2ae691b4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:01.088806 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c37a71-abad-493a-8309-2b2ae691b4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:01.089083 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c37a71-abad-493a-8309-2b2ae691b4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:01.089817 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c37a71-abad-493a-8309-2b2ae691b4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:01.091622 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c37a71-abad-493a-8309-2b2ae691b4e3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:01.104969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1105/2248] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:01.109706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb1fed-c167-43dc-98e6-faeb7033e5fd admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:01.128897 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb1fed-c167-43dc-98e6-faeb7033e5fd admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:01.136042 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8621af6-3424-43d8-bc49-2b7a2d1259ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:01.137416 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8621af6-3424-43d8-bc49-2b7a2d1259ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:01.137717 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8621af6-3424-43d8-bc49-2b7a2d1259ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:01.138049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8621af6-3424-43d8-bc49-2b7a2d1259ca admin admin] PATH_INFO: `/v3/projects/c3d2700edc0f4e0a91b4af62f316ef1c/users/898883440f6a4e978f246f56148152f7/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:01.292655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8621af6-3424-43d8-bc49-2b7a2d1259ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d2700edc0f4e0a91b4af62f316ef1c, user_id=898883440f6a4e978f246f56148152f7, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:01.295292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8621af6-3424-43d8-bc49-2b7a2d1259ca admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:01.313193 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1144/2249] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:27:01 2022] PUT /identity/v3/projects/c3d2700edc0f4e0a91b4af62f316ef1c/users/898883440f6a4e978f246f56148152f7/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:27:01.319462 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c37a71-abad-493a-8309-2b2ae691b4e3 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:01.339157 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c37a71-abad-493a-8309-2b2ae691b4e3 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:01.403134 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec988b-0e63-49a5-ae12-40d291502722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:01.403497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec988b-0e63-49a5-ae12-40d291502722 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:01.403956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec988b-0e63-49a5-ae12-40d291502722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:01.404154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec988b-0e63-49a5-ae12-40d291502722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:01.405028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec988b-0e63-49a5-ae12-40d291502722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:01.406721 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec988b-0e63-49a5-ae12-40d291502722 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:01.418350 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1106/2250] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:01.423051 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8621af6-3424-43d8-bc49-2b7a2d1259ca admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:01.434886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8621af6-3424-43d8-bc49-2b7a2d1259ca admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:01.439898 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfbfd1-5f80-4850-aa51-4946ea69ac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:01.441138 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfbfd1-5f80-4850-aa51-4946ea69ac6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:01.441619 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfbfd1-5f80-4850-aa51-4946ea69ac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:01.442076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfbfd1-5f80-4850-aa51-4946ea69ac6e admin admin] PATH_INFO: `/v3/projects/c3d2700edc0f4e0a91b4af62f316ef1c/users/898883440f6a4e978f246f56148152f7/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:01.444562 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfbfd1-5f80-4850-aa51-4946ea69ac6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d2700edc0f4e0a91b4af62f316ef1c, user_id=898883440f6a4e978f246f56148152f7, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:01.447609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfbfd1-5f80-4850-aa51-4946ea69ac6e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:01.461029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1145/2251] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:27:01 2022] PUT /identity/v3/projects/c3d2700edc0f4e0a91b4af62f316ef1c/users/898883440f6a4e978f246f56148152f7/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:27:01.477725 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4770d8-5102-4b2d-beb8-674b5fec783c None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:01.478031 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4770d8-5102-4b2d-beb8-674b5fec783c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:01.478471 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4770d8-5102-4b2d-beb8-674b5fec783c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:01.511128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-8a4770d8-5102-4b2d-beb8-674b5fec783c None None] MFA Rules not processed for user `898883440f6a4e978f246f56148152f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:01.512419 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8a4770d8-5102-4b2d-beb8-674b5fec783c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:01.590952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1107/2252] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:01.602645 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfbfd1-5f80-4850-aa51-4946ea69ac6e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:01.604506 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c6cfbfd1-5f80-4850-aa51-4946ea69ac6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:01.681411 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfbfd1-5f80-4850-aa51-4946ea69ac6e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:01.685236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779045b-570e-4897-83c4-ec2a5cb8e5b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:01.685979 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779045b-570e-4897-83c4-ec2a5cb8e5b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:01.686280 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779045b-570e-4897-83c4-ec2a5cb8e5b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:01.686567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779045b-570e-4897-83c4-ec2a5cb8e5b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:01.759732 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779045b-570e-4897-83c4-ec2a5cb8e5b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:01.761464 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779045b-570e-4897-83c4-ec2a5cb8e5b7 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:01.771852 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1146/2253] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:27:04.675602 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4770d8-5102-4b2d-beb8-674b5fec783c None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:04.681227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8a4770d8-5102-4b2d-beb8-674b5fec783c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:04.757227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:04.872013 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4770d8-5102-4b2d-beb8-674b5fec783c None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:04.882076 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2e66a-0a9c-45bc-9e0a-8ad5142b9abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:04.883229 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2e66a-0a9c-45bc-9e0a-8ad5142b9abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:04.883744 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2e66a-0a9c-45bc-9e0a-8ad5142b9abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:04.884293 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2e66a-0a9c-45bc-9e0a-8ad5142b9abd admin admin] PATH_INFO: `/v3/users/e65d74c114044f569ba2ae1546612f1a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:04.886512 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2e66a-0a9c-45bc-9e0a-8ad5142b9abd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e65d74c114044f569ba2ae1546612f1a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:04.902373 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2e66a-0a9c-45bc-9e0a-8ad5142b9abd admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:04.976031 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-cfe2e66a-0a9c-45bc-9e0a-8ad5142b9abd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e65d74c114044f569ba2ae1546612f1a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:04.977199 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-cfe2e66a-0a9c-45bc-9e0a-8ad5142b9abd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e65d74c114044f569ba2ae1546612f1a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:04.992379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-cfe2e66a-0a9c-45bc-9e0a-8ad5142b9abd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e65d74c114044f569ba2ae1546612f1a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:05.021634 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-cfe2e66a-0a9c-45bc-9e0a-8ad5142b9abd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e65d74c114044f569ba2ae1546612f1a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:05.036744 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-cfe2e66a-0a9c-45bc-9e0a-8ad5142b9abd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e65d74c114044f569ba2ae1546612f1a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:05.049290 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1108/2254] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:27:04 2022] DELETE /identity/v3/users/e65d74c114044f569ba2ae1546612f1a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:05.057070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902ae1-d8ff-4994-ad13-74716c71c4d7 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:05.057740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902ae1-d8ff-4994-ad13-74716c71c4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:05.058071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902ae1-d8ff-4994-ad13-74716c71c4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:05.107950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-89902ae1-d8ff-4994-ad13-74716c71c4d7 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:05.110202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-89902ae1-d8ff-4994-ad13-74716c71c4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:05.134434 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:05.295262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1147/2255] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:05.307333 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2e66a-0a9c-45bc-9e0a-8ad5142b9abd admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:05.317536 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cfe2e66a-0a9c-45bc-9e0a-8ad5142b9abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:05.432432 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2e66a-0a9c-45bc-9e0a-8ad5142b9abd admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:05.438523 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe26ea2-275f-48de-8256-89b043c58194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:05.439610 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe26ea2-275f-48de-8256-89b043c58194 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:05.440013 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe26ea2-275f-48de-8256-89b043c58194 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:05.441103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe26ea2-275f-48de-8256-89b043c58194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:05.457823 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe26ea2-275f-48de-8256-89b043c58194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:05.459567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe26ea2-275f-48de-8256-89b043c58194 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:05.470998 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1109/2256] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:27:05.797967 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89902ae1-d8ff-4994-ad13-74716c71c4d7 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:05.800027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-89902ae1-d8ff-4994-ad13-74716c71c4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:05.818351 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe26ea2-275f-48de-8256-89b043c58194 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:05.819982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cbe26ea2-275f-48de-8256-89b043c58194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:05.845890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe26ea2-275f-48de-8256-89b043c58194 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:05.852587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b99ac0-321e-4996-8404-be6fe7916071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:05.853633 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b99ac0-321e-4996-8404-be6fe7916071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:05.853933 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b99ac0-321e-4996-8404-be6fe7916071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:05.854220 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b99ac0-321e-4996-8404-be6fe7916071 admin admin] PATH_INFO: `/v3/projects/52ce013d275045609ec64f42fdaebff8` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:05.855944 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b99ac0-321e-4996-8404-be6fe7916071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ce013d275045609ec64f42fdaebff8)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:05.858133 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b99ac0-321e-4996-8404-be6fe7916071 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:05.888780 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89902ae1-d8ff-4994-ad13-74716c71c4d7 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:05.895554 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051ef19-78ba-4022-9b30-92c45b5edf35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:05.896353 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051ef19-78ba-4022-9b30-92c45b5edf35 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:05.896701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051ef19-78ba-4022-9b30-92c45b5edf35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:05.897171 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051ef19-78ba-4022-9b30-92c45b5edf35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:05.901395 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c051ef19-78ba-4022-9b30-92c45b5edf35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:05.926748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:05.943369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-96b99ac0-321e-4996-8404-be6fe7916071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ce013d275045609ec64f42fdaebff8', 'request_id': 'req-96b99ac0-321e-4996-8404-be6fe7916071'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:05.953731 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-96b99ac0-321e-4996-8404-be6fe7916071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ce013d275045609ec64f42fdaebff8', 'request_id': 'req-96b99ac0-321e-4996-8404-be6fe7916071'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:05.967129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-96b99ac0-321e-4996-8404-be6fe7916071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ce013d275045609ec64f42fdaebff8', 'request_id': 'req-96b99ac0-321e-4996-8404-be6fe7916071'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:05.986240 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-96b99ac0-321e-4996-8404-be6fe7916071 admin admin] The token cache is being invalidate because project 52ce013d275045609ec64f42fdaebff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:27:05.986894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-96b99ac0-321e-4996-8404-be6fe7916071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:05.989896 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-96b99ac0-321e-4996-8404-be6fe7916071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:05.992475 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1110/2257] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:27:05 2022] DELETE /identity/v3/projects/52ce013d275045609ec64f42fdaebff8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:27:06.001274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098927b-5e24-4a91-8c2b-aef1732e25ab None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:06.002404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098927b-5e24-4a91-8c2b-aef1732e25ab None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:06.003570 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098927b-5e24-4a91-8c2b-aef1732e25ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:06.030711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051ef19-78ba-4022-9b30-92c45b5edf35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:06.032213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051ef19-78ba-4022-9b30-92c45b5edf35 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:06.035905 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d098927b-5e24-4a91-8c2b-aef1732e25ab None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:06.037630 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d098927b-5e24-4a91-8c2b-aef1732e25ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:06.043418 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1148/2258] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:27:06.142243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1111/2259] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:06.154035 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487d7c1-649f-43e3-92d9-720fe042e2fc None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:06.154695 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487d7c1-649f-43e3-92d9-720fe042e2fc None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:06.154695 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487d7c1-649f-43e3-92d9-720fe042e2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:06.180770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6487d7c1-649f-43e3-92d9-720fe042e2fc None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:06.182300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6487d7c1-649f-43e3-92d9-720fe042e2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:06.193349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1149/2260] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:27:06.199093 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098927b-5e24-4a91-8c2b-aef1732e25ab None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:06.210759 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098927b-5e24-4a91-8c2b-aef1732e25ab None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:06.216240 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decba4df-c171-4ef7-9a3e-a0c4d236fab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:06.217935 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decba4df-c171-4ef7-9a3e-a0c4d236fab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:06.218214 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decba4df-c171-4ef7-9a3e-a0c4d236fab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:06.218675 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decba4df-c171-4ef7-9a3e-a0c4d236fab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:06.219640 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decba4df-c171-4ef7-9a3e-a0c4d236fab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:27:06.219938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decba4df-c171-4ef7-9a3e-a0c4d236fab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:06.222330 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decba4df-c171-4ef7-9a3e-a0c4d236fab0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:06.244236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1112/2261] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:27:06.249649 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487d7c1-649f-43e3-92d9-720fe042e2fc None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:06.263182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487d7c1-649f-43e3-92d9-720fe042e2fc None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:06.269172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274ebfb-92f4-4060-95ec-492951cd0cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:06.270237 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274ebfb-92f4-4060-95ec-492951cd0cbd admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:06.270672 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274ebfb-92f4-4060-95ec-492951cd0cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:06.271146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274ebfb-92f4-4060-95ec-492951cd0cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:06.272087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274ebfb-92f4-4060-95ec-492951cd0cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:06.274604 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274ebfb-92f4-4060-95ec-492951cd0cbd admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:06.322084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1150/2262] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:27:06 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:06.328969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decba4df-c171-4ef7-9a3e-a0c4d236fab0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:06.350911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decba4df-c171-4ef7-9a3e-a0c4d236fab0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:06.437372 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2844f96-2b28-4a9b-a1d8-0016d905556e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:06.438276 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2844f96-2b28-4a9b-a1d8-0016d905556e admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:06.438564 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2844f96-2b28-4a9b-a1d8-0016d905556e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:06.438842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2844f96-2b28-4a9b-a1d8-0016d905556e admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:06.439650 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2844f96-2b28-4a9b-a1d8-0016d905556e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:06.443137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2844f96-2b28-4a9b-a1d8-0016d905556e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:06.475812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1113/2263] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:27:06 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:06.480839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274ebfb-92f4-4060-95ec-492951cd0cbd admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:06.495807 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274ebfb-92f4-4060-95ec-492951cd0cbd admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:06.501735 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccd23f-a573-4a16-bae6-a7d0ca1b7dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:06.502555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccd23f-a573-4a16-bae6-a7d0ca1b7dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:06.502873 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccd23f-a573-4a16-bae6-a7d0ca1b7dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:06.503161 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccd23f-a573-4a16-bae6-a7d0ca1b7dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:06.503922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccd23f-a573-4a16-bae6-a7d0ca1b7dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:06.505758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccd23f-a573-4a16-bae6-a7d0ca1b7dcf admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:06.518821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1151/2264] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:06.525784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2844f96-2b28-4a9b-a1d8-0016d905556e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:06.548260 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2844f96-2b28-4a9b-a1d8-0016d905556e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:06.558266 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176babb2-c7c0-45dc-9209-b26465e0e69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:06.564336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176babb2-c7c0-45dc-9209-b26465e0e69d admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:06.564336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176babb2-c7c0-45dc-9209-b26465e0e69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:06.564336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176babb2-c7c0-45dc-9209-b26465e0e69d admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:06.564336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176babb2-c7c0-45dc-9209-b26465e0e69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:06.565790 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176babb2-c7c0-45dc-9209-b26465e0e69d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:06.594932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1114/2265] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:06.596996 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccd23f-a573-4a16-bae6-a7d0ca1b7dcf admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:06.634477 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccd23f-a573-4a16-bae6-a7d0ca1b7dcf admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:06.644379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e5071-8b40-43a2-89ef-280f6b0cd54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:06.645636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e5071-8b40-43a2-89ef-280f6b0cd54d admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:06.646191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e5071-8b40-43a2-89ef-280f6b0cd54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:06.646712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e5071-8b40-43a2-89ef-280f6b0cd54d admin admin] PATH_INFO: `/v3/projects/1d4a20bb885c4f4ab70ec9eb4966ff3c/users/69f42ce0a18144b39525a174e87b7ce7/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:06.681295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e5071-8b40-43a2-89ef-280f6b0cd54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d4a20bb885c4f4ab70ec9eb4966ff3c, user_id=69f42ce0a18144b39525a174e87b7ce7, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:06.685600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e5071-8b40-43a2-89ef-280f6b0cd54d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:06.723544 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1152/2266] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:27:06 2022] PUT /identity/v3/projects/1d4a20bb885c4f4ab70ec9eb4966ff3c/users/69f42ce0a18144b39525a174e87b7ce7/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:06.745425 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706036de-9768-49a2-a9c2-2e7dcb134d83 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:06.745941 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706036de-9768-49a2-a9c2-2e7dcb134d83 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:06.746449 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706036de-9768-49a2-a9c2-2e7dcb134d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:06.798071 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-706036de-9768-49a2-a9c2-2e7dcb134d83 None None] MFA Rules not processed for user `69f42ce0a18144b39525a174e87b7ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:06.799521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-706036de-9768-49a2-a9c2-2e7dcb134d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:06.833291 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:06.910815 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1115/2267] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:06.927575 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e5071-8b40-43a2-89ef-280f6b0cd54d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:06.929620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-613e5071-8b40-43a2-89ef-280f6b0cd54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:06.935475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:06.998874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e5071-8b40-43a2-89ef-280f6b0cd54d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:07.004096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51ac24-0390-4d30-96bb-82202b9f8c59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:07.004767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51ac24-0390-4d30-96bb-82202b9f8c59 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:07.005043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51ac24-0390-4d30-96bb-82202b9f8c59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:07.005314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51ac24-0390-4d30-96bb-82202b9f8c59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:07.015174 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51ac24-0390-4d30-96bb-82202b9f8c59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:07.016839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51ac24-0390-4d30-96bb-82202b9f8c59 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:07.028248 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1153/2268] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:27:16.905053 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=18 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:17.023193 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=25 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:21.160608 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706036de-9768-49a2-a9c2-2e7dcb134d83 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:21.162085 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-706036de-9768-49a2-a9c2-2e7dcb134d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:21.250356 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706036de-9768-49a2-a9c2-2e7dcb134d83 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:21.258131 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d700b-f8ca-4b8a-9e0a-9bf0d4897c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:21.259182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d700b-f8ca-4b8a-9e0a-9bf0d4897c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:21.259628 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d700b-f8ca-4b8a-9e0a-9bf0d4897c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:21.260650 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d700b-f8ca-4b8a-9e0a-9bf0d4897c51 admin admin] PATH_INFO: `/v3/users/0067ac43b76b438da40c87e69ec78923` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:21.267720 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d700b-f8ca-4b8a-9e0a-9bf0d4897c51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0067ac43b76b438da40c87e69ec78923)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:21.271097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d700b-f8ca-4b8a-9e0a-9bf0d4897c51 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:21.347315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-966d700b-f8ca-4b8a-9e0a-9bf0d4897c51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0067ac43b76b438da40c87e69ec78923'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:21.349643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-966d700b-f8ca-4b8a-9e0a-9bf0d4897c51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0067ac43b76b438da40c87e69ec78923'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:21.361395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-966d700b-f8ca-4b8a-9e0a-9bf0d4897c51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0067ac43b76b438da40c87e69ec78923'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:21.387291 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-966d700b-f8ca-4b8a-9e0a-9bf0d4897c51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0067ac43b76b438da40c87e69ec78923'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:21.400423 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-966d700b-f8ca-4b8a-9e0a-9bf0d4897c51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0067ac43b76b438da40c87e69ec78923'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:21.410680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1116/2269] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:27:21 2022] DELETE /identity/v3/users/0067ac43b76b438da40c87e69ec78923 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:21.508429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51ac24-0390-4d30-96bb-82202b9f8c59 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:21.548495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51ac24-0390-4d30-96bb-82202b9f8c59 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:21.683263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2cb29-a82c-41bd-af91-19067ef76a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:21.684688 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2cb29-a82c-41bd-af91-19067ef76a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:21.685284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2cb29-a82c-41bd-af91-19067ef76a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:21.689420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2cb29-a82c-41bd-af91-19067ef76a7c admin admin] PATH_INFO: `/v3/users/69f42ce0a18144b39525a174e87b7ce7` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:21.691155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d700b-f8ca-4b8a-9e0a-9bf0d4897c51 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:21.693722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2cb29-a82c-41bd-af91-19067ef76a7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=69f42ce0a18144b39525a174e87b7ce7)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:21.695193 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-966d700b-f8ca-4b8a-9e0a-9bf0d4897c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:21.701646 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2cb29-a82c-41bd-af91-19067ef76a7c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:21.727775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d700b-f8ca-4b8a-9e0a-9bf0d4897c51 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:21.740080 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1f346-cc3d-4266-ad45-9c8ad5410653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:21.741645 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1f346-cc3d-4266-ad45-9c8ad5410653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:21.742039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1f346-cc3d-4266-ad45-9c8ad5410653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:21.742336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1f346-cc3d-4266-ad45-9c8ad5410653 admin admin] PATH_INFO: `/v3/projects/2c9addf0cf4f4f47953a878fabdde91e` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:21.744022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1f346-cc3d-4266-ad45-9c8ad5410653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c9addf0cf4f4f47953a878fabdde91e)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:21.747731 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1f346-cc3d-4266-ad45-9c8ad5410653 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:21.795285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6fe2cb29-a82c-41bd-af91-19067ef76a7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69f42ce0a18144b39525a174e87b7ce7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:21.796043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6fe2cb29-a82c-41bd-af91-19067ef76a7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69f42ce0a18144b39525a174e87b7ce7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:21.811526 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6fe2cb29-a82c-41bd-af91-19067ef76a7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69f42ce0a18144b39525a174e87b7ce7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:21.812740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6fe2cb29-a82c-41bd-af91-19067ef76a7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69f42ce0a18144b39525a174e87b7ce7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:21.844910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6fe2cb29-a82c-41bd-af91-19067ef76a7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69f42ce0a18144b39525a174e87b7ce7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:21.862537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b4c1f346-cc3d-4266-ad45-9c8ad5410653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c9addf0cf4f4f47953a878fabdde91e', 'request_id': 'req-b4c1f346-cc3d-4266-ad45-9c8ad5410653'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:21.874671 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b4c1f346-cc3d-4266-ad45-9c8ad5410653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c9addf0cf4f4f47953a878fabdde91e', 'request_id': 'req-b4c1f346-cc3d-4266-ad45-9c8ad5410653'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:21.876766 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1154/2270] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:27:21 2022] DELETE /identity/v3/users/69f42ce0a18144b39525a174e87b7ce7 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:21.882766 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667f8be-927c-46b1-b822-df5f0548f4d0 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:21.883068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667f8be-927c-46b1-b822-df5f0548f4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:21.884449 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667f8be-927c-46b1-b822-df5f0548f4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:21.892323 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b4c1f346-cc3d-4266-ad45-9c8ad5410653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c9addf0cf4f4f47953a878fabdde91e', 'request_id': 'req-b4c1f346-cc3d-4266-ad45-9c8ad5410653'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:21.911322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3667f8be-927c-46b1-b822-df5f0548f4d0 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:21.912648 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3667f8be-927c-46b1-b822-df5f0548f4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:21.913328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b4c1f346-cc3d-4266-ad45-9c8ad5410653 admin admin] The token cache is being invalidate because project 2c9addf0cf4f4f47953a878fabdde91e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:27:21.913808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b4c1f346-cc3d-4266-ad45-9c8ad5410653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:21.914745 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b4c1f346-cc3d-4266-ad45-9c8ad5410653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:21.920286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1117/2271] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:27:21 2022] DELETE /identity/v3/projects/2c9addf0cf4f4f47953a878fabdde91e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:21.921673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1f346-cc3d-4266-ad45-9c8ad5410653 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:21.925835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b4c1f346-cc3d-4266-ad45-9c8ad5410653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:21.933783 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:21.998532 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1155/2272] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:21.999815 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed2a9a-dcd8-45e8-a601-eb3e174fa0ac None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:22.000100 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed2a9a-dcd8-45e8-a601-eb3e174fa0ac None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:22.000411 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed2a9a-dcd8-45e8-a601-eb3e174fa0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:22.017192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1f346-cc3d-4266-ad45-9c8ad5410653 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:22.020980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-53ed2a9a-dcd8-45e8-a601-eb3e174fa0ac None None] MFA Rules not processed for user `9c26da44165845babfb18a1c6ae51d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:22.022229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-53ed2a9a-dcd8-45e8-a601-eb3e174fa0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:22.028005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e8f83-6df2-4c59-aca9-e8ca754ba5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:22.028642 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e8f83-6df2-4c59-aca9-e8ca754ba5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:22.028929 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e8f83-6df2-4c59-aca9-e8ca754ba5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:22.029212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e8f83-6df2-4c59-aca9-e8ca754ba5a6 admin admin] PATH_INFO: `/v3/users/24aeb123720a4f8ba5c4175a49c31ba3` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:22.030466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e8f83-6df2-4c59-aca9-e8ca754ba5a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24aeb123720a4f8ba5c4175a49c31ba3)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:22.032488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e8f83-6df2-4c59-aca9-e8ca754ba5a6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:22.042827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:22.092533 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d02e8f83-6df2-4c59-aca9-e8ca754ba5a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24aeb123720a4f8ba5c4175a49c31ba3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:22.093328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d02e8f83-6df2-4c59-aca9-e8ca754ba5a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24aeb123720a4f8ba5c4175a49c31ba3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:22.102039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d02e8f83-6df2-4c59-aca9-e8ca754ba5a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24aeb123720a4f8ba5c4175a49c31ba3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:22.106584 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1156/2273] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:22.107859 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed2a9a-dcd8-45e8-a601-eb3e174fa0ac None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:22.109313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-53ed2a9a-dcd8-45e8-a601-eb3e174fa0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:22.128068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d02e8f83-6df2-4c59-aca9-e8ca754ba5a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24aeb123720a4f8ba5c4175a49c31ba3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:22.138671 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d02e8f83-6df2-4c59-aca9-e8ca754ba5a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24aeb123720a4f8ba5c4175a49c31ba3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:22.147924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1118/2274] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:27:21 2022] DELETE /identity/v3/users/24aeb123720a4f8ba5c4175a49c31ba3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:22.201678 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed2a9a-dcd8-45e8-a601-eb3e174fa0ac None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:22.279453 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdae54e-ef3c-41e7-aedc-7f1136082b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:22.280111 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdae54e-ef3c-41e7-aedc-7f1136082b70 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:22.280521 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdae54e-ef3c-41e7-aedc-7f1136082b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:22.280902 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdae54e-ef3c-41e7-aedc-7f1136082b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:22.283270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0cdae54e-ef3c-41e7-aedc-7f1136082b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:22.381916 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdae54e-ef3c-41e7-aedc-7f1136082b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:22.383523 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdae54e-ef3c-41e7-aedc-7f1136082b70 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:22.395167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1157/2275] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:27:22.479232 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e8f83-6df2-4c59-aca9-e8ca754ba5a6 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:22.481387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d02e8f83-6df2-4c59-aca9-e8ca754ba5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:22.512525 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e8f83-6df2-4c59-aca9-e8ca754ba5a6 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:22.527403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8227c39-4dc6-40f4-a6ac-f324715d97f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:22.528690 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8227c39-4dc6-40f4-a6ac-f324715d97f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:22.529612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8227c39-4dc6-40f4-a6ac-f324715d97f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:22.529823 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8227c39-4dc6-40f4-a6ac-f324715d97f4 admin admin] PATH_INFO: `/v3/projects/ab7f9ec3a5484c2c9c9523926aed0df7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:22.531912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8227c39-4dc6-40f4-a6ac-f324715d97f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7f9ec3a5484c2c9c9523926aed0df7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:22.540226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8227c39-4dc6-40f4-a6ac-f324715d97f4 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:22.607656 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d8227c39-4dc6-40f4-a6ac-f324715d97f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7f9ec3a5484c2c9c9523926aed0df7', 'request_id': 'req-d8227c39-4dc6-40f4-a6ac-f324715d97f4'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:22.620279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d8227c39-4dc6-40f4-a6ac-f324715d97f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7f9ec3a5484c2c9c9523926aed0df7', 'request_id': 'req-d8227c39-4dc6-40f4-a6ac-f324715d97f4'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:22.635036 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d8227c39-4dc6-40f4-a6ac-f324715d97f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7f9ec3a5484c2c9c9523926aed0df7', 'request_id': 'req-d8227c39-4dc6-40f4-a6ac-f324715d97f4'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:22.657521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d8227c39-4dc6-40f4-a6ac-f324715d97f4 admin admin] The token cache is being invalidate because project ab7f9ec3a5484c2c9c9523926aed0df7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:27:22.657628 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d8227c39-4dc6-40f4-a6ac-f324715d97f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:22.658459 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d8227c39-4dc6-40f4-a6ac-f324715d97f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:22.661348 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1119/2276] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:27:22 2022] DELETE /identity/v3/projects/ab7f9ec3a5484c2c9c9523926aed0df7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:22.666421 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb269b-7222-4bea-af5d-c1496a9beb04 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:22.667302 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb269b-7222-4bea-af5d-c1496a9beb04 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:22.667302 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb269b-7222-4bea-af5d-c1496a9beb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:22.696844 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-95bb269b-7222-4bea-af5d-c1496a9beb04 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:22.698483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-95bb269b-7222-4bea-af5d-c1496a9beb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:22.744082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:22.812310 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1158/2277] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:27:22.823483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da435e1-bacf-49d2-aebf-0b6f46e2fee1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:22.824327 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da435e1-bacf-49d2-aebf-0b6f46e2fee1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:22.824732 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da435e1-bacf-49d2-aebf-0b6f46e2fee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:22.836040 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:22.864557 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4da435e1-bacf-49d2-aebf-0b6f46e2fee1 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:22.876441 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4da435e1-bacf-49d2-aebf-0b6f46e2fee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:22.893027 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1120/2278] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:22.898571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb269b-7222-4bea-af5d-c1496a9beb04 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:22.917505 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb269b-7222-4bea-af5d-c1496a9beb04 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:22.924342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24eb8d-be6f-496f-9232-c3e6d6c07b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:22.937047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24eb8d-be6f-496f-9232-c3e6d6c07b62 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:22.937047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24eb8d-be6f-496f-9232-c3e6d6c07b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:22.937047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24eb8d-be6f-496f-9232-c3e6d6c07b62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:22.937047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24eb8d-be6f-496f-9232-c3e6d6c07b62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:27:22.937047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24eb8d-be6f-496f-9232-c3e6d6c07b62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:22.937047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24eb8d-be6f-496f-9232-c3e6d6c07b62 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:22.948367 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1159/2279] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:27:22.950185 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da435e1-bacf-49d2-aebf-0b6f46e2fee1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:22.960955 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da435e1-bacf-49d2-aebf-0b6f46e2fee1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:22.969747 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cb342-0fba-4278-af2b-56bcd7a50a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:22.970484 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cb342-0fba-4278-af2b-56bcd7a50a46 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:22.970768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cb342-0fba-4278-af2b-56bcd7a50a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:22.971093 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cb342-0fba-4278-af2b-56bcd7a50a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:22.976839 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54cb342-0fba-4278-af2b-56bcd7a50a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:22.977256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54cb342-0fba-4278-af2b-56bcd7a50a46 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:23.025846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1121/2280] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:27:22 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:23.030295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24eb8d-be6f-496f-9232-c3e6d6c07b62 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:23.048035 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24eb8d-be6f-496f-9232-c3e6d6c07b62 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:23.076535 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cb342-0fba-4278-af2b-56bcd7a50a46 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:23.081927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a54cb342-0fba-4278-af2b-56bcd7a50a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:23.168929 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffb1a1-1128-476f-bac8-b5883c655c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:23.169766 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffb1a1-1128-476f-bac8-b5883c655c4d admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:23.170613 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffb1a1-1128-476f-bac8-b5883c655c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:23.170613 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffb1a1-1128-476f-bac8-b5883c655c4d admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:23.171142 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffb1a1-1128-476f-bac8-b5883c655c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:23.173323 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffb1a1-1128-476f-bac8-b5883c655c4d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:23.203029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1160/2281] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:27:23 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:27:23.209043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffb1a1-1128-476f-bac8-b5883c655c4d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:23.221432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffb1a1-1128-476f-bac8-b5883c655c4d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:23.221709 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cb342-0fba-4278-af2b-56bcd7a50a46 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:23.245726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4f03b-7319-43cf-8001-e5e807daca0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:23.247112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4f03b-7319-43cf-8001-e5e807daca0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:23.247395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4f03b-7319-43cf-8001-e5e807daca0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:23.247670 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4f03b-7319-43cf-8001-e5e807daca0c admin admin] PATH_INFO: `/v3/projects/1d4a20bb885c4f4ab70ec9eb4966ff3c` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:23.249030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4f03b-7319-43cf-8001-e5e807daca0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d4a20bb885c4f4ab70ec9eb4966ff3c)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:23.251008 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4f03b-7319-43cf-8001-e5e807daca0c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:23.258692 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4947ed3-19fe-468a-b432-b535bc48869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:23.258872 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4947ed3-19fe-468a-b432-b535bc48869e admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:23.259097 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4947ed3-19fe-468a-b432-b535bc48869e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:23.259397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4947ed3-19fe-468a-b432-b535bc48869e admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:23.260339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4947ed3-19fe-468a-b432-b535bc48869e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:23.262516 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4947ed3-19fe-468a-b432-b535bc48869e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:23.283445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1161/2282] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:27:23.288337 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4947ed3-19fe-468a-b432-b535bc48869e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:23.306333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4947ed3-19fe-468a-b432-b535bc48869e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:23.319583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79157df8-2202-4f87-b0f7-43aad9db8d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:23.321740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79157df8-2202-4f87-b0f7-43aad9db8d45 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:23.322361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79157df8-2202-4f87-b0f7-43aad9db8d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:23.323229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79157df8-2202-4f87-b0f7-43aad9db8d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:23.326581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79157df8-2202-4f87-b0f7-43aad9db8d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:23.333980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79157df8-2202-4f87-b0f7-43aad9db8d45 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:23.345003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-8ae4f03b-7319-43cf-8001-e5e807daca0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d4a20bb885c4f4ab70ec9eb4966ff3c', 'request_id': 'req-8ae4f03b-7319-43cf-8001-e5e807daca0c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:23.355177 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-8ae4f03b-7319-43cf-8001-e5e807daca0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d4a20bb885c4f4ab70ec9eb4966ff3c', 'request_id': 'req-8ae4f03b-7319-43cf-8001-e5e807daca0c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:23.364256 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1162/2283] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:27:23.367935 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79157df8-2202-4f87-b0f7-43aad9db8d45 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:23.385972 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79157df8-2202-4f87-b0f7-43aad9db8d45 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:23.401899 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-8ae4f03b-7319-43cf-8001-e5e807daca0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d4a20bb885c4f4ab70ec9eb4966ff3c', 'request_id': 'req-8ae4f03b-7319-43cf-8001-e5e807daca0c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:23.416297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-8ae4f03b-7319-43cf-8001-e5e807daca0c admin admin] The token cache is being invalidate because project 1d4a20bb885c4f4ab70ec9eb4966ff3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:27:23.416596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-8ae4f03b-7319-43cf-8001-e5e807daca0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:23.417717 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-8ae4f03b-7319-43cf-8001-e5e807daca0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:23.419976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1122/2284] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:27:23 2022] DELETE /identity/v3/projects/1d4a20bb885c4f4ab70ec9eb4966ff3c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:23.431134 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00287891-a487-49de-a862-951d8800b3cc None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:23.431432 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00287891-a487-49de-a862-951d8800b3cc None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:23.433109 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00287891-a487-49de-a862-951d8800b3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:23.487604 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-00287891-a487-49de-a862-951d8800b3cc None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:23.490017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-00287891-a487-49de-a862-951d8800b3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:23.492850 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ba57d-3852-4d40-bf1d-7f273fb34984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:23.493889 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ba57d-3852-4d40-bf1d-7f273fb34984 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:23.494231 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ba57d-3852-4d40-bf1d-7f273fb34984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:23.494567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ba57d-3852-4d40-bf1d-7f273fb34984 admin admin] PATH_INFO: `/v3/projects/c7987271889146e49f32d9f4d7dae6e1/users/b0f1e7e8004049b09e3d54c30b0bd0e0/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:23.511769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1123/2285] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:23.521452 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6126d46-b091-4d9f-b10a-cca57d8c38f8 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:23.522307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ba57d-3852-4d40-bf1d-7f273fb34984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7987271889146e49f32d9f4d7dae6e1, user_id=b0f1e7e8004049b09e3d54c30b0bd0e0, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:23.522446 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6126d46-b091-4d9f-b10a-cca57d8c38f8 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:23.522880 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6126d46-b091-4d9f-b10a-cca57d8c38f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:23.529199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ba57d-3852-4d40-bf1d-7f273fb34984 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:23.561886 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b6126d46-b091-4d9f-b10a-cca57d8c38f8 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:23.564275 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b6126d46-b091-4d9f-b10a-cca57d8c38f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:23.575458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1163/2286] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:27:23 2022] PUT /identity/v3/projects/c7987271889146e49f32d9f4d7dae6e1/users/b0f1e7e8004049b09e3d54c30b0bd0e0/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:27:23.586746 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceacd43-78dd-485e-94ef-2ba3f08e5c66 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:23.587095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceacd43-78dd-485e-94ef-2ba3f08e5c66 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:23.587377 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceacd43-78dd-485e-94ef-2ba3f08e5c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:23.640092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:23.657263 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:23.657574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-dceacd43-78dd-485e-94ef-2ba3f08e5c66 None None] MFA Rules not processed for user `b0f1e7e8004049b09e3d54c30b0bd0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:23.657656 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-dceacd43-78dd-485e-94ef-2ba3f08e5c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:23.680271 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1124/2287] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:27:23.688454 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6126d46-b091-4d9f-b10a-cca57d8c38f8 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:23.734377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6126d46-b091-4d9f-b10a-cca57d8c38f8 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:23.757859 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68c108-97b7-4b14-9f2c-a8722a7860df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:23.760660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68c108-97b7-4b14-9f2c-a8722a7860df admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:23.761696 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68c108-97b7-4b14-9f2c-a8722a7860df admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:23.764880 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1164/2288] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:27:23.766434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68c108-97b7-4b14-9f2c-a8722a7860df admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:23.767260 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68c108-97b7-4b14-9f2c-a8722a7860df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:27:23.769469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68c108-97b7-4b14-9f2c-a8722a7860df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:23.771683 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68c108-97b7-4b14-9f2c-a8722a7860df admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:23.790303 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1125/2289] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:27:23.794670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceacd43-78dd-485e-94ef-2ba3f08e5c66 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:23.806218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68c108-97b7-4b14-9f2c-a8722a7860df admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:23.808082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4a68c108-97b7-4b14-9f2c-a8722a7860df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:23.817033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceacd43-78dd-485e-94ef-2ba3f08e5c66 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:23.822109 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab20e6-be09-4ea2-8a0e-26ada107ef32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:23.823392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab20e6-be09-4ea2-8a0e-26ada107ef32 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:23.823666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab20e6-be09-4ea2-8a0e-26ada107ef32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:23.824079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab20e6-be09-4ea2-8a0e-26ada107ef32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:23.824949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab20e6-be09-4ea2-8a0e-26ada107ef32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:23.827800 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab20e6-be09-4ea2-8a0e-26ada107ef32 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:23.887714 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1165/2290] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:27:23 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:23.892659 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab20e6-be09-4ea2-8a0e-26ada107ef32 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:23.953115 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68c108-97b7-4b14-9f2c-a8722a7860df admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:24.051906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab20e6-be09-4ea2-8a0e-26ada107ef32 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:24.061213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6855176-6a14-4ecd-8272-e9f433d79777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:24.062380 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6855176-6a14-4ecd-8272-e9f433d79777 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:24.062664 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6855176-6a14-4ecd-8272-e9f433d79777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:24.063012 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6855176-6a14-4ecd-8272-e9f433d79777 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:24.065787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6855176-6a14-4ecd-8272-e9f433d79777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:24.069368 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da80fe-1edd-460d-ad66-139d9447794a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:24.070022 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da80fe-1edd-460d-ad66-139d9447794a service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:24.070309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da80fe-1edd-460d-ad66-139d9447794a service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:24.070590 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da80fe-1edd-460d-ad66-139d9447794a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:24.071353 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6855176-6a14-4ecd-8272-e9f433d79777 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:24.112625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1166/2291] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:27:23 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:24.116544 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6855176-6a14-4ecd-8272-e9f433d79777 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:24.136327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6855176-6a14-4ecd-8272-e9f433d79777 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:24.142179 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e62f4d-424c-408d-b108-58ea76a3a40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:24.143772 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e62f4d-424c-408d-b108-58ea76a3a40e admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:24.143985 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e62f4d-424c-408d-b108-58ea76a3a40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:24.144289 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e62f4d-424c-408d-b108-58ea76a3a40e admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:24.145008 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e62f4d-424c-408d-b108-58ea76a3a40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:24.146905 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e62f4d-424c-408d-b108-58ea76a3a40e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:24.166378 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1167/2292] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:27:24.168626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e62f4d-424c-408d-b108-58ea76a3a40e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:24.175770 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da80fe-1edd-460d-ad66-139d9447794a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:24.179061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da80fe-1edd-460d-ad66-139d9447794a service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:24.184314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e62f4d-424c-408d-b108-58ea76a3a40e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:24.193266 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a66b1-2a2d-44d0-bd83-adb35faa0b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:24.193921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a66b1-2a2d-44d0-bd83-adb35faa0b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:24.194207 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a66b1-2a2d-44d0-bd83-adb35faa0b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:24.194480 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a66b1-2a2d-44d0-bd83-adb35faa0b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:24.195208 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a66b1-2a2d-44d0-bd83-adb35faa0b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:24.198269 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a66b1-2a2d-44d0-bd83-adb35faa0b71 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:24.199529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1126/2293] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:27:24.224306 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1168/2294] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:24.226034 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da80fe-1edd-460d-ad66-139d9447794a service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:24.239519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a66b1-2a2d-44d0-bd83-adb35faa0b71 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:24.243866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e30a66b1-2a2d-44d0-bd83-adb35faa0b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:24.260808 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a66b1-2a2d-44d0-bd83-adb35faa0b71 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:24.262734 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da80fe-1edd-460d-ad66-139d9447794a service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:24.267138 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d357f7a-2cea-4924-a00b-a1a5e2487af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:24.267820 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d357f7a-2cea-4924-a00b-a1a5e2487af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:24.270248 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d357f7a-2cea-4924-a00b-a1a5e2487af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:24.270587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d357f7a-2cea-4924-a00b-a1a5e2487af3 admin admin] PATH_INFO: `/v3/users/b0f1e7e8004049b09e3d54c30b0bd0e0` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:24.272106 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d357f7a-2cea-4924-a00b-a1a5e2487af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f1e7e8004049b09e3d54c30b0bd0e0)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:24.274168 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d357f7a-2cea-4924-a00b-a1a5e2487af3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:24.278525 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd0ceb-290e-4f1c-8b00-8e30f4af4982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:24.279520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd0ceb-290e-4f1c-8b00-8e30f4af4982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:24.279842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd0ceb-290e-4f1c-8b00-8e30f4af4982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:24.280294 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd0ceb-290e-4f1c-8b00-8e30f4af4982 admin admin] PATH_INFO: `/v3/projects/2aee265fc196454fb68ea3d997da52c6/users/a1f98d6cc4c94b4d8e92481a5a08ac15/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:24.310073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd0ceb-290e-4f1c-8b00-8e30f4af4982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aee265fc196454fb68ea3d997da52c6, user_id=a1f98d6cc4c94b4d8e92481a5a08ac15, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:24.314088 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd0ceb-290e-4f1c-8b00-8e30f4af4982 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:24.349709 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:24.349826 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1127/2295] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:27:24 2022] PUT /identity/v3/projects/2aee265fc196454fb68ea3d997da52c6/users/a1f98d6cc4c94b4d8e92481a5a08ac15/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:24.349826 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299481d2-a643-406e-a3ee-24b720c32a1a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:24.350627 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299481d2-a643-406e-a3ee-24b720c32a1a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:24.351297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299481d2-a643-406e-a3ee-24b720c32a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:24.352179 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3d357f7a-2cea-4924-a00b-a1a5e2487af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f1e7e8004049b09e3d54c30b0bd0e0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:24.353476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3d357f7a-2cea-4924-a00b-a1a5e2487af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f1e7e8004049b09e3d54c30b0bd0e0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:24.361298 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3d357f7a-2cea-4924-a00b-a1a5e2487af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f1e7e8004049b09e3d54c30b0bd0e0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:24.362148 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3d357f7a-2cea-4924-a00b-a1a5e2487af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f1e7e8004049b09e3d54c30b0bd0e0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:24.377171 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3d357f7a-2cea-4924-a00b-a1a5e2487af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f1e7e8004049b09e3d54c30b0bd0e0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:24.391151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-299481d2-a643-406e-a3ee-24b720c32a1a None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:24.394519 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-299481d2-a643-406e-a3ee-24b720c32a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:24.406591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1169/2296] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:27:24 2022] DELETE /identity/v3/users/b0f1e7e8004049b09e3d54c30b0bd0e0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:24.412785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c7a30-b789-43a5-9e3b-ef21effa4db7 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:24.413381 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c7a30-b789-43a5-9e3b-ef21effa4db7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:24.413813 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c7a30-b789-43a5-9e3b-ef21effa4db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:24.437448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-622c7a30-b789-43a5-9e3b-ef21effa4db7 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:24.438696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-622c7a30-b789-43a5-9e3b-ef21effa4db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:24.440686 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:24.498142 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1128/2297] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:24.511611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299481d2-a643-406e-a3ee-24b720c32a1a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:24.513311 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-299481d2-a643-406e-a3ee-24b720c32a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:24.521131 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1170/2298] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:27:24.532182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c7a30-b789-43a5-9e3b-ef21effa4db7 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:24.534867 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-622c7a30-b789-43a5-9e3b-ef21effa4db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:24.589842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299481d2-a643-406e-a3ee-24b720c32a1a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:24.634784 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c7a30-b789-43a5-9e3b-ef21effa4db7 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:24.638998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccad49-cda6-42de-af12-9a446da0e0d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:24.639643 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccad49-cda6-42de-af12-9a446da0e0d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:24.639918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccad49-cda6-42de-af12-9a446da0e0d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:24.640209 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccad49-cda6-42de-af12-9a446da0e0d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:24.654586 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ccad49-cda6-42de-af12-9a446da0e0d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:24.656518 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ccad49-cda6-42de-af12-9a446da0e0d3 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:24.669263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1171/2299] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:27:24.696248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf375ba-eb1f-452e-835d-4ef57927bb05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:24.697691 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf375ba-eb1f-452e-835d-4ef57927bb05 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:24.698256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf375ba-eb1f-452e-835d-4ef57927bb05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:24.699096 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf375ba-eb1f-452e-835d-4ef57927bb05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:24.723552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf375ba-eb1f-452e-835d-4ef57927bb05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:24.727630 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf375ba-eb1f-452e-835d-4ef57927bb05 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:24.746863 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1129/2300] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:27:25.215776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccad49-cda6-42de-af12-9a446da0e0d3 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:25.220053 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d3ccad49-cda6-42de-af12-9a446da0e0d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:25.258932 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccad49-cda6-42de-af12-9a446da0e0d3 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:25.268567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb02d8-a783-43c0-b6a4-eb2329e861a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:25.285636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb02d8-a783-43c0-b6a4-eb2329e861a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:25.286658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb02d8-a783-43c0-b6a4-eb2329e861a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:25.287418 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb02d8-a783-43c0-b6a4-eb2329e861a6 admin admin] PATH_INFO: `/v3/projects/c7987271889146e49f32d9f4d7dae6e1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:25.290433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb02d8-a783-43c0-b6a4-eb2329e861a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7987271889146e49f32d9f4d7dae6e1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:25.294106 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb02d8-a783-43c0-b6a4-eb2329e861a6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:25.369512 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ffcb02d8-a783-43c0-b6a4-eb2329e861a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7987271889146e49f32d9f4d7dae6e1', 'request_id': 'req-ffcb02d8-a783-43c0-b6a4-eb2329e861a6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:25.380906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ffcb02d8-a783-43c0-b6a4-eb2329e861a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7987271889146e49f32d9f4d7dae6e1', 'request_id': 'req-ffcb02d8-a783-43c0-b6a4-eb2329e861a6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:25.383192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:25.394926 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ffcb02d8-a783-43c0-b6a4-eb2329e861a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7987271889146e49f32d9f4d7dae6e1', 'request_id': 'req-ffcb02d8-a783-43c0-b6a4-eb2329e861a6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:25.418712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ffcb02d8-a783-43c0-b6a4-eb2329e861a6 admin admin] The token cache is being invalidate because project c7987271889146e49f32d9f4d7dae6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:27:25.419258 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ffcb02d8-a783-43c0-b6a4-eb2329e861a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:25.420077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ffcb02d8-a783-43c0-b6a4-eb2329e861a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:25.422105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1172/2301] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:27:25 2022] DELETE /identity/v3/projects/c7987271889146e49f32d9f4d7dae6e1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:25.428588 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2484bb-ae88-4c8c-807a-996b8edd3fbf None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:25.428588 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2484bb-ae88-4c8c-807a-996b8edd3fbf None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:25.428588 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2484bb-ae88-4c8c-807a-996b8edd3fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:25.464938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-0e2484bb-ae88-4c8c-807a-996b8edd3fbf None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:25.466304 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0e2484bb-ae88-4c8c-807a-996b8edd3fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:25.570028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1130/2302] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:27:25.579422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ace1d-ec29-43a4-9c0f-d08f188f6ef1 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:25.579940 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ace1d-ec29-43a4-9c0f-d08f188f6ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:25.580373 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ace1d-ec29-43a4-9c0f-d08f188f6ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:25.635925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a94ace1d-ec29-43a4-9c0f-d08f188f6ef1 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:25.641901 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a94ace1d-ec29-43a4-9c0f-d08f188f6ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:25.666808 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1173/2303] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:25.676583 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2484bb-ae88-4c8c-807a-996b8edd3fbf None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:25.697333 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2484bb-ae88-4c8c-807a-996b8edd3fbf None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:25.706684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb420e-ebfc-462b-a963-cc420970dea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:25.707953 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb420e-ebfc-462b-a963-cc420970dea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:25.716508 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb420e-ebfc-462b-a963-cc420970dea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:25.717119 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb420e-ebfc-462b-a963-cc420970dea9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:25.718533 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb420e-ebfc-462b-a963-cc420970dea9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:27:25.719094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb420e-ebfc-462b-a963-cc420970dea9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:25.722798 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb420e-ebfc-462b-a963-cc420970dea9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:25.759431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1131/2304] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:27:25.765255 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ace1d-ec29-43a4-9c0f-d08f188f6ef1 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:25.780615 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ace1d-ec29-43a4-9c0f-d08f188f6ef1 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:25.795731 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e1d27-7c7c-4001-87b3-cfbd14bb6299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:25.797427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e1d27-7c7c-4001-87b3-cfbd14bb6299 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:25.797861 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e1d27-7c7c-4001-87b3-cfbd14bb6299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:25.798326 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e1d27-7c7c-4001-87b3-cfbd14bb6299 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:25.799433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e1d27-7c7c-4001-87b3-cfbd14bb6299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:25.803392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e1d27-7c7c-4001-87b3-cfbd14bb6299 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:25.871902 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1174/2305] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:27:25 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:27:25.876392 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb420e-ebfc-462b-a963-cc420970dea9 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:25.889514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb420e-ebfc-462b-a963-cc420970dea9 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:25.916019 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:25.998371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d981366-72e9-4a6b-941d-51d2b9ec46a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:25.999246 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d981366-72e9-4a6b-941d-51d2b9ec46a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:25.999604 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d981366-72e9-4a6b-941d-51d2b9ec46a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:25.999956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d981366-72e9-4a6b-941d-51d2b9ec46a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:26.000795 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d981366-72e9-4a6b-941d-51d2b9ec46a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:26.003881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d981366-72e9-4a6b-941d-51d2b9ec46a1 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:26.070139 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1132/2306] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:27:25 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:26.074563 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e1d27-7c7c-4001-87b3-cfbd14bb6299 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:26.089074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e1d27-7c7c-4001-87b3-cfbd14bb6299 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:26.094368 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff717e64-acf4-4db4-8c2c-b30a38c66a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:26.095181 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff717e64-acf4-4db4-8c2c-b30a38c66a15 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:26.095316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff717e64-acf4-4db4-8c2c-b30a38c66a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:26.095560 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff717e64-acf4-4db4-8c2c-b30a38c66a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:26.097161 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff717e64-acf4-4db4-8c2c-b30a38c66a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:26.098071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff717e64-acf4-4db4-8c2c-b30a38c66a15 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:26.118968 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1175/2307] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:26.122861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d981366-72e9-4a6b-941d-51d2b9ec46a1 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:26.141822 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d981366-72e9-4a6b-941d-51d2b9ec46a1 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:26.152245 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffdd79-1fae-4daa-b4c0-1a168dc946c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:26.153405 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffdd79-1fae-4daa-b4c0-1a168dc946c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:26.153808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffdd79-1fae-4daa-b4c0-1a168dc946c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:26.154244 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffdd79-1fae-4daa-b4c0-1a168dc946c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:26.155473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffdd79-1fae-4daa-b4c0-1a168dc946c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:26.157206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffdd79-1fae-4daa-b4c0-1a168dc946c8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:26.181522 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff717e64-acf4-4db4-8c2c-b30a38c66a15 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:26.188199 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1133/2308] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:26.195411 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff717e64-acf4-4db4-8c2c-b30a38c66a15 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:26.209926 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116fd70-b3ce-4d23-b4fd-c4bfa1268729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:26.210709 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116fd70-b3ce-4d23-b4fd-c4bfa1268729 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:26.212791 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116fd70-b3ce-4d23-b4fd-c4bfa1268729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:26.213371 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116fd70-b3ce-4d23-b4fd-c4bfa1268729 admin admin] PATH_INFO: `/v3/projects/2ffb6a7b337a4bf69b3ac826cd942e09/users/3352de1e3dc449c3872e4052a38a89fc/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:26.229951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4b285-c5a8-4740-94b6-ed7d0c7523aa None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:26.229951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4b285-c5a8-4740-94b6-ed7d0c7523aa None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:26.230292 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4b285-c5a8-4740-94b6-ed7d0c7523aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:26.258986 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116fd70-b3ce-4d23-b4fd-c4bfa1268729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ffb6a7b337a4bf69b3ac826cd942e09, user_id=3352de1e3dc449c3872e4052a38a89fc, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:26.262621 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116fd70-b3ce-4d23-b4fd-c4bfa1268729 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:26.292546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-0da4b285-c5a8-4740-94b6-ed7d0c7523aa None None] MFA Rules not processed for user `a1f98d6cc4c94b4d8e92481a5a08ac15`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:26.293657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1176/2309] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:27:26 2022] PUT /identity/v3/projects/2ffb6a7b337a4bf69b3ac826cd942e09/users/3352de1e3dc449c3872e4052a38a89fc/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:26.294019 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0da4b285-c5a8-4740-94b6-ed7d0c7523aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:26.306239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f9637-4885-4780-bbcf-96ad81cb5327 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:26.306800 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f9637-4885-4780-bbcf-96ad81cb5327 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:26.307334 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f9637-4885-4780-bbcf-96ad81cb5327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:26.379477 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-914f9637-4885-4780-bbcf-96ad81cb5327 None None] MFA Rules not processed for user `3352de1e3dc449c3872e4052a38a89fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:26.386157 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-914f9637-4885-4780-bbcf-96ad81cb5327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:26.444897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1134/2310] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:26.444897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4b285-c5a8-4740-94b6-ed7d0c7523aa None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:26.444897 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0da4b285-c5a8-4740-94b6-ed7d0c7523aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:26.552423 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4b285-c5a8-4740-94b6-ed7d0c7523aa None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:26.557925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199b9ca-6001-4c7b-9c06-a7235ee2d720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:26.559525 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199b9ca-6001-4c7b-9c06-a7235ee2d720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:26.559832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199b9ca-6001-4c7b-9c06-a7235ee2d720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:26.560117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199b9ca-6001-4c7b-9c06-a7235ee2d720 admin admin] PATH_INFO: `/v3/users/4995a70489a347bdb25de7c49e656ddc` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:26.561836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199b9ca-6001-4c7b-9c06-a7235ee2d720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4995a70489a347bdb25de7c49e656ddc)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:26.564702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199b9ca-6001-4c7b-9c06-a7235ee2d720 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:26.575640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1177/2311] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:27:26.578275 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f9637-4885-4780-bbcf-96ad81cb5327 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:26.580049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-914f9637-4885-4780-bbcf-96ad81cb5327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:26.634748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:26.669559 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5199b9ca-6001-4c7b-9c06-a7235ee2d720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4995a70489a347bdb25de7c49e656ddc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:26.671082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5199b9ca-6001-4c7b-9c06-a7235ee2d720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4995a70489a347bdb25de7c49e656ddc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:26.682662 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5199b9ca-6001-4c7b-9c06-a7235ee2d720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4995a70489a347bdb25de7c49e656ddc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:26.701076 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5199b9ca-6001-4c7b-9c06-a7235ee2d720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4995a70489a347bdb25de7c49e656ddc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:26.707425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f9637-4885-4780-bbcf-96ad81cb5327 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:26.712013 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5199b9ca-6001-4c7b-9c06-a7235ee2d720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4995a70489a347bdb25de7c49e656ddc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:26.713667 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee8e4d-6869-4509-ad3d-9a3678c0eeb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:26.714429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee8e4d-6869-4509-ad3d-9a3678c0eeb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:26.714824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee8e4d-6869-4509-ad3d-9a3678c0eeb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:26.715109 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee8e4d-6869-4509-ad3d-9a3678c0eeb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:26.717324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e8ee8e4d-6869-4509-ad3d-9a3678c0eeb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:26.725660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1135/2312] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:27:26 2022] DELETE /identity/v3/users/4995a70489a347bdb25de7c49e656ddc => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:26.726786 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199b9ca-6001-4c7b-9c06-a7235ee2d720 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:26.728820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5199b9ca-6001-4c7b-9c06-a7235ee2d720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:26.739356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee8e4d-6869-4509-ad3d-9a3678c0eeb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:26.742171 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee8e4d-6869-4509-ad3d-9a3678c0eeb7 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:26.753522 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1178/2313] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:27:26.757377 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590209b0-1df9-4807-9d03-73c0faf136ab None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:26.757757 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590209b0-1df9-4807-9d03-73c0faf136ab None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:26.760311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590209b0-1df9-4807-9d03-73c0faf136ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:26.823045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-590209b0-1df9-4807-9d03-73c0faf136ab None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:26.824455 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-590209b0-1df9-4807-9d03-73c0faf136ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:26.846924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:26.909512 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199b9ca-6001-4c7b-9c06-a7235ee2d720 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:26.930535 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d5f50-3f46-4ff1-80b3-377a936ecae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:26.932329 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d5f50-3f46-4ff1-80b3-377a936ecae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:26.933112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d5f50-3f46-4ff1-80b3-377a936ecae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:26.934334 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d5f50-3f46-4ff1-80b3-377a936ecae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:26.939007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d5f50-3f46-4ff1-80b3-377a936ecae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:26.944443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d5f50-3f46-4ff1-80b3-377a936ecae6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:27.001340 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1136/2314] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:27:26 2022] POST /identity/v3/projects => generated 375 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:27.003228 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d5f50-3f46-4ff1-80b3-377a936ecae6 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:27.004376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1179/2315] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:27.027138 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590209b0-1df9-4807-9d03-73c0faf136ab None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:27.029936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-590209b0-1df9-4807-9d03-73c0faf136ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:27.146878 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d5f50-3f46-4ff1-80b3-377a936ecae6 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:27.157941 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5d052-9ee8-4815-a465-cb9c61207b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:27.159189 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5d052-9ee8-4815-a465-cb9c61207b49 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:27.159808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5d052-9ee8-4815-a465-cb9c61207b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:27.160248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5d052-9ee8-4815-a465-cb9c61207b49 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:27.161569 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5d052-9ee8-4815-a465-cb9c61207b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:27.166234 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5d052-9ee8-4815-a465-cb9c61207b49 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:27.219432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590209b0-1df9-4807-9d03-73c0faf136ab None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:27.220006 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1137/2316] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:27:27 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:27.226321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5d052-9ee8-4815-a465-cb9c61207b49 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:27.274775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5d052-9ee8-4815-a465-cb9c61207b49 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:27.291561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f6e9f-367c-4d63-99d5-35106c3c1445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:27.295242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f6e9f-367c-4d63-99d5-35106c3c1445 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:27.296017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f6e9f-367c-4d63-99d5-35106c3c1445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:27.299288 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f6e9f-367c-4d63-99d5-35106c3c1445 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:27.301136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f6e9f-367c-4d63-99d5-35106c3c1445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:27.305028 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f6e9f-367c-4d63-99d5-35106c3c1445 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:27.309129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105ffde-251d-4cc9-b446-c0ed67d49fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:27.310709 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105ffde-251d-4cc9-b446-c0ed67d49fbf service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:27.311162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105ffde-251d-4cc9-b446-c0ed67d49fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:27.311647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105ffde-251d-4cc9-b446-c0ed67d49fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:27.351644 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105ffde-251d-4cc9-b446-c0ed67d49fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:27.357288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105ffde-251d-4cc9-b446-c0ed67d49fbf service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:27.368971 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1138/2317] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:27.375065 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f6e9f-367c-4d63-99d5-35106c3c1445 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:27.398352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1180/2318] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:27:27.408393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f6e9f-367c-4d63-99d5-35106c3c1445 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:27.429788 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098ec1b-d3b7-4f23-8482-2a64bae32c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:27.431086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098ec1b-d3b7-4f23-8482-2a64bae32c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:27.431623 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098ec1b-d3b7-4f23-8482-2a64bae32c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:27.432452 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098ec1b-d3b7-4f23-8482-2a64bae32c4b admin admin] PATH_INFO: `/v3/projects/cf4ba2fafbba4242aa82e5570951b14b/users/71f449c58d364a339db37e3ef537923d/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:27.460855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:27.483469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098ec1b-d3b7-4f23-8482-2a64bae32c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf4ba2fafbba4242aa82e5570951b14b, user_id=71f449c58d364a339db37e3ef537923d, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:27.494520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098ec1b-d3b7-4f23-8482-2a64bae32c4b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:27.547027 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1139/2319] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:27:27 2022] PUT /identity/v3/projects/cf4ba2fafbba4242aa82e5570951b14b/users/71f449c58d364a339db37e3ef537923d/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:27:27.553265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105ffde-251d-4cc9-b446-c0ed67d49fbf service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:27.593860 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105ffde-251d-4cc9-b446-c0ed67d49fbf service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:27.797996 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960042c-6221-445b-ab8e-68f5769644be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:27.798720 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960042c-6221-445b-ab8e-68f5769644be admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:27.799068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960042c-6221-445b-ab8e-68f5769644be admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:27.800493 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960042c-6221-445b-ab8e-68f5769644be admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:27.801436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960042c-6221-445b-ab8e-68f5769644be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:27.803521 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960042c-6221-445b-ab8e-68f5769644be admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:27.824419 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1181/2320] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:27.830237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098ec1b-d3b7-4f23-8482-2a64bae32c4b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:27.852965 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098ec1b-d3b7-4f23-8482-2a64bae32c4b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:27.889767 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d8e88-ae14-44dd-ab78-33509d3d8306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:27.894201 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d8e88-ae14-44dd-ab78-33509d3d8306 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:27.895523 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d8e88-ae14-44dd-ab78-33509d3d8306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:27.896338 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d8e88-ae14-44dd-ab78-33509d3d8306 admin admin] PATH_INFO: `/v3/projects/cf4ba2fafbba4242aa82e5570951b14b/users/71f449c58d364a339db37e3ef537923d/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:27.905850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d8e88-ae14-44dd-ab78-33509d3d8306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf4ba2fafbba4242aa82e5570951b14b, user_id=71f449c58d364a339db37e3ef537923d, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:27.925707 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d8e88-ae14-44dd-ab78-33509d3d8306 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:27.968565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1140/2321] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:27:27 2022] PUT /identity/v3/projects/cf4ba2fafbba4242aa82e5570951b14b/users/71f449c58d364a339db37e3ef537923d/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:27:27.972380 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f8fb7-13ba-46be-9360-f398e1b66a97 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:27.973254 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f8fb7-13ba-46be-9360-f398e1b66a97 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:27.973862 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f8fb7-13ba-46be-9360-f398e1b66a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:27.994674 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:28.017627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b08f8fb7-13ba-46be-9360-f398e1b66a97 None None] MFA Rules not processed for user `71f449c58d364a339db37e3ef537923d`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:28.020375 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b08f8fb7-13ba-46be-9360-f398e1b66a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:28.131848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d8e88-ae14-44dd-ab78-33509d3d8306 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:28.133938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8a8d8e88-ae14-44dd-ab78-33509d3d8306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:28.168652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1182/2322] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:28.189503 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f8fb7-13ba-46be-9360-f398e1b66a97 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:28.194927 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b08f8fb7-13ba-46be-9360-f398e1b66a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:28.310247 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d8e88-ae14-44dd-ab78-33509d3d8306 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:28.326530 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa66f5-3732-45d0-80d3-9d4593a3ea69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:28.327641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa66f5-3732-45d0-80d3-9d4593a3ea69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:28.328146 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa66f5-3732-45d0-80d3-9d4593a3ea69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:28.328680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa66f5-3732-45d0-80d3-9d4593a3ea69 admin admin] PATH_INFO: `/v3/projects/cc910f2ad850411ea3b51c2fdad71ee6` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:28.336287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa66f5-3732-45d0-80d3-9d4593a3ea69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc910f2ad850411ea3b51c2fdad71ee6)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:28.338366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f8fb7-13ba-46be-9360-f398e1b66a97 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:28.340122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa66f5-3732-45d0-80d3-9d4593a3ea69 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:28.344964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95bf15-97ac-4652-94e8-9dd1ea9ca5bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:28.346287 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95bf15-97ac-4652-94e8-9dd1ea9ca5bf service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:28.346694 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95bf15-97ac-4652-94e8-9dd1ea9ca5bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:28.347080 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95bf15-97ac-4652-94e8-9dd1ea9ca5bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:28.350222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-fa95bf15-97ac-4652-94e8-9dd1ea9ca5bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:28.451354 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e4aa66f5-3732-45d0-80d3-9d4593a3ea69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc910f2ad850411ea3b51c2fdad71ee6', 'request_id': 'req-e4aa66f5-3732-45d0-80d3-9d4593a3ea69'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:28.465216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e4aa66f5-3732-45d0-80d3-9d4593a3ea69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc910f2ad850411ea3b51c2fdad71ee6', 'request_id': 'req-e4aa66f5-3732-45d0-80d3-9d4593a3ea69'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:28.477694 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95bf15-97ac-4652-94e8-9dd1ea9ca5bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:28.478883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e4aa66f5-3732-45d0-80d3-9d4593a3ea69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc910f2ad850411ea3b51c2fdad71ee6', 'request_id': 'req-e4aa66f5-3732-45d0-80d3-9d4593a3ea69'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:28.479779 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95bf15-97ac-4652-94e8-9dd1ea9ca5bf service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:28.493117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1183/2323] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:27:28.499561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e4aa66f5-3732-45d0-80d3-9d4593a3ea69 admin admin] The token cache is being invalidate because project cc910f2ad850411ea3b51c2fdad71ee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:27:28.500027 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e4aa66f5-3732-45d0-80d3-9d4593a3ea69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:28.501530 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e4aa66f5-3732-45d0-80d3-9d4593a3ea69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:28.507898 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1141/2324] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:27:28 2022] DELETE /identity/v3/projects/cc910f2ad850411ea3b51c2fdad71ee6 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:28.509112 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95bf15-97ac-4652-94e8-9dd1ea9ca5bf service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:28.523786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95bf15-97ac-4652-94e8-9dd1ea9ca5bf service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:28.617330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:28.662321 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e32f7-32db-4fd3-ba1b-1fb1a5356e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:28.663486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e32f7-32db-4fd3-ba1b-1fb1a5356e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:28.663869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e32f7-32db-4fd3-ba1b-1fb1a5356e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:28.664256 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e32f7-32db-4fd3-ba1b-1fb1a5356e19 admin admin] PATH_INFO: `/v3/users/898883440f6a4e978f246f56148152f7` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:28.667380 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e32f7-32db-4fd3-ba1b-1fb1a5356e19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=898883440f6a4e978f246f56148152f7)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:28.669846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e32f7-32db-4fd3-ba1b-1fb1a5356e19 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:28.742285 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3c59c-7eb1-447b-9d88-b0f418868b60 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:28.742467 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3c59c-7eb1-447b-9d88-b0f418868b60 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:28.742785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3c59c-7eb1-447b-9d88-b0f418868b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:28.770236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-90f3c59c-7eb1-447b-9d88-b0f418868b60 None None] MFA Rules not processed for user `a1f98d6cc4c94b4d8e92481a5a08ac15`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:28.771893 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-90f3c59c-7eb1-447b-9d88-b0f418868b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:28.794432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9d4e32f7-32db-4fd3-ba1b-1fb1a5356e19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '898883440f6a4e978f246f56148152f7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:28.795497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9d4e32f7-32db-4fd3-ba1b-1fb1a5356e19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '898883440f6a4e978f246f56148152f7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:28.813462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9d4e32f7-32db-4fd3-ba1b-1fb1a5356e19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '898883440f6a4e978f246f56148152f7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:28.814812 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9d4e32f7-32db-4fd3-ba1b-1fb1a5356e19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '898883440f6a4e978f246f56148152f7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:28.856817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9d4e32f7-32db-4fd3-ba1b-1fb1a5356e19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '898883440f6a4e978f246f56148152f7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:28.886914 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1184/2325] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:27:28 2022] DELETE /identity/v3/users/898883440f6a4e978f246f56148152f7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:28.908242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1142/2326] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:27:29.781273 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e32f7-32db-4fd3-ba1b-1fb1a5356e19 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:29.783886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9d4e32f7-32db-4fd3-ba1b-1fb1a5356e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:29.979565 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e32f7-32db-4fd3-ba1b-1fb1a5356e19 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:29.984614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc0085-7482-47fa-94c9-a4f84c4bc3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:29.985294 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc0085-7482-47fa-94c9-a4f84c4bc3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:29.985575 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc0085-7482-47fa-94c9-a4f84c4bc3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:29.985858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc0085-7482-47fa-94c9-a4f84c4bc3af admin admin] PATH_INFO: `/v3/projects/c3d2700edc0f4e0a91b4af62f316ef1c` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:29.987919 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc0085-7482-47fa-94c9-a4f84c4bc3af admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d2700edc0f4e0a91b4af62f316ef1c)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:29.989936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc0085-7482-47fa-94c9-a4f84c4bc3af admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:30.058624 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-41cc0085-7482-47fa-94c9-a4f84c4bc3af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d2700edc0f4e0a91b4af62f316ef1c', 'request_id': 'req-41cc0085-7482-47fa-94c9-a4f84c4bc3af'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:30.071570 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-41cc0085-7482-47fa-94c9-a4f84c4bc3af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d2700edc0f4e0a91b4af62f316ef1c', 'request_id': 'req-41cc0085-7482-47fa-94c9-a4f84c4bc3af'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:30.084019 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-41cc0085-7482-47fa-94c9-a4f84c4bc3af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d2700edc0f4e0a91b4af62f316ef1c', 'request_id': 'req-41cc0085-7482-47fa-94c9-a4f84c4bc3af'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:30.089731 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:30.097914 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-41cc0085-7482-47fa-94c9-a4f84c4bc3af admin admin] The token cache is being invalidate because project c3d2700edc0f4e0a91b4af62f316ef1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:27:30.098689 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-41cc0085-7482-47fa-94c9-a4f84c4bc3af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:30.099904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-41cc0085-7482-47fa-94c9-a4f84c4bc3af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:30.101821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1185/2327] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:27:29 2022] DELETE /identity/v3/projects/c3d2700edc0f4e0a91b4af62f316ef1c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:30.106751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de4d83-9e4b-48b6-8576-4131c77d9242 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:30.107298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de4d83-9e4b-48b6-8576-4131c77d9242 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:30.107298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de4d83-9e4b-48b6-8576-4131c77d9242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:30.133552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-68de4d83-9e4b-48b6-8576-4131c77d9242 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:30.135837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-68de4d83-9e4b-48b6-8576-4131c77d9242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:30.141048 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:30.284524 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1143/2328] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:30.291419 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b4b27-e299-4fdd-bbfa-33223027701b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:30.292300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b4b27-e299-4fdd-bbfa-33223027701b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:30.294190 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b4b27-e299-4fdd-bbfa-33223027701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:30.354513 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-592b4b27-e299-4fdd-bbfa-33223027701b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:30.356079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-592b4b27-e299-4fdd-bbfa-33223027701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:30.370011 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1186/2329] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:30.378531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de4d83-9e4b-48b6-8576-4131c77d9242 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:30.397111 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de4d83-9e4b-48b6-8576-4131c77d9242 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:30.406702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a4f53-248f-4a24-8383-8db881c289fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:30.407674 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a4f53-248f-4a24-8383-8db881c289fe admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:30.408096 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a4f53-248f-4a24-8383-8db881c289fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:30.409128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a4f53-248f-4a24-8383-8db881c289fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:30.410489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a4f53-248f-4a24-8383-8db881c289fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:27:30.410967 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a4f53-248f-4a24-8383-8db881c289fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:30.414223 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a4f53-248f-4a24-8383-8db881c289fe admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:30.445680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1144/2330] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:27:30.446682 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b4b27-e299-4fdd-bbfa-33223027701b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:30.463151 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b4b27-e299-4fdd-bbfa-33223027701b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:30.469941 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566fc83-e291-48a6-90fa-12feb238b5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:30.470744 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566fc83-e291-48a6-90fa-12feb238b5de admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:30.471675 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566fc83-e291-48a6-90fa-12feb238b5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:30.472198 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566fc83-e291-48a6-90fa-12feb238b5de admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:30.473302 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566fc83-e291-48a6-90fa-12feb238b5de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:30.475732 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566fc83-e291-48a6-90fa-12feb238b5de admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:30.511260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1187/2331] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:27:30 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:30.518027 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a4f53-248f-4a24-8383-8db881c289fe admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:30.531321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a4f53-248f-4a24-8383-8db881c289fe admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:30.632153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd4b5d-fbc4-4220-8e9c-45f4c491c76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:30.633304 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd4b5d-fbc4-4220-8e9c-45f4c491c76f admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:30.633800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd4b5d-fbc4-4220-8e9c-45f4c491c76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:30.634314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd4b5d-fbc4-4220-8e9c-45f4c491c76f admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:30.635607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd4b5d-fbc4-4220-8e9c-45f4c491c76f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:30.639559 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd4b5d-fbc4-4220-8e9c-45f4c491c76f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:30.676698 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1145/2332] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:27:30 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:30.678696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566fc83-e291-48a6-90fa-12feb238b5de admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:30.693361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566fc83-e291-48a6-90fa-12feb238b5de admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:30.698800 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0c94e-689f-45db-9832-1f3cec08c2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:30.699513 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0c94e-689f-45db-9832-1f3cec08c2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:30.699833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0c94e-689f-45db-9832-1f3cec08c2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:30.700159 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0c94e-689f-45db-9832-1f3cec08c2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:30.700971 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0c94e-689f-45db-9832-1f3cec08c2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:30.702676 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0c94e-689f-45db-9832-1f3cec08c2c0 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:30.714627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1188/2333] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:30.719094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd4b5d-fbc4-4220-8e9c-45f4c491c76f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:30.729853 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd4b5d-fbc4-4220-8e9c-45f4c491c76f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:30.734934 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f95d8-2973-412d-95a6-8f0707c5183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:30.735575 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f95d8-2973-412d-95a6-8f0707c5183d admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:30.735875 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f95d8-2973-412d-95a6-8f0707c5183d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:30.736137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f95d8-2973-412d-95a6-8f0707c5183d admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:30.737426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f95d8-2973-412d-95a6-8f0707c5183d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:30.739054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f95d8-2973-412d-95a6-8f0707c5183d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:30.754414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1146/2334] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:30.758956 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0c94e-689f-45db-9832-1f3cec08c2c0 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:30.770549 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0c94e-689f-45db-9832-1f3cec08c2c0 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:30.775650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60264575-27a7-48fd-8650-cd7fc316ba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:30.776381 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60264575-27a7-48fd-8650-cd7fc316ba13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:30.776668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60264575-27a7-48fd-8650-cd7fc316ba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:30.776952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60264575-27a7-48fd-8650-cd7fc316ba13 admin admin] PATH_INFO: `/v3/projects/9e14bd95027949fb81bc74b167d628e1/users/8c34db29fc2d44e0a8c9c0b70a25815a/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:30.796508 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60264575-27a7-48fd-8650-cd7fc316ba13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e14bd95027949fb81bc74b167d628e1, user_id=8c34db29fc2d44e0a8c9c0b70a25815a, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:30.799299 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60264575-27a7-48fd-8650-cd7fc316ba13 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:30.815990 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1189/2335] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:27:30 2022] PUT /identity/v3/projects/9e14bd95027949fb81bc74b167d628e1/users/8c34db29fc2d44e0a8c9c0b70a25815a/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:30.827996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41157d5-f2ab-4cde-9327-562eda876afe None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:30.828363 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41157d5-f2ab-4cde-9327-562eda876afe None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:30.828612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41157d5-f2ab-4cde-9327-562eda876afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:30.863189 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a41157d5-f2ab-4cde-9327-562eda876afe None None] MFA Rules not processed for user `8c34db29fc2d44e0a8c9c0b70a25815a`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:30.864522 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a41157d5-f2ab-4cde-9327-562eda876afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:30.942571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1147/2336] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:30.954628 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60264575-27a7-48fd-8650-cd7fc316ba13 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:30.957688 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-60264575-27a7-48fd-8650-cd7fc316ba13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:31.061550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60264575-27a7-48fd-8650-cd7fc316ba13 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:31.069244 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5115a-ec33-4354-a972-6cfcb34ae957 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:31.070540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5115a-ec33-4354-a972-6cfcb34ae957 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:31.071444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5115a-ec33-4354-a972-6cfcb34ae957 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:31.071653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5115a-ec33-4354-a972-6cfcb34ae957 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:31.087786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5115a-ec33-4354-a972-6cfcb34ae957 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:31.090752 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5115a-ec33-4354-a972-6cfcb34ae957 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:31.108269 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1190/2337] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:27:32.753979 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41157d5-f2ab-4cde-9327-562eda876afe None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:32.756772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a41157d5-f2ab-4cde-9327-562eda876afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:32.770387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:32.881907 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41157d5-f2ab-4cde-9327-562eda876afe None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:32.889636 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10421b-feb6-43a9-8836-cf88036ab6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:32.890484 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10421b-feb6-43a9-8836-cf88036ab6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:32.890989 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10421b-feb6-43a9-8836-cf88036ab6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:32.891359 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10421b-feb6-43a9-8836-cf88036ab6d7 admin admin] PATH_INFO: `/v3/users/3352de1e3dc449c3872e4052a38a89fc` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:32.894667 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10421b-feb6-43a9-8836-cf88036ab6d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3352de1e3dc449c3872e4052a38a89fc)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:32.898104 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10421b-feb6-43a9-8836-cf88036ab6d7 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:33.003144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3c10421b-feb6-43a9-8836-cf88036ab6d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3352de1e3dc449c3872e4052a38a89fc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:33.004606 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3c10421b-feb6-43a9-8836-cf88036ab6d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3352de1e3dc449c3872e4052a38a89fc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:33.026732 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3c10421b-feb6-43a9-8836-cf88036ab6d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3352de1e3dc449c3872e4052a38a89fc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:33.062384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3c10421b-feb6-43a9-8836-cf88036ab6d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3352de1e3dc449c3872e4052a38a89fc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:33.087710 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3c10421b-feb6-43a9-8836-cf88036ab6d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3352de1e3dc449c3872e4052a38a89fc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:33.103533 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1148/2338] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:27:32 2022] DELETE /identity/v3/users/3352de1e3dc449c3872e4052a38a89fc => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:33.109635 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926d2d2-c35e-432c-806e-43fa39eff356 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:33.110316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926d2d2-c35e-432c-806e-43fa39eff356 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:33.111188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926d2d2-c35e-432c-806e-43fa39eff356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:33.149721 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8926d2d2-c35e-432c-806e-43fa39eff356 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:33.151932 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8926d2d2-c35e-432c-806e-43fa39eff356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:33.232408 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1191/2339] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:33.243134 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10421b-feb6-43a9-8836-cf88036ab6d7 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:33.244754 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3c10421b-feb6-43a9-8836-cf88036ab6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:33.321302 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10421b-feb6-43a9-8836-cf88036ab6d7 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:33.325747 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445ecb6-cefe-4c5c-b0a6-6ecc49007acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:33.326615 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445ecb6-cefe-4c5c-b0a6-6ecc49007acf service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:33.326730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445ecb6-cefe-4c5c-b0a6-6ecc49007acf service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:33.327012 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445ecb6-cefe-4c5c-b0a6-6ecc49007acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:33.338390 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445ecb6-cefe-4c5c-b0a6-6ecc49007acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:33.339918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445ecb6-cefe-4c5c-b0a6-6ecc49007acf service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:33.351667 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1149/2340] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:27:33.875600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926d2d2-c35e-432c-806e-43fa39eff356 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:33.884474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8926d2d2-c35e-432c-806e-43fa39eff356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:33.952486 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926d2d2-c35e-432c-806e-43fa39eff356 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:33.973075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e93973-964b-4d25-942c-152a5cbba824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:33.973846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e93973-964b-4d25-942c-152a5cbba824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:33.974218 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e93973-964b-4d25-942c-152a5cbba824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:33.976708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e93973-964b-4d25-942c-152a5cbba824 admin admin] PATH_INFO: `/v3/projects/2ffb6a7b337a4bf69b3ac826cd942e09` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:33.983082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e93973-964b-4d25-942c-152a5cbba824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ffb6a7b337a4bf69b3ac826cd942e09)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:33.989996 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e93973-964b-4d25-942c-152a5cbba824 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:34.097037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:34.123349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-22e93973-964b-4d25-942c-152a5cbba824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ffb6a7b337a4bf69b3ac826cd942e09', 'request_id': 'req-22e93973-964b-4d25-942c-152a5cbba824'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:34.138093 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-22e93973-964b-4d25-942c-152a5cbba824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ffb6a7b337a4bf69b3ac826cd942e09', 'request_id': 'req-22e93973-964b-4d25-942c-152a5cbba824'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:34.156152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-22e93973-964b-4d25-942c-152a5cbba824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ffb6a7b337a4bf69b3ac826cd942e09', 'request_id': 'req-22e93973-964b-4d25-942c-152a5cbba824'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:34.177579 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-22e93973-964b-4d25-942c-152a5cbba824 admin admin] The token cache is being invalidate because project 2ffb6a7b337a4bf69b3ac826cd942e09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:27:34.177994 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-22e93973-964b-4d25-942c-152a5cbba824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:34.178974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-22e93973-964b-4d25-942c-152a5cbba824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:34.182788 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1192/2341] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:27:33 2022] DELETE /identity/v3/projects/2ffb6a7b337a4bf69b3ac826cd942e09 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:34.188350 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445ecb6-cefe-4c5c-b0a6-6ecc49007acf service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:34.206478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445ecb6-cefe-4c5c-b0a6-6ecc49007acf service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:34.255906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:34.312813 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d3758-2768-4d9e-88f2-a347dda3f2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:34.313850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d3758-2768-4d9e-88f2-a347dda3f2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:34.314366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d3758-2768-4d9e-88f2-a347dda3f2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:34.315455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d3758-2768-4d9e-88f2-a347dda3f2bf admin admin] PATH_INFO: `/v3/users/71f449c58d364a339db37e3ef537923d` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:34.317495 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d3758-2768-4d9e-88f2-a347dda3f2bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f449c58d364a339db37e3ef537923d)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:34.319711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d3758-2768-4d9e-88f2-a347dda3f2bf admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:34.396228 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9b5d3758-2768-4d9e-88f2-a347dda3f2bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f449c58d364a339db37e3ef537923d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:34.401021 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9b5d3758-2768-4d9e-88f2-a347dda3f2bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f449c58d364a339db37e3ef537923d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:34.411385 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9b5d3758-2768-4d9e-88f2-a347dda3f2bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f449c58d364a339db37e3ef537923d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:34.427633 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9b5d3758-2768-4d9e-88f2-a347dda3f2bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f449c58d364a339db37e3ef537923d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:34.437196 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9b5d3758-2768-4d9e-88f2-a347dda3f2bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f449c58d364a339db37e3ef537923d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:34.445562 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1150/2342] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:27:34 2022] DELETE /identity/v3/users/71f449c58d364a339db37e3ef537923d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:34.956513 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e93973-964b-4d25-942c-152a5cbba824 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:34.958979 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-22e93973-964b-4d25-942c-152a5cbba824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:34.975863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e93973-964b-4d25-942c-152a5cbba824 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:35.059695 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a11481-176a-4fc7-8e42-e2f0351bc670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:35.060404 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a11481-176a-4fc7-8e42-e2f0351bc670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:35.060692 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a11481-176a-4fc7-8e42-e2f0351bc670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:35.060973 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a11481-176a-4fc7-8e42-e2f0351bc670 admin admin] PATH_INFO: `/v3/projects/cf4ba2fafbba4242aa82e5570951b14b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:35.062253 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a11481-176a-4fc7-8e42-e2f0351bc670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf4ba2fafbba4242aa82e5570951b14b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:35.065587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a11481-176a-4fc7-8e42-e2f0351bc670 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:35.106577 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d3758-2768-4d9e-88f2-a347dda3f2bf admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:35.109123 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9b5d3758-2768-4d9e-88f2-a347dda3f2bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:35.138497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d3758-2768-4d9e-88f2-a347dda3f2bf admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:35.159116 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-81a11481-176a-4fc7-8e42-e2f0351bc670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf4ba2fafbba4242aa82e5570951b14b', 'request_id': 'req-81a11481-176a-4fc7-8e42-e2f0351bc670'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:35.171328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-81a11481-176a-4fc7-8e42-e2f0351bc670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf4ba2fafbba4242aa82e5570951b14b', 'request_id': 'req-81a11481-176a-4fc7-8e42-e2f0351bc670'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:35.184453 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-81a11481-176a-4fc7-8e42-e2f0351bc670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf4ba2fafbba4242aa82e5570951b14b', 'request_id': 'req-81a11481-176a-4fc7-8e42-e2f0351bc670'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:35.200987 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-81a11481-176a-4fc7-8e42-e2f0351bc670 admin admin] The token cache is being invalidate because project cf4ba2fafbba4242aa82e5570951b14b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:27:35.201545 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-81a11481-176a-4fc7-8e42-e2f0351bc670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:35.202233 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-81a11481-176a-4fc7-8e42-e2f0351bc670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:35.204418 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1193/2343] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:27:34 2022] DELETE /identity/v3/projects/cf4ba2fafbba4242aa82e5570951b14b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:35.209875 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c1cd3-923e-43f5-8cbf-500dad128a16 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:35.210161 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c1cd3-923e-43f5-8cbf-500dad128a16 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:35.210442 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c1cd3-923e-43f5-8cbf-500dad128a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:35.215913 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97086a-b1fa-4ef4-980f-a047a5d627cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:35.216772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97086a-b1fa-4ef4-980f-a047a5d627cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:35.216932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97086a-b1fa-4ef4-980f-a047a5d627cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:35.217112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97086a-b1fa-4ef4-980f-a047a5d627cc admin admin] PATH_INFO: `/v3/users/8e400a4b26bd4394aac6573f02165bd0` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:35.218353 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97086a-b1fa-4ef4-980f-a047a5d627cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e400a4b26bd4394aac6573f02165bd0)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:35.220506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97086a-b1fa-4ef4-980f-a047a5d627cc admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:35.239688 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-079c1cd3-923e-43f5-8cbf-500dad128a16 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:35.240907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-079c1cd3-923e-43f5-8cbf-500dad128a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:35.255418 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1194/2344] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:35.270469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284857f4-5d84-4adc-bbd8-8f0d05ee8639 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:35.271128 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284857f4-5d84-4adc-bbd8-8f0d05ee8639 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:35.271609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284857f4-5d84-4adc-bbd8-8f0d05ee8639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:35.302226 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd97086a-b1fa-4ef4-980f-a047a5d627cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e400a4b26bd4394aac6573f02165bd0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:35.303655 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd97086a-b1fa-4ef4-980f-a047a5d627cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e400a4b26bd4394aac6573f02165bd0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:35.304151 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-284857f4-5d84-4adc-bbd8-8f0d05ee8639 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:35.305598 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-284857f4-5d84-4adc-bbd8-8f0d05ee8639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:35.306116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:35.320456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1195/2345] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:35.323251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd97086a-b1fa-4ef4-980f-a047a5d627cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e400a4b26bd4394aac6573f02165bd0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:35.326015 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284857f4-5d84-4adc-bbd8-8f0d05ee8639 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:35.340835 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284857f4-5d84-4adc-bbd8-8f0d05ee8639 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:35.348483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd97086a-b1fa-4ef4-980f-a047a5d627cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e400a4b26bd4394aac6573f02165bd0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:35.349043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c847c5-cea8-40fb-ac14-bee5b7c2efb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:35.349936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c847c5-cea8-40fb-ac14-bee5b7c2efb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:35.350349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c847c5-cea8-40fb-ac14-bee5b7c2efb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:35.350684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c847c5-cea8-40fb-ac14-bee5b7c2efb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:35.352225 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c847c5-cea8-40fb-ac14-bee5b7c2efb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:27:35.352225 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c847c5-cea8-40fb-ac14-bee5b7c2efb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:35.354858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c847c5-cea8-40fb-ac14-bee5b7c2efb7 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:35.364047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd97086a-b1fa-4ef4-980f-a047a5d627cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e400a4b26bd4394aac6573f02165bd0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:35.373992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1151/2346] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:27:35 2022] DELETE /identity/v3/users/8e400a4b26bd4394aac6573f02165bd0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:35.374822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1196/2347] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:27:35.381655 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0af9a6-caca-41a6-8247-31f02acbf6f1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:35.381924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c847c5-cea8-40fb-ac14-bee5b7c2efb7 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:35.382313 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0af9a6-caca-41a6-8247-31f02acbf6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:35.382600 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0af9a6-caca-41a6-8247-31f02acbf6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:35.400375 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c847c5-cea8-40fb-ac14-bee5b7c2efb7 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:35.409153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-eb0af9a6-caca-41a6-8247-31f02acbf6f1 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:35.410515 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-eb0af9a6-caca-41a6-8247-31f02acbf6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:35.449965 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:35.511111 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1152/2348] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:27:35.521427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb07b6-da51-4a11-91c6-831ed6eeae5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:35.522472 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb07b6-da51-4a11-91c6-831ed6eeae5b admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:35.522950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb07b6-da51-4a11-91c6-831ed6eeae5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:35.523507 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb07b6-da51-4a11-91c6-831ed6eeae5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:35.524000 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0af9a6-caca-41a6-8247-31f02acbf6f1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:35.524713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb07b6-da51-4a11-91c6-831ed6eeae5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:35.526553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-eb0af9a6-caca-41a6-8247-31f02acbf6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:35.527415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb07b6-da51-4a11-91c6-831ed6eeae5b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:35.580964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1197/2349] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:27:35 2022] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:35.589171 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb07b6-da51-4a11-91c6-831ed6eeae5b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:35.639326 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0af9a6-caca-41a6-8247-31f02acbf6f1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:35.715005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb07b6-da51-4a11-91c6-831ed6eeae5b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:35.722842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e1f4d-f9dc-4479-99ca-10a0a814d884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:35.723546 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e1f4d-f9dc-4479-99ca-10a0a814d884 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:35.723832 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e1f4d-f9dc-4479-99ca-10a0a814d884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:35.724111 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e1f4d-f9dc-4479-99ca-10a0a814d884 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:35.724838 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e1f4d-f9dc-4479-99ca-10a0a814d884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:35.725371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69d376-1766-43b6-b78d-1f2fcc1ae814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:35.726451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d376-1766-43b6-b78d-1f2fcc1ae814 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:35.726824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e1f4d-f9dc-4479-99ca-10a0a814d884 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:35.727746 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d376-1766-43b6-b78d-1f2fcc1ae814 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:35.728455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69d376-1766-43b6-b78d-1f2fcc1ae814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:35.743316 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69d376-1766-43b6-b78d-1f2fcc1ae814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:35.745752 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69d376-1766-43b6-b78d-1f2fcc1ae814 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:35.756027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1198/2350] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:27:35 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:27:35.759502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e1f4d-f9dc-4479-99ca-10a0a814d884 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:35.761918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1153/2351] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:27:35.778587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e1f4d-f9dc-4479-99ca-10a0a814d884 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:35.790818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608475ad-b6a3-47dc-b823-7ac5535ac0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:35.792279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608475ad-b6a3-47dc-b823-7ac5535ac0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:35.792820 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608475ad-b6a3-47dc-b823-7ac5535ac0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:35.793390 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608475ad-b6a3-47dc-b823-7ac5535ac0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:35.795878 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608475ad-b6a3-47dc-b823-7ac5535ac0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:35.799452 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608475ad-b6a3-47dc-b823-7ac5535ac0a2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:35.823352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1199/2352] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:27:35.828812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69d376-1766-43b6-b78d-1f2fcc1ae814 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:35.843223 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69d376-1766-43b6-b78d-1f2fcc1ae814 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:35.852823 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcdaa6-ea1b-405f-b4a9-cd8fbb031cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:35.865971 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcdaa6-ea1b-405f-b4a9-cd8fbb031cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:35.869962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcdaa6-ea1b-405f-b4a9-cd8fbb031cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:35.870708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcdaa6-ea1b-405f-b4a9-cd8fbb031cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:35.874002 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcdaa6-ea1b-405f-b4a9-cd8fbb031cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:35.878754 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcdaa6-ea1b-405f-b4a9-cd8fbb031cd8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:35.921517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608475ad-b6a3-47dc-b823-7ac5535ac0a2 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:35.932432 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1154/2353] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:35.965269 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608475ad-b6a3-47dc-b823-7ac5535ac0a2 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:35.979964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d6459-db1c-47fe-b071-9e99f7b0015b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:35.980798 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d6459-db1c-47fe-b071-9e99f7b0015b admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:35.981268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d6459-db1c-47fe-b071-9e99f7b0015b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:35.981566 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d6459-db1c-47fe-b071-9e99f7b0015b admin admin] PATH_INFO: `/v3/projects/32b0ec4d77324788be8ad43a08bc4a28/users/e3035b3de5f34f14bf18ba8d1b04f9af/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:36.020764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d6459-db1c-47fe-b071-9e99f7b0015b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b0ec4d77324788be8ad43a08bc4a28, user_id=e3035b3de5f34f14bf18ba8d1b04f9af, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:36.026194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d6459-db1c-47fe-b071-9e99f7b0015b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:36.070135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1200/2354] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:27:35 2022] PUT /identity/v3/projects/32b0ec4d77324788be8ad43a08bc4a28/users/e3035b3de5f34f14bf18ba8d1b04f9af/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:27:36.091567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08ea70-e15a-45b9-8201-deb3568673ee None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:36.092133 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08ea70-e15a-45b9-8201-deb3568673ee None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:36.092735 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08ea70-e15a-45b9-8201-deb3568673ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:36.151400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:36.177097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-5b08ea70-e15a-45b9-8201-deb3568673ee None None] MFA Rules not processed for user `e3035b3de5f34f14bf18ba8d1b04f9af`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:36.179538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5b08ea70-e15a-45b9-8201-deb3568673ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:36.352117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1155/2355] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:36.368055 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d6459-db1c-47fe-b071-9e99f7b0015b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:36.377002 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-177d6459-db1c-47fe-b071-9e99f7b0015b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:36.549454 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08ea70-e15a-45b9-8201-deb3568673ee None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:36.550908 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5b08ea70-e15a-45b9-8201-deb3568673ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:36.626978 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d6459-db1c-47fe-b071-9e99f7b0015b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:36.645901 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08ea70-e15a-45b9-8201-deb3568673ee None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:36.651650 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b606789-bbf3-4827-8d88-b4cc227c48b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:36.652404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b606789-bbf3-4827-8d88-b4cc227c48b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:36.652700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b606789-bbf3-4827-8d88-b4cc227c48b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:36.652982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b606789-bbf3-4827-8d88-b4cc227c48b5 admin admin] PATH_INFO: `/v3/projects/21dee20f14684dfdb6b65ae385d3e494` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:36.654246 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b606789-bbf3-4827-8d88-b4cc227c48b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21dee20f14684dfdb6b65ae385d3e494)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:36.656436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b606789-bbf3-4827-8d88-b4cc227c48b5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:36.661990 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a6779-4ed8-4d6e-82ae-04083ad47307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:36.666458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a6779-4ed8-4d6e-82ae-04083ad47307 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:36.670272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a6779-4ed8-4d6e-82ae-04083ad47307 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:36.672902 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a6779-4ed8-4d6e-82ae-04083ad47307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:36.729339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a6779-4ed8-4d6e-82ae-04083ad47307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:36.739899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a6779-4ed8-4d6e-82ae-04083ad47307 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:36.751136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3b606789-bbf3-4827-8d88-b4cc227c48b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21dee20f14684dfdb6b65ae385d3e494', 'request_id': 'req-3b606789-bbf3-4827-8d88-b4cc227c48b5'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:36.759836 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1201/2356] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:27:36.763038 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3b606789-bbf3-4827-8d88-b4cc227c48b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21dee20f14684dfdb6b65ae385d3e494', 'request_id': 'req-3b606789-bbf3-4827-8d88-b4cc227c48b5'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:36.782297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3b606789-bbf3-4827-8d88-b4cc227c48b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21dee20f14684dfdb6b65ae385d3e494', 'request_id': 'req-3b606789-bbf3-4827-8d88-b4cc227c48b5'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:36.825703 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3b606789-bbf3-4827-8d88-b4cc227c48b5 admin admin] The token cache is being invalidate because project 21dee20f14684dfdb6b65ae385d3e494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:27:36.825703 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3b606789-bbf3-4827-8d88-b4cc227c48b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:36.825703 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3b606789-bbf3-4827-8d88-b4cc227c48b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:36.825703 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1156/2357] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:27:36 2022] DELETE /identity/v3/projects/21dee20f14684dfdb6b65ae385d3e494 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:36.833000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccd703-a19e-48ad-861c-e5a04866d3c8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:36.833617 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccd703-a19e-48ad-861c-e5a04866d3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:36.834185 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccd703-a19e-48ad-861c-e5a04866d3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:36.864461 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:36.899890 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-0fccd703-a19e-48ad-861c-e5a04866d3c8 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:36.904578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0fccd703-a19e-48ad-861c-e5a04866d3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:37.092311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1202/2358] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:37.101100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35416c-3f41-4750-9906-30a1547231f0 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:37.101712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35416c-3f41-4750-9906-30a1547231f0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:37.102207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35416c-3f41-4750-9906-30a1547231f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:37.156125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-bd35416c-3f41-4750-9906-30a1547231f0 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:37.158013 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-bd35416c-3f41-4750-9906-30a1547231f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:37.178125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1157/2359] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:37.182906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccd703-a19e-48ad-861c-e5a04866d3c8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:37.216864 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccd703-a19e-48ad-861c-e5a04866d3c8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:37.237423 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bc195-1d1b-4285-bf04-10e555908de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:37.239076 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bc195-1d1b-4285-bf04-10e555908de4 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:37.239948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bc195-1d1b-4285-bf04-10e555908de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:37.240600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bc195-1d1b-4285-bf04-10e555908de4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:37.241863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bc195-1d1b-4285-bf04-10e555908de4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:27:37.242492 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bc195-1d1b-4285-bf04-10e555908de4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:37.245626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bc195-1d1b-4285-bf04-10e555908de4 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:37.304464 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1203/2360] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:27:37.312603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35416c-3f41-4750-9906-30a1547231f0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:37.345594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35416c-3f41-4750-9906-30a1547231f0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:37.355552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350f497-385a-441d-abcb-0b36e16a7f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:37.356835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350f497-385a-441d-abcb-0b36e16a7f3c admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:37.358414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350f497-385a-441d-abcb-0b36e16a7f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:37.359184 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350f497-385a-441d-abcb-0b36e16a7f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:37.360792 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350f497-385a-441d-abcb-0b36e16a7f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:37.365348 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350f497-385a-441d-abcb-0b36e16a7f3c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:37.438668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1158/2361] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:27:37 2022] POST /identity/v3/projects => generated 399 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:37.446136 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bc195-1d1b-4285-bf04-10e555908de4 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:37.478400 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bc195-1d1b-4285-bf04-10e555908de4 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:37.610027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037503e-1406-4c79-91fc-370eeedaf127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:37.611172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037503e-1406-4c79-91fc-370eeedaf127 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:37.612012 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037503e-1406-4c79-91fc-370eeedaf127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:37.613258 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037503e-1406-4c79-91fc-370eeedaf127 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:37.614826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037503e-1406-4c79-91fc-370eeedaf127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:37.623722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037503e-1406-4c79-91fc-370eeedaf127 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:37.688296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1204/2362] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:27:37 2022] POST /identity/v3/users => generated 300 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:27:37.691936 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350f497-385a-441d-abcb-0b36e16a7f3c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:37.718290 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:37.739103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350f497-385a-441d-abcb-0b36e16a7f3c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:37.748125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bf1c3-7c2d-4f77-b290-2a2aca3298bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:37.749283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bf1c3-7c2d-4f77-b290-2a2aca3298bf admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:37.749831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bf1c3-7c2d-4f77-b290-2a2aca3298bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:37.750350 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bf1c3-7c2d-4f77-b290-2a2aca3298bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:37.751783 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8bf1c3-7c2d-4f77-b290-2a2aca3298bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:37.755848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8bf1c3-7c2d-4f77-b290-2a2aca3298bf admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:37.780283 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1159/2363] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:37.783055 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037503e-1406-4c79-91fc-370eeedaf127 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:37.796349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037503e-1406-4c79-91fc-370eeedaf127 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:37.803344 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad8873-bbf0-4180-83a8-b68ffc626afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:37.804223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad8873-bbf0-4180-83a8-b68ffc626afe admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:37.804757 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad8873-bbf0-4180-83a8-b68ffc626afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:37.805037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad8873-bbf0-4180-83a8-b68ffc626afe admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:37.805979 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad8873-bbf0-4180-83a8-b68ffc626afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:37.807765 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad8873-bbf0-4180-83a8-b68ffc626afe admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:37.820705 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1205/2364] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:27:37.825696 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bf1c3-7c2d-4f77-b290-2a2aca3298bf admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:37.837965 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bf1c3-7c2d-4f77-b290-2a2aca3298bf admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:37.843811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fe1b6-f6a9-49b5-b18d-03ce3b512406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:37.844716 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fe1b6-f6a9-49b5-b18d-03ce3b512406 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:37.844882 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fe1b6-f6a9-49b5-b18d-03ce3b512406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:37.845113 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fe1b6-f6a9-49b5-b18d-03ce3b512406 admin admin] PATH_INFO: `/v3/projects/108e2d0a18594acaba334a885ad09d58/users/de71fa36c3d94630a3569d60e02553ae/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:37.869603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fe1b6-f6a9-49b5-b18d-03ce3b512406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=108e2d0a18594acaba334a885ad09d58, user_id=de71fa36c3d94630a3569d60e02553ae, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:37.875447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fe1b6-f6a9-49b5-b18d-03ce3b512406 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:37.900605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1160/2365] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:27:37 2022] PUT /identity/v3/projects/108e2d0a18594acaba334a885ad09d58/users/de71fa36c3d94630a3569d60e02553ae/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:27:37.921031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6add11-7dec-407f-b7d8-d0e86154816a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:37.921552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6add11-7dec-407f-b7d8-d0e86154816a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:37.922039 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6add11-7dec-407f-b7d8-d0e86154816a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:37.957906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6f6add11-7dec-407f-b7d8-d0e86154816a None None] MFA Rules not processed for user `de71fa36c3d94630a3569d60e02553ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:37.959439 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6f6add11-7dec-407f-b7d8-d0e86154816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:38.063145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:38.069367 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1206/2366] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:38.087625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fe1b6-f6a9-49b5-b18d-03ce3b512406 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:38.090073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-739fe1b6-f6a9-49b5-b18d-03ce3b512406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:38.178724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fe1b6-f6a9-49b5-b18d-03ce3b512406 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:38.182538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e8230-38be-47ef-a45a-29d38a8dff50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:38.183174 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e8230-38be-47ef-a45a-29d38a8dff50 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:38.183470 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e8230-38be-47ef-a45a-29d38a8dff50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:38.183751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e8230-38be-47ef-a45a-29d38a8dff50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:38.193508 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e8230-38be-47ef-a45a-29d38a8dff50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:38.194979 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e8230-38be-47ef-a45a-29d38a8dff50 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:38.206932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1161/2367] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:38 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:27:40.131813 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6add11-7dec-407f-b7d8-d0e86154816a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:40.134217 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6f6add11-7dec-407f-b7d8-d0e86154816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:40.251350 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6add11-7dec-407f-b7d8-d0e86154816a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:40.257793 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2d6d5-e2f6-4397-a9ae-07f82c57e652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:40.258492 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2d6d5-e2f6-4397-a9ae-07f82c57e652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:40.259261 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2d6d5-e2f6-4397-a9ae-07f82c57e652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:40.259261 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2d6d5-e2f6-4397-a9ae-07f82c57e652 admin admin] PATH_INFO: `/v3/users/8c34db29fc2d44e0a8c9c0b70a25815a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:40.260587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2d6d5-e2f6-4397-a9ae-07f82c57e652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c34db29fc2d44e0a8c9c0b70a25815a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:40.262898 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2d6d5-e2f6-4397-a9ae-07f82c57e652 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:40.352577 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1ba2d6d5-e2f6-4397-a9ae-07f82c57e652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c34db29fc2d44e0a8c9c0b70a25815a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:40.353425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1ba2d6d5-e2f6-4397-a9ae-07f82c57e652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c34db29fc2d44e0a8c9c0b70a25815a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:40.373137 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1ba2d6d5-e2f6-4397-a9ae-07f82c57e652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c34db29fc2d44e0a8c9c0b70a25815a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:40.375751 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1ba2d6d5-e2f6-4397-a9ae-07f82c57e652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c34db29fc2d44e0a8c9c0b70a25815a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:40.399641 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1ba2d6d5-e2f6-4397-a9ae-07f82c57e652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c34db29fc2d44e0a8c9c0b70a25815a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:40.418192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1207/2368] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:27:40 2022] DELETE /identity/v3/users/8c34db29fc2d44e0a8c9c0b70a25815a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:40.422566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91524981-8ad6-4f38-8b45-e478f2db5081 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:40.423344 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91524981-8ad6-4f38-8b45-e478f2db5081 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:40.423344 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91524981-8ad6-4f38-8b45-e478f2db5081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:40.455954 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-91524981-8ad6-4f38-8b45-e478f2db5081 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:40.458188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-91524981-8ad6-4f38-8b45-e478f2db5081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:40.575960 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1162/2369] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:40.597167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2d6d5-e2f6-4397-a9ae-07f82c57e652 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:40.599476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1ba2d6d5-e2f6-4397-a9ae-07f82c57e652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:40.681744 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2d6d5-e2f6-4397-a9ae-07f82c57e652 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:40.686510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df90fc-26ee-4849-903e-7783a91894c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:40.687771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df90fc-26ee-4849-903e-7783a91894c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:40.688093 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df90fc-26ee-4849-903e-7783a91894c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:40.688446 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df90fc-26ee-4849-903e-7783a91894c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:40.700618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df90fc-26ee-4849-903e-7783a91894c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:40.702096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df90fc-26ee-4849-903e-7783a91894c6 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:40.714236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1208/2370] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:27:40.789686 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91524981-8ad6-4f38-8b45-e478f2db5081 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:40.791637 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-91524981-8ad6-4f38-8b45-e478f2db5081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:40.809168 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91524981-8ad6-4f38-8b45-e478f2db5081 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:40.815660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d689700-7e7d-4708-bc8e-dcd20cbffcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:40.816429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d689700-7e7d-4708-bc8e-dcd20cbffcff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:40.816713 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d689700-7e7d-4708-bc8e-dcd20cbffcff admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:40.816997 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d689700-7e7d-4708-bc8e-dcd20cbffcff admin admin] PATH_INFO: `/v3/users/e3035b3de5f34f14bf18ba8d1b04f9af` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:40.818490 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d689700-7e7d-4708-bc8e-dcd20cbffcff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3035b3de5f34f14bf18ba8d1b04f9af)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:40.820526 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d689700-7e7d-4708-bc8e-dcd20cbffcff admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:40.880907 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4d689700-7e7d-4708-bc8e-dcd20cbffcff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3035b3de5f34f14bf18ba8d1b04f9af'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:40.881857 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4d689700-7e7d-4708-bc8e-dcd20cbffcff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3035b3de5f34f14bf18ba8d1b04f9af'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:40.890577 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4d689700-7e7d-4708-bc8e-dcd20cbffcff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3035b3de5f34f14bf18ba8d1b04f9af'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:40.902656 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:40.910734 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4d689700-7e7d-4708-bc8e-dcd20cbffcff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3035b3de5f34f14bf18ba8d1b04f9af'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:40.930010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4d689700-7e7d-4708-bc8e-dcd20cbffcff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3035b3de5f34f14bf18ba8d1b04f9af'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:40.942671 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1163/2371] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:27:40 2022] DELETE /identity/v3/users/e3035b3de5f34f14bf18ba8d1b04f9af => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:27:40.948860 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dea62-ba23-4314-82fb-0fd0ea06086e None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:40.949148 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dea62-ba23-4314-82fb-0fd0ea06086e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:40.949569 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dea62-ba23-4314-82fb-0fd0ea06086e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:40.976619 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e76dea62-ba23-4314-82fb-0fd0ea06086e None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:40.978291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e76dea62-ba23-4314-82fb-0fd0ea06086e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:41.005328 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:41.073734 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1209/2372] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:27:41.090925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d689700-7e7d-4708-bc8e-dcd20cbffcff admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:41.093730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4d689700-7e7d-4708-bc8e-dcd20cbffcff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:41.141222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dea62-ba23-4314-82fb-0fd0ea06086e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:41.143975 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e76dea62-ba23-4314-82fb-0fd0ea06086e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:41.158904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dea62-ba23-4314-82fb-0fd0ea06086e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:41.169687 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f259e2-d7d9-4456-bfad-ee569efeda70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:41.171091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f259e2-d7d9-4456-bfad-ee569efeda70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:41.171541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f259e2-d7d9-4456-bfad-ee569efeda70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:41.172008 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f259e2-d7d9-4456-bfad-ee569efeda70 admin admin] PATH_INFO: `/v3/projects/9e14bd95027949fb81bc74b167d628e1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:41.183918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f259e2-d7d9-4456-bfad-ee569efeda70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e14bd95027949fb81bc74b167d628e1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:41.186050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f259e2-d7d9-4456-bfad-ee569efeda70 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:41.212835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d689700-7e7d-4708-bc8e-dcd20cbffcff admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:41.221416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d33c6f-d5a8-4dee-b483-fdf37c0f4c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:41.222473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d33c6f-d5a8-4dee-b483-fdf37c0f4c4f service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:41.222787 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d33c6f-d5a8-4dee-b483-fdf37c0f4c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:41.223231 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d33c6f-d5a8-4dee-b483-fdf37c0f4c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:41.238260 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d33c6f-d5a8-4dee-b483-fdf37c0f4c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:41.240448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d33c6f-d5a8-4dee-b483-fdf37c0f4c4f service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:41.249012 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-64f259e2-d7d9-4456-bfad-ee569efeda70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e14bd95027949fb81bc74b167d628e1', 'request_id': 'req-64f259e2-d7d9-4456-bfad-ee569efeda70'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:41.252918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1164/2373] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:27:41.257745 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-64f259e2-d7d9-4456-bfad-ee569efeda70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e14bd95027949fb81bc74b167d628e1', 'request_id': 'req-64f259e2-d7d9-4456-bfad-ee569efeda70'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:41.267045 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-64f259e2-d7d9-4456-bfad-ee569efeda70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e14bd95027949fb81bc74b167d628e1', 'request_id': 'req-64f259e2-d7d9-4456-bfad-ee569efeda70'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:41.279631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-64f259e2-d7d9-4456-bfad-ee569efeda70 admin admin] The token cache is being invalidate because project 9e14bd95027949fb81bc74b167d628e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:27:41.279904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-64f259e2-d7d9-4456-bfad-ee569efeda70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:41.280549 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-64f259e2-d7d9-4456-bfad-ee569efeda70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:41.282475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1210/2374] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:27:41 2022] DELETE /identity/v3/projects/9e14bd95027949fb81bc74b167d628e1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:27:41.287577 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d0758-c54e-47f8-9756-da5b421f9352 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:41.287873 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d0758-c54e-47f8-9756-da5b421f9352 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:41.288203 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d0758-c54e-47f8-9756-da5b421f9352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:41.316079 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a54d0758-c54e-47f8-9756-da5b421f9352 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:41.317601 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a54d0758-c54e-47f8-9756-da5b421f9352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:41.442203 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1165/2375] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:27:41.460378 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd1ed3-8782-4bde-8c9c-c366d94c92c5 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:41.462150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd1ed3-8782-4bde-8c9c-c366d94c92c5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:41.462640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd1ed3-8782-4bde-8c9c-c366d94c92c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:41.504709 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f9dd1ed3-8782-4bde-8c9c-c366d94c92c5 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:41.506180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f9dd1ed3-8782-4bde-8c9c-c366d94c92c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:41.521150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1211/2376] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:41.529899 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d0758-c54e-47f8-9756-da5b421f9352 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:41.541000 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d0758-c54e-47f8-9756-da5b421f9352 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:41.546901 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661abf5-96ca-48ed-8fcf-4d17d311e14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:41.547756 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661abf5-96ca-48ed-8fcf-4d17d311e14c admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:41.548144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661abf5-96ca-48ed-8fcf-4d17d311e14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:41.548549 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661abf5-96ca-48ed-8fcf-4d17d311e14c admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:41.550215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661abf5-96ca-48ed-8fcf-4d17d311e14c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:27:41.550947 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661abf5-96ca-48ed-8fcf-4d17d311e14c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:41.552811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661abf5-96ca-48ed-8fcf-4d17d311e14c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:41.569492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1166/2377] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:27:41.573993 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd1ed3-8782-4bde-8c9c-c366d94c92c5 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:41.588061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd1ed3-8782-4bde-8c9c-c366d94c92c5 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:41.593495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8558e17-98b0-4347-906f-10b4694287c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:41.594146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558e17-98b0-4347-906f-10b4694287c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:41.594427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558e17-98b0-4347-906f-10b4694287c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:41.594707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558e17-98b0-4347-906f-10b4694287c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:41.595380 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8558e17-98b0-4347-906f-10b4694287c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:41.598017 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8558e17-98b0-4347-906f-10b4694287c9 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:41.637748 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1212/2378] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:27:41 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:41.642292 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661abf5-96ca-48ed-8fcf-4d17d311e14c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:41.656211 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661abf5-96ca-48ed-8fcf-4d17d311e14c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:41.773272 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f7c7c-6b76-4521-83e1-8c8704b9c9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:41.774198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f7c7c-6b76-4521-83e1-8c8704b9c9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:41.774634 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f7c7c-6b76-4521-83e1-8c8704b9c9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:41.775016 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f7c7c-6b76-4521-83e1-8c8704b9c9e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:41.775913 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f7c7c-6b76-4521-83e1-8c8704b9c9e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:41.778961 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f7c7c-6b76-4521-83e1-8c8704b9c9e8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:41.825323 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1167/2379] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:27:41 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:41.832311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8558e17-98b0-4347-906f-10b4694287c9 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:41.833866 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f7c7c-6b76-4521-83e1-8c8704b9c9e8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:41.835904 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e8558e17-98b0-4347-906f-10b4694287c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:41.846222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:41.859536 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8558e17-98b0-4347-906f-10b4694287c9 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:41.865181 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f7c7c-6b76-4521-83e1-8c8704b9c9e8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:41.868152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1734a-68ff-4e79-9061-e00f5aa65c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:41.869477 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1734a-68ff-4e79-9061-e00f5aa65c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:41.870181 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1734a-68ff-4e79-9061-e00f5aa65c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:41.870925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1734a-68ff-4e79-9061-e00f5aa65c4c admin admin] PATH_INFO: `/v3/projects/32b0ec4d77324788be8ad43a08bc4a28` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:41.873920 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1734a-68ff-4e79-9061-e00f5aa65c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b0ec4d77324788be8ad43a08bc4a28)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:41.879314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1734a-68ff-4e79-9061-e00f5aa65c4c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:41.879487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e569c-1041-4280-a95e-0454220b9c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:41.880851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e569c-1041-4280-a95e-0454220b9c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:41.881193 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e569c-1041-4280-a95e-0454220b9c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:41.881473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e569c-1041-4280-a95e-0454220b9c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:41.882260 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e569c-1041-4280-a95e-0454220b9c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:41.884218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e569c-1041-4280-a95e-0454220b9c09 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:41.903316 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1168/2380] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:41.909542 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e569c-1041-4280-a95e-0454220b9c09 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:41.928423 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e569c-1041-4280-a95e-0454220b9c09 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:41.945642 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85a5aa-bac7-4b68-8a4f-c94dc9ba64fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:41.947083 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85a5aa-bac7-4b68-8a4f-c94dc9ba64fa admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:41.948009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85a5aa-bac7-4b68-8a4f-c94dc9ba64fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:41.948446 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85a5aa-bac7-4b68-8a4f-c94dc9ba64fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:41.950869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85a5aa-bac7-4b68-8a4f-c94dc9ba64fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:41.953663 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85a5aa-bac7-4b68-8a4f-c94dc9ba64fa admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:41.967517 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1169/2381] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:27:41.969247 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-04f1734a-68ff-4e79-9061-e00f5aa65c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b0ec4d77324788be8ad43a08bc4a28', 'request_id': 'req-04f1734a-68ff-4e79-9061-e00f5aa65c4c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:41.973686 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85a5aa-bac7-4b68-8a4f-c94dc9ba64fa admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:41.980434 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-04f1734a-68ff-4e79-9061-e00f5aa65c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b0ec4d77324788be8ad43a08bc4a28', 'request_id': 'req-04f1734a-68ff-4e79-9061-e00f5aa65c4c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:41.985260 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85a5aa-bac7-4b68-8a4f-c94dc9ba64fa admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:41.995151 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-04f1734a-68ff-4e79-9061-e00f5aa65c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b0ec4d77324788be8ad43a08bc4a28', 'request_id': 'req-04f1734a-68ff-4e79-9061-e00f5aa65c4c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:42.010160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:42.018317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-04f1734a-68ff-4e79-9061-e00f5aa65c4c admin admin] The token cache is being invalidate because project 32b0ec4d77324788be8ad43a08bc4a28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:27:42.019072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-04f1734a-68ff-4e79-9061-e00f5aa65c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:42.022846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-04f1734a-68ff-4e79-9061-e00f5aa65c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:42.030089 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1213/2382] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:27:41 2022] DELETE /identity/v3/projects/32b0ec4d77324788be8ad43a08bc4a28 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:27:42.032284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31ac43-19e5-41bf-9f62-a2e0b6b5e1df None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:42.034030 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31ac43-19e5-41bf-9f62-a2e0b6b5e1df None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:42.034620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31ac43-19e5-41bf-9f62-a2e0b6b5e1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:42.069208 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2d31ac43-19e5-41bf-9f62-a2e0b6b5e1df None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:42.071512 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2d31ac43-19e5-41bf-9f62-a2e0b6b5e1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:42.086936 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b068aa-f317-4669-8d98-cdd9cc4e56c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:42.088090 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b068aa-f317-4669-8d98-cdd9cc4e56c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:42.088610 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b068aa-f317-4669-8d98-cdd9cc4e56c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:42.089070 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b068aa-f317-4669-8d98-cdd9cc4e56c1 admin admin] PATH_INFO: `/v3/projects/b75e10339f494640960293882dfe5218/users/fc8a4d9353224ae4963616185022e76c/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:42.135594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b068aa-f317-4669-8d98-cdd9cc4e56c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75e10339f494640960293882dfe5218, user_id=fc8a4d9353224ae4963616185022e76c, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:42.148363 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b068aa-f317-4669-8d98-cdd9cc4e56c1 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:42.187296 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1170/2383] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:27:41 2022] PUT /identity/v3/projects/b75e10339f494640960293882dfe5218/users/fc8a4d9353224ae4963616185022e76c/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:42.203686 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24678a6b-dd95-4963-9bf0-e25a1ae59593 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:42.205980 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24678a6b-dd95-4963-9bf0-e25a1ae59593 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:42.208639 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24678a6b-dd95-4963-9bf0-e25a1ae59593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:42.220361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1214/2384] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:42.222954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbf13f-3078-42c6-97df-16e542f595fd None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:42.223264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbf13f-3078-42c6-97df-16e542f595fd None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:42.223734 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbf13f-3078-42c6-97df-16e542f595fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:42.247974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a2dbf13f-3078-42c6-97df-16e542f595fd None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:42.249290 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a2dbf13f-3078-42c6-97df-16e542f595fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:42.311140 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-24678a6b-dd95-4963-9bf0-e25a1ae59593 None None] MFA Rules not processed for user `fc8a4d9353224ae4963616185022e76c`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:42.314533 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-24678a6b-dd95-4963-9bf0-e25a1ae59593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:42.371376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1215/2385] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:42.379102 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbf13f-3078-42c6-97df-16e542f595fd None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:42.401498 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbf13f-3078-42c6-97df-16e542f595fd None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:42.409856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443521d-578b-4bec-9389-e7ad75aeb447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:42.411146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443521d-578b-4bec-9389-e7ad75aeb447 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:42.411427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443521d-578b-4bec-9389-e7ad75aeb447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:42.411708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443521d-578b-4bec-9389-e7ad75aeb447 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:42.412459 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443521d-578b-4bec-9389-e7ad75aeb447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:27:42.412764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443521d-578b-4bec-9389-e7ad75aeb447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:42.414446 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443521d-578b-4bec-9389-e7ad75aeb447 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:42.437794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1216/2386] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:27:42.440499 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443521d-578b-4bec-9389-e7ad75aeb447 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:42.453355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1171/2387] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:27:42.460412 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443521d-578b-4bec-9389-e7ad75aeb447 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:42.468618 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbf84c-0c9a-4db7-b2af-879d753a8214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:42.469619 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbf84c-0c9a-4db7-b2af-879d753a8214 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:42.469741 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24678a6b-dd95-4963-9bf0-e25a1ae59593 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:42.470059 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbf84c-0c9a-4db7-b2af-879d753a8214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:42.470544 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbf84c-0c9a-4db7-b2af-879d753a8214 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:42.472394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbf84c-0c9a-4db7-b2af-879d753a8214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:42.473979 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-24678a6b-dd95-4963-9bf0-e25a1ae59593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:42.475907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbf84c-0c9a-4db7-b2af-879d753a8214 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:42.522537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1217/2388] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:27:42 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:27:42.531540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbf84c-0c9a-4db7-b2af-879d753a8214 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:42.576187 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24678a6b-dd95-4963-9bf0-e25a1ae59593 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:42.605443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:42.670204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbf84c-0c9a-4db7-b2af-879d753a8214 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:42.683941 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87599c9e-77f5-4e68-a83f-e75c5ab38069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:42.684870 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87599c9e-77f5-4e68-a83f-e75c5ab38069 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:42.685134 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87599c9e-77f5-4e68-a83f-e75c5ab38069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:42.685758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87599c9e-77f5-4e68-a83f-e75c5ab38069 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:42.686667 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87599c9e-77f5-4e68-a83f-e75c5ab38069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:42.688837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87599c9e-77f5-4e68-a83f-e75c5ab38069 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:42.703050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:42.714516 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4063c80-9ac5-492e-a5e9-1f8fe91b079d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:42.716027 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4063c80-9ac5-492e-a5e9-1f8fe91b079d service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:42.717335 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4063c80-9ac5-492e-a5e9-1f8fe91b079d service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:42.718292 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4063c80-9ac5-492e-a5e9-1f8fe91b079d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:42.740131 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1218/2389] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:27:42 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:42.746188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87599c9e-77f5-4e68-a83f-e75c5ab38069 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:42.767463 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87599c9e-77f5-4e68-a83f-e75c5ab38069 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:42.787288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5e8cc-bbd5-400f-be49-64231f2b18fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:42.787960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5e8cc-bbd5-400f-be49-64231f2b18fa admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:42.788583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5e8cc-bbd5-400f-be49-64231f2b18fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:42.788930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5e8cc-bbd5-400f-be49-64231f2b18fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:42.789782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5e8cc-bbd5-400f-be49-64231f2b18fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:42.792231 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5e8cc-bbd5-400f-be49-64231f2b18fa admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:42.817522 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1219/2390] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:42.827369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5e8cc-bbd5-400f-be49-64231f2b18fa admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:42.863370 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5e8cc-bbd5-400f-be49-64231f2b18fa admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:42.893758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735d985-ab7e-4a73-b9b2-eb5f2ecebdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:42.895237 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735d985-ab7e-4a73-b9b2-eb5f2ecebdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:42.897952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735d985-ab7e-4a73-b9b2-eb5f2ecebdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:42.899875 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735d985-ab7e-4a73-b9b2-eb5f2ecebdb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:42.905289 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735d985-ab7e-4a73-b9b2-eb5f2ecebdb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:42.919402 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735d985-ab7e-4a73-b9b2-eb5f2ecebdb6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:42.959769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1220/2391] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:42.961552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735d985-ab7e-4a73-b9b2-eb5f2ecebdb6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:42.995549 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735d985-ab7e-4a73-b9b2-eb5f2ecebdb6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:43.007456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4063c80-9ac5-492e-a5e9-1f8fe91b079d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:43.013520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4063c80-9ac5-492e-a5e9-1f8fe91b079d service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:43.023072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bab79-89bd-469c-8982-ede8246e6011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:43.025814 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bab79-89bd-469c-8982-ede8246e6011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:43.025814 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bab79-89bd-469c-8982-ede8246e6011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:43.026349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bab79-89bd-469c-8982-ede8246e6011 admin admin] PATH_INFO: `/v3/projects/356e92ba096f41f7b345b20056982d0e/users/cec63a671c874599af341bc7be49c9ce/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:43.059260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bab79-89bd-469c-8982-ede8246e6011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356e92ba096f41f7b345b20056982d0e, user_id=cec63a671c874599af341bc7be49c9ce, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:43.059928 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1172/2392] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:27:43.068500 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bab79-89bd-469c-8982-ede8246e6011 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:43.106006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1221/2393] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:27:42 2022] PUT /identity/v3/projects/356e92ba096f41f7b345b20056982d0e/users/cec63a671c874599af341bc7be49c9ce/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:43.126499 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26ac6b-865d-4cac-b399-fe3d5fdc6dbd None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:43.128032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26ac6b-865d-4cac-b399-fe3d5fdc6dbd None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:43.128858 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26ac6b-865d-4cac-b399-fe3d5fdc6dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:43.232215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-bc26ac6b-865d-4cac-b399-fe3d5fdc6dbd None None] MFA Rules not processed for user `cec63a671c874599af341bc7be49c9ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:43.235023 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-bc26ac6b-865d-4cac-b399-fe3d5fdc6dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:43.397579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1173/2394] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:43.414046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bab79-89bd-469c-8982-ede8246e6011 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:43.416668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-af7bab79-89bd-469c-8982-ede8246e6011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:43.542840 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bab79-89bd-469c-8982-ede8246e6011 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:43.547458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0b006-135c-477d-95a4-fe09cc1383bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:43.549719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0b006-135c-477d-95a4-fe09cc1383bc service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:43.549719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0b006-135c-477d-95a4-fe09cc1383bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:43.549719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0b006-135c-477d-95a4-fe09cc1383bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:43.561911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0b006-135c-477d-95a4-fe09cc1383bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:43.563903 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0b006-135c-477d-95a4-fe09cc1383bc service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:43.576697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1222/2395] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:27:43.880297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26ac6b-865d-4cac-b399-fe3d5fdc6dbd None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:43.883004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-bc26ac6b-865d-4cac-b399-fe3d5fdc6dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:43.973069 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:43.980397 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26ac6b-865d-4cac-b399-fe3d5fdc6dbd None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:43.988902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579c4c2-17fa-44b2-8648-3e52f5397543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:43.990577 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579c4c2-17fa-44b2-8648-3e52f5397543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:43.991537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579c4c2-17fa-44b2-8648-3e52f5397543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:43.992034 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579c4c2-17fa-44b2-8648-3e52f5397543 admin admin] PATH_INFO: `/v3/users/de71fa36c3d94630a3569d60e02553ae` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:43.995185 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579c4c2-17fa-44b2-8648-3e52f5397543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de71fa36c3d94630a3569d60e02553ae)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:43.997966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579c4c2-17fa-44b2-8648-3e52f5397543 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:44.085334 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d579c4c2-17fa-44b2-8648-3e52f5397543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de71fa36c3d94630a3569d60e02553ae'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:44.086118 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d579c4c2-17fa-44b2-8648-3e52f5397543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de71fa36c3d94630a3569d60e02553ae'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:44.097802 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d579c4c2-17fa-44b2-8648-3e52f5397543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de71fa36c3d94630a3569d60e02553ae'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:44.129037 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d579c4c2-17fa-44b2-8648-3e52f5397543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de71fa36c3d94630a3569d60e02553ae'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:44.139232 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d579c4c2-17fa-44b2-8648-3e52f5397543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de71fa36c3d94630a3569d60e02553ae'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:44.147209 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1174/2396] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:27:43 2022] DELETE /identity/v3/users/de71fa36c3d94630a3569d60e02553ae => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:44.153607 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed113a3-fe6e-4c91-a5e0-0ad5d541cd55 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:44.153802 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed113a3-fe6e-4c91-a5e0-0ad5d541cd55 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:44.154109 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed113a3-fe6e-4c91-a5e0-0ad5d541cd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:44.178071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7ed113a3-fe6e-4c91-a5e0-0ad5d541cd55 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:44.180207 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7ed113a3-fe6e-4c91-a5e0-0ad5d541cd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:44.265200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1223/2397] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:44.281407 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579c4c2-17fa-44b2-8648-3e52f5397543 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:44.285833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d579c4c2-17fa-44b2-8648-3e52f5397543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:44.318616 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed113a3-fe6e-4c91-a5e0-0ad5d541cd55 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:44.324334 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7ed113a3-fe6e-4c91-a5e0-0ad5d541cd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:44.351669 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed113a3-fe6e-4c91-a5e0-0ad5d541cd55 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:44.363430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f6171-d31e-48a0-aa21-273b6594f881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:44.365621 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f6171-d31e-48a0-aa21-273b6594f881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:44.365621 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f6171-d31e-48a0-aa21-273b6594f881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:44.366039 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f6171-d31e-48a0-aa21-273b6594f881 admin admin] PATH_INFO: `/v3/users/98e82008f7ec4a51a23e7c6cacd0190c` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:44.368646 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f6171-d31e-48a0-aa21-273b6594f881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e82008f7ec4a51a23e7c6cacd0190c)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:44.373424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f6171-d31e-48a0-aa21-273b6594f881 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:44.429974 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579c4c2-17fa-44b2-8648-3e52f5397543 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:44.437777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767152f-6863-4145-b89e-1ba3243de9ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:44.438440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767152f-6863-4145-b89e-1ba3243de9ed service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:44.438724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767152f-6863-4145-b89e-1ba3243de9ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:44.439056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767152f-6863-4145-b89e-1ba3243de9ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:44.458155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767152f-6863-4145-b89e-1ba3243de9ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:44.460089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767152f-6863-4145-b89e-1ba3243de9ed service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:44.474798 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1175/2398] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:27:44.502430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8e2f6171-d31e-48a0-aa21-273b6594f881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e82008f7ec4a51a23e7c6cacd0190c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:44.503757 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8e2f6171-d31e-48a0-aa21-273b6594f881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e82008f7ec4a51a23e7c6cacd0190c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:44.507316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:44.532668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8e2f6171-d31e-48a0-aa21-273b6594f881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e82008f7ec4a51a23e7c6cacd0190c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:44.541018 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8e2f6171-d31e-48a0-aa21-273b6594f881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e82008f7ec4a51a23e7c6cacd0190c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:44.587118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8e2f6171-d31e-48a0-aa21-273b6594f881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e82008f7ec4a51a23e7c6cacd0190c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:44.640775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1224/2399] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:27:44 2022] DELETE /identity/v3/users/98e82008f7ec4a51a23e7c6cacd0190c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:44.650572 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c76ed-eda2-42a1-98a4-f9d810e03738 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:44.651109 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c76ed-eda2-42a1-98a4-f9d810e03738 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:44.651575 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c76ed-eda2-42a1-98a4-f9d810e03738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:44.704796 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-277c76ed-eda2-42a1-98a4-f9d810e03738 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:44.707948 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-277c76ed-eda2-42a1-98a4-f9d810e03738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:44.909328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1176/2400] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:44.925876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f6171-d31e-48a0-aa21-273b6594f881 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:44.928517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8e2f6171-d31e-48a0-aa21-273b6594f881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:44.999752 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c76ed-eda2-42a1-98a4-f9d810e03738 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:45.001669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-277c76ed-eda2-42a1-98a4-f9d810e03738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:45.021687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c76ed-eda2-42a1-98a4-f9d810e03738 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:45.059591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4c697-e209-4aa0-afd8-712e4d7b0dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:45.061001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f6171-d31e-48a0-aa21-273b6594f881 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:45.061822 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4c697-e209-4aa0-afd8-712e4d7b0dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:45.067180 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4c697-e209-4aa0-afd8-712e4d7b0dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:45.067742 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4c697-e209-4aa0-afd8-712e4d7b0dbe admin admin] PATH_INFO: `/v3/projects/108e2d0a18594acaba334a885ad09d58` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:45.070936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42614f6c-652a-4769-a428-e1a1a58c8026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:45.072275 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42614f6c-652a-4769-a428-e1a1a58c8026 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:45.072500 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4c697-e209-4aa0-afd8-712e4d7b0dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=108e2d0a18594acaba334a885ad09d58)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:45.073232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42614f6c-652a-4769-a428-e1a1a58c8026 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:45.074551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42614f6c-652a-4769-a428-e1a1a58c8026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:45.077679 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4c697-e209-4aa0-afd8-712e4d7b0dbe admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:45.091479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42614f6c-652a-4769-a428-e1a1a58c8026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:45.097392 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:45.099716 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42614f6c-652a-4769-a428-e1a1a58c8026 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:45.134535 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1225/2401] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:27:45.213994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4be4c697-e209-4aa0-afd8-712e4d7b0dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '108e2d0a18594acaba334a885ad09d58', 'request_id': 'req-4be4c697-e209-4aa0-afd8-712e4d7b0dbe'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:45.241350 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4be4c697-e209-4aa0-afd8-712e4d7b0dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '108e2d0a18594acaba334a885ad09d58', 'request_id': 'req-4be4c697-e209-4aa0-afd8-712e4d7b0dbe'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:45.264480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4be4c697-e209-4aa0-afd8-712e4d7b0dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '108e2d0a18594acaba334a885ad09d58', 'request_id': 'req-4be4c697-e209-4aa0-afd8-712e4d7b0dbe'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:45.331419 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4be4c697-e209-4aa0-afd8-712e4d7b0dbe admin admin] The token cache is being invalidate because project 108e2d0a18594acaba334a885ad09d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:27:45.331927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4be4c697-e209-4aa0-afd8-712e4d7b0dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:45.333153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4be4c697-e209-4aa0-afd8-712e4d7b0dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:45.352611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1177/2402] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:27:44 2022] DELETE /identity/v3/projects/108e2d0a18594acaba334a885ad09d58 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:45.866180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42614f6c-652a-4769-a428-e1a1a58c8026 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:45.870112 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-42614f6c-652a-4769-a428-e1a1a58c8026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:45.889933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42614f6c-652a-4769-a428-e1a1a58c8026 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:45.965991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77564475-1431-46ba-bc38-a295760269cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:45.966656 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77564475-1431-46ba-bc38-a295760269cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:45.967066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77564475-1431-46ba-bc38-a295760269cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:45.967239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77564475-1431-46ba-bc38-a295760269cc admin admin] PATH_INFO: `/v3/projects/9530532a56d5437ba055c948e01d8eb7` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:45.969293 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77564475-1431-46ba-bc38-a295760269cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9530532a56d5437ba055c948e01d8eb7)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:45.972454 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77564475-1431-46ba-bc38-a295760269cc admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:46.045842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-77564475-1431-46ba-bc38-a295760269cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9530532a56d5437ba055c948e01d8eb7', 'request_id': 'req-77564475-1431-46ba-bc38-a295760269cc'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:46.055653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-77564475-1431-46ba-bc38-a295760269cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9530532a56d5437ba055c948e01d8eb7', 'request_id': 'req-77564475-1431-46ba-bc38-a295760269cc'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:46.069105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-77564475-1431-46ba-bc38-a295760269cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9530532a56d5437ba055c948e01d8eb7', 'request_id': 'req-77564475-1431-46ba-bc38-a295760269cc'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:46.083939 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:46.093830 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-77564475-1431-46ba-bc38-a295760269cc admin admin] The token cache is being invalidate because project 9530532a56d5437ba055c948e01d8eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:27:46.094155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-77564475-1431-46ba-bc38-a295760269cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:46.095107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-77564475-1431-46ba-bc38-a295760269cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:46.098603 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1226/2403] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:27:45 2022] DELETE /identity/v3/projects/9530532a56d5437ba055c948e01d8eb7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:46.104958 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9d127-e6b9-4e39-a479-32694374a434 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:46.105449 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9d127-e6b9-4e39-a479-32694374a434 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:46.105832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9d127-e6b9-4e39-a479-32694374a434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:46.133206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-26b9d127-e6b9-4e39-a479-32694374a434 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:46.134463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-26b9d127-e6b9-4e39-a479-32694374a434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:46.221275 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1178/2404] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:46.229676 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281cb68-187e-4b4b-a68f-8ca3310226b0 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:46.229963 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281cb68-187e-4b4b-a68f-8ca3310226b0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:46.230239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281cb68-187e-4b4b-a68f-8ca3310226b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:46.252828 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2281cb68-187e-4b4b-a68f-8ca3310226b0 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:46.254376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2281cb68-187e-4b4b-a68f-8ca3310226b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:46.262515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1227/2405] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:46.267429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9d127-e6b9-4e39-a479-32694374a434 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:46.285212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9d127-e6b9-4e39-a479-32694374a434 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:46.292975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e52bc-7e87-4a35-b9c9-cc231e837746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:46.293920 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e52bc-7e87-4a35-b9c9-cc231e837746 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:46.294428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e52bc-7e87-4a35-b9c9-cc231e837746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:46.294937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e52bc-7e87-4a35-b9c9-cc231e837746 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:46.296328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e52bc-7e87-4a35-b9c9-cc231e837746 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:27:46.296883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e52bc-7e87-4a35-b9c9-cc231e837746 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:46.299917 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e52bc-7e87-4a35-b9c9-cc231e837746 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:46.330978 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281cb68-187e-4b4b-a68f-8ca3310226b0 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:46.332743 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1179/2406] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:27:46.348931 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281cb68-187e-4b4b-a68f-8ca3310226b0 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:46.357780 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6322c4-8e6e-4147-b482-afb595211308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:46.359043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6322c4-8e6e-4147-b482-afb595211308 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:46.360369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6322c4-8e6e-4147-b482-afb595211308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:46.360369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6322c4-8e6e-4147-b482-afb595211308 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:46.362429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6322c4-8e6e-4147-b482-afb595211308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:46.365796 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6322c4-8e6e-4147-b482-afb595211308 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:46.426994 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1228/2407] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:27:46 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:46.428152 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e52bc-7e87-4a35-b9c9-cc231e837746 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:46.439103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e52bc-7e87-4a35-b9c9-cc231e837746 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:46.551983 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ff43a-e2e1-4d7f-acfe-2d477ff101bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:46.553900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ff43a-e2e1-4d7f-acfe-2d477ff101bd admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:46.554687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ff43a-e2e1-4d7f-acfe-2d477ff101bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:46.555270 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ff43a-e2e1-4d7f-acfe-2d477ff101bd admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:46.556970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ff43a-e2e1-4d7f-acfe-2d477ff101bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:46.561255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ff43a-e2e1-4d7f-acfe-2d477ff101bd admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:46.601932 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1180/2408] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:27:46 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:46.607890 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6322c4-8e6e-4147-b482-afb595211308 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:46.626700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6322c4-8e6e-4147-b482-afb595211308 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:46.640761 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d004a86-36de-4e09-a013-fd247028247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:46.641817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d004a86-36de-4e09-a013-fd247028247c admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:46.642256 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d004a86-36de-4e09-a013-fd247028247c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:46.644425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d004a86-36de-4e09-a013-fd247028247c admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:46.645342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d004a86-36de-4e09-a013-fd247028247c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:46.647014 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d004a86-36de-4e09-a013-fd247028247c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:46.662220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1229/2409] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:27:46.667619 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ff43a-e2e1-4d7f-acfe-2d477ff101bd admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:46.687183 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ff43a-e2e1-4d7f-acfe-2d477ff101bd admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:46.698604 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cfa64-085b-45e9-8b33-62ac8fbbfa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:46.699631 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cfa64-085b-45e9-8b33-62ac8fbbfa28 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:46.700145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cfa64-085b-45e9-8b33-62ac8fbbfa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:46.700770 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cfa64-085b-45e9-8b33-62ac8fbbfa28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:46.702227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71cfa64-085b-45e9-8b33-62ac8fbbfa28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:46.706985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71cfa64-085b-45e9-8b33-62ac8fbbfa28 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:46.726565 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d004a86-36de-4e09-a013-fd247028247c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:46.738082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5d004a86-36de-4e09-a013-fd247028247c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:46.768351 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1181/2410] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:46.770079 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cfa64-085b-45e9-8b33-62ac8fbbfa28 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:46.803523 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d004a86-36de-4e09-a013-fd247028247c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:46.811210 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cfa64-085b-45e9-8b33-62ac8fbbfa28 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:46.814708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e96d11-35aa-4bcd-a997-4f652916e95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:46.814708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e96d11-35aa-4bcd-a997-4f652916e95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:46.815017 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e96d11-35aa-4bcd-a997-4f652916e95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:46.815293 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e96d11-35aa-4bcd-a997-4f652916e95b admin admin] PATH_INFO: `/v3/users/cec63a671c874599af341bc7be49c9ce` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:46.817602 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e96d11-35aa-4bcd-a997-4f652916e95b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec63a671c874599af341bc7be49c9ce)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:46.820846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7191aa-d8e0-4b17-a161-51176ee6ba29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:46.821798 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7191aa-d8e0-4b17-a161-51176ee6ba29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:46.822021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e96d11-35aa-4bcd-a997-4f652916e95b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:46.822333 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7191aa-d8e0-4b17-a161-51176ee6ba29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:46.823139 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7191aa-d8e0-4b17-a161-51176ee6ba29 admin admin] PATH_INFO: `/v3/projects/4c20f6027a9c418b85d37b1202b82616/users/c6f04d09f9394463b55a08fa1623e439/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:46.841227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:46.867066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7191aa-d8e0-4b17-a161-51176ee6ba29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c20f6027a9c418b85d37b1202b82616, user_id=c6f04d09f9394463b55a08fa1623e439, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:46.872586 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7191aa-d8e0-4b17-a161-51176ee6ba29 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:46.898816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1182/2411] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:27:46 2022] PUT /identity/v3/projects/4c20f6027a9c418b85d37b1202b82616/users/c6f04d09f9394463b55a08fa1623e439/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:46.905915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f8c1b-4d42-435a-9c4b-b3a0d81ff8a5 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:46.906237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f8c1b-4d42-435a-9c4b-b3a0d81ff8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:46.906516 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f8c1b-4d42-435a-9c4b-b3a0d81ff8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:46.933114 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-884f8c1b-4d42-435a-9c4b-b3a0d81ff8a5 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:46.934467 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-884f8c1b-4d42-435a-9c4b-b3a0d81ff8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:46.957200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-75e96d11-35aa-4bcd-a997-4f652916e95b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec63a671c874599af341bc7be49c9ce'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:46.958789 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-75e96d11-35aa-4bcd-a997-4f652916e95b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec63a671c874599af341bc7be49c9ce'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:46.976826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-75e96d11-35aa-4bcd-a997-4f652916e95b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec63a671c874599af341bc7be49c9ce'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:46.978658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-75e96d11-35aa-4bcd-a997-4f652916e95b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec63a671c874599af341bc7be49c9ce'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:47.008527 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-75e96d11-35aa-4bcd-a997-4f652916e95b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec63a671c874599af341bc7be49c9ce'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:47.022483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1183/2412] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:27:47.035764 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f8c1b-4d42-435a-9c4b-b3a0d81ff8a5 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:47.037828 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-884f8c1b-4d42-435a-9c4b-b3a0d81ff8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:47.045224 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1230/2413] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:27:46 2022] DELETE /identity/v3/users/cec63a671c874599af341bc7be49c9ce => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:47.048136 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6ddcb-3bc2-4720-bae9-68d9a0631bc2 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:47.048939 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6ddcb-3bc2-4720-bae9-68d9a0631bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:47.049688 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6ddcb-3bc2-4720-bae9-68d9a0631bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:47.089078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5db6ddcb-3bc2-4720-bae9-68d9a0631bc2 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:47.091852 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5db6ddcb-3bc2-4720-bae9-68d9a0631bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:47.183458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f8c1b-4d42-435a-9c4b-b3a0d81ff8a5 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:47.214466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1231/2414] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:47.226366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6ddcb-3bc2-4720-bae9-68d9a0631bc2 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:47.228297 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5db6ddcb-3bc2-4720-bae9-68d9a0631bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:47.279803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:47.294079 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1355a8-a37b-4fcc-820b-03e7eb546f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:47.295073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1355a8-a37b-4fcc-820b-03e7eb546f21 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:47.295761 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1355a8-a37b-4fcc-820b-03e7eb546f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:47.297437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1355a8-a37b-4fcc-820b-03e7eb546f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:47.325285 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1355a8-a37b-4fcc-820b-03e7eb546f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:47.327972 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1355a8-a37b-4fcc-820b-03e7eb546f21 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:47.332020 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6ddcb-3bc2-4720-bae9-68d9a0631bc2 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:47.336251 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119838e6-4dd4-4592-9689-dfd2d36d24f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:47.336864 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119838e6-4dd4-4592-9689-dfd2d36d24f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:47.337220 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119838e6-4dd4-4592-9689-dfd2d36d24f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:47.337503 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119838e6-4dd4-4592-9689-dfd2d36d24f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:47.347641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1184/2415] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:27:47.349331 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119838e6-4dd4-4592-9689-dfd2d36d24f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:47.352668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119838e6-4dd4-4592-9689-dfd2d36d24f4 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:47.371397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1232/2416] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:27:47.867846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1355a8-a37b-4fcc-820b-03e7eb546f21 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:47.871042 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6a1355a8-a37b-4fcc-820b-03e7eb546f21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:47.898549 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1355a8-a37b-4fcc-820b-03e7eb546f21 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:47.908016 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62c60d-f3b0-4336-ab56-8eb8e35ad507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:47.910090 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62c60d-f3b0-4336-ab56-8eb8e35ad507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:47.911220 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62c60d-f3b0-4336-ab56-8eb8e35ad507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:47.911723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62c60d-f3b0-4336-ab56-8eb8e35ad507 admin admin] PATH_INFO: `/v3/projects/356e92ba096f41f7b345b20056982d0e` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:47.913722 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62c60d-f3b0-4336-ab56-8eb8e35ad507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=356e92ba096f41f7b345b20056982d0e)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:47.917956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62c60d-f3b0-4336-ab56-8eb8e35ad507 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:48.010644 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:48.026140 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ff62c60d-f3b0-4336-ab56-8eb8e35ad507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '356e92ba096f41f7b345b20056982d0e', 'request_id': 'req-ff62c60d-f3b0-4336-ab56-8eb8e35ad507'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:48.035537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ff62c60d-f3b0-4336-ab56-8eb8e35ad507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '356e92ba096f41f7b345b20056982d0e', 'request_id': 'req-ff62c60d-f3b0-4336-ab56-8eb8e35ad507'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:48.045811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ff62c60d-f3b0-4336-ab56-8eb8e35ad507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '356e92ba096f41f7b345b20056982d0e', 'request_id': 'req-ff62c60d-f3b0-4336-ab56-8eb8e35ad507'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:48.067010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ff62c60d-f3b0-4336-ab56-8eb8e35ad507 admin admin] The token cache is being invalidate because project 356e92ba096f41f7b345b20056982d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:27:48.067374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ff62c60d-f3b0-4336-ab56-8eb8e35ad507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:48.068213 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ff62c60d-f3b0-4336-ab56-8eb8e35ad507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:48.069833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1185/2417] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:27:47 2022] DELETE /identity/v3/projects/356e92ba096f41f7b345b20056982d0e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:48.078181 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d09d1b-b1d1-4854-bbac-9953e1e68233 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:48.078992 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d09d1b-b1d1-4854-bbac-9953e1e68233 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:48.079263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d09d1b-b1d1-4854-bbac-9953e1e68233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:48.130529 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-78d09d1b-b1d1-4854-bbac-9953e1e68233 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:48.132882 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-78d09d1b-b1d1-4854-bbac-9953e1e68233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:48.234133 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1233/2418] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:48.243013 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6154c93-52a6-4219-a0bf-9ae219099ed4 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:48.243478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6154c93-52a6-4219-a0bf-9ae219099ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:48.243776 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6154c93-52a6-4219-a0bf-9ae219099ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:48.265622 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b6154c93-52a6-4219-a0bf-9ae219099ed4 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:48.266868 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b6154c93-52a6-4219-a0bf-9ae219099ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:48.277980 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1186/2419] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:27:48.284042 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d09d1b-b1d1-4854-bbac-9953e1e68233 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:48.302933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d09d1b-b1d1-4854-bbac-9953e1e68233 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:48.309331 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f38b65-175d-4440-9874-057271761028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:48.310188 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f38b65-175d-4440-9874-057271761028 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:48.310535 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f38b65-175d-4440-9874-057271761028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:48.310819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f38b65-175d-4440-9874-057271761028 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:48.311553 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f38b65-175d-4440-9874-057271761028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:27:48.311990 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f38b65-175d-4440-9874-057271761028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:48.313882 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f38b65-175d-4440-9874-057271761028 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:48.329177 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1234/2420] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:27:48.336428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6154c93-52a6-4219-a0bf-9ae219099ed4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:48.347448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6154c93-52a6-4219-a0bf-9ae219099ed4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:48.352554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54167c25-d21c-4e94-93b7-04491ad90516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:48.353183 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54167c25-d21c-4e94-93b7-04491ad90516 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:48.353463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54167c25-d21c-4e94-93b7-04491ad90516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:48.353735 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54167c25-d21c-4e94-93b7-04491ad90516 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:48.354414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54167c25-d21c-4e94-93b7-04491ad90516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:48.356383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54167c25-d21c-4e94-93b7-04491ad90516 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:48.395323 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1187/2421] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:27:48 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:48.396891 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f38b65-175d-4440-9874-057271761028 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:48.410319 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f38b65-175d-4440-9874-057271761028 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:48.491756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed523b10-54c0-4a8a-8a9c-0abf1fc43b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:48.492629 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523b10-54c0-4a8a-8a9c-0abf1fc43b05 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:48.492970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523b10-54c0-4a8a-8a9c-0abf1fc43b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:48.493303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523b10-54c0-4a8a-8a9c-0abf1fc43b05 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:48.494056 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed523b10-54c0-4a8a-8a9c-0abf1fc43b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:48.496842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed523b10-54c0-4a8a-8a9c-0abf1fc43b05 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:48.524319 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1235/2422] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:27:48 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:48.528708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54167c25-d21c-4e94-93b7-04491ad90516 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:48.547195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54167c25-d21c-4e94-93b7-04491ad90516 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:48.552717 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86361cd-d41f-4c10-8112-2cf8143ee9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:48.553494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86361cd-d41f-4c10-8112-2cf8143ee9dd admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:48.553817 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86361cd-d41f-4c10-8112-2cf8143ee9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:48.554152 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86361cd-d41f-4c10-8112-2cf8143ee9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:48.555144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86361cd-d41f-4c10-8112-2cf8143ee9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:48.556949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86361cd-d41f-4c10-8112-2cf8143ee9dd admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:48.573701 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1188/2423] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:48.576099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed523b10-54c0-4a8a-8a9c-0abf1fc43b05 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:48.600495 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed523b10-54c0-4a8a-8a9c-0abf1fc43b05 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:48.607982 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09edca-22ab-49e0-bd85-87742eacbfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:48.607982 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09edca-22ab-49e0-bd85-87742eacbfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:48.607982 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09edca-22ab-49e0-bd85-87742eacbfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:48.609569 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09edca-22ab-49e0-bd85-87742eacbfe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:48.609920 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09edca-22ab-49e0-bd85-87742eacbfe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:48.613249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09edca-22ab-49e0-bd85-87742eacbfe7 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:48.638741 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1236/2424] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:48.642120 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86361cd-d41f-4c10-8112-2cf8143ee9dd admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:48.657826 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86361cd-d41f-4c10-8112-2cf8143ee9dd admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:48.669408 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03983d-ca59-47c6-8519-44cd331081c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:48.670398 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03983d-ca59-47c6-8519-44cd331081c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:48.671078 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03983d-ca59-47c6-8519-44cd331081c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:48.671610 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03983d-ca59-47c6-8519-44cd331081c3 admin admin] PATH_INFO: `/v3/projects/5dfa9545c0ba4f82ac5ccc016b74ca7f/users/16a2dc7c197f4f1c95b37c8fcbf2d3ab/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:48.694946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03983d-ca59-47c6-8519-44cd331081c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dfa9545c0ba4f82ac5ccc016b74ca7f, user_id=16a2dc7c197f4f1c95b37c8fcbf2d3ab, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:48.701612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03983d-ca59-47c6-8519-44cd331081c3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:48.725279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1189/2425] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:27:48 2022] PUT /identity/v3/projects/5dfa9545c0ba4f82ac5ccc016b74ca7f/users/16a2dc7c197f4f1c95b37c8fcbf2d3ab/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:48.748229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f86fe3-784f-4ceb-8a43-bc5d12fd7254 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:48.748646 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f86fe3-784f-4ceb-8a43-bc5d12fd7254 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:48.749119 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f86fe3-784f-4ceb-8a43-bc5d12fd7254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:48.797167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-18f86fe3-784f-4ceb-8a43-bc5d12fd7254 None None] MFA Rules not processed for user `16a2dc7c197f4f1c95b37c8fcbf2d3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:48.799570 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-18f86fe3-784f-4ceb-8a43-bc5d12fd7254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:48.864424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:48.952236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1237/2426] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:48.976942 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03983d-ca59-47c6-8519-44cd331081c3 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:48.979673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0d03983d-ca59-47c6-8519-44cd331081c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:49.162438 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03983d-ca59-47c6-8519-44cd331081c3 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:49.170291 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a88c5-205e-43d8-a43f-c46f9fafb0d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:49.171691 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a88c5-205e-43d8-a43f-c46f9fafb0d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:49.172359 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a88c5-205e-43d8-a43f-c46f9fafb0d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:49.173185 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a88c5-205e-43d8-a43f-c46f9fafb0d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:49.196157 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a88c5-205e-43d8-a43f-c46f9fafb0d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:49.198560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a88c5-205e-43d8-a43f-c46f9fafb0d5 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:49.221838 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1190/2427] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:27:49.274981 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f86fe3-784f-4ceb-8a43-bc5d12fd7254 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:49.491354 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f86fe3-784f-4ceb-8a43-bc5d12fd7254 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:49.499476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c643a-2bb4-462e-9a17-f4e167ceb5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:49.500447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c643a-2bb4-462e-9a17-f4e167ceb5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:49.500868 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c643a-2bb4-462e-9a17-f4e167ceb5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:49.501212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c643a-2bb4-462e-9a17-f4e167ceb5d1 admin admin] PATH_INFO: `/v3/users/16a2dc7c197f4f1c95b37c8fcbf2d3ab` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:49.502599 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c643a-2bb4-462e-9a17-f4e167ceb5d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a2dc7c197f4f1c95b37c8fcbf2d3ab)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:49.504987 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c643a-2bb4-462e-9a17-f4e167ceb5d1 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:49.609192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-320c643a-2bb4-462e-9a17-f4e167ceb5d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a2dc7c197f4f1c95b37c8fcbf2d3ab'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:49.610786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-320c643a-2bb4-462e-9a17-f4e167ceb5d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a2dc7c197f4f1c95b37c8fcbf2d3ab'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:49.643311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-320c643a-2bb4-462e-9a17-f4e167ceb5d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a2dc7c197f4f1c95b37c8fcbf2d3ab'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:49.644811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-320c643a-2bb4-462e-9a17-f4e167ceb5d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a2dc7c197f4f1c95b37c8fcbf2d3ab'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:49.678083 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-320c643a-2bb4-462e-9a17-f4e167ceb5d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a2dc7c197f4f1c95b37c8fcbf2d3ab'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:49.703831 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1238/2428] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:27:49 2022] DELETE /identity/v3/users/16a2dc7c197f4f1c95b37c8fcbf2d3ab => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:49.710483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae1e54-683f-4048-bf17-378593d144e9 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:49.712734 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae1e54-683f-4048-bf17-378593d144e9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:49.713257 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae1e54-683f-4048-bf17-378593d144e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:49.744956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7bae1e54-683f-4048-bf17-378593d144e9 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:49.746845 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7bae1e54-683f-4048-bf17-378593d144e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:49.892333 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1191/2429] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:27:49.909064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c643a-2bb4-462e-9a17-f4e167ceb5d1 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:49.912259 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-320c643a-2bb4-462e-9a17-f4e167ceb5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:50.017060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:50.039365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c643a-2bb4-462e-9a17-f4e167ceb5d1 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:50.048471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720b238-c901-474e-bae4-23aa44aee36f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:50.049541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720b238-c901-474e-bae4-23aa44aee36f service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:50.050030 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720b238-c901-474e-bae4-23aa44aee36f service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:50.050503 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720b238-c901-474e-bae4-23aa44aee36f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:50.076154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720b238-c901-474e-bae4-23aa44aee36f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:50.078090 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720b238-c901-474e-bae4-23aa44aee36f service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:50.097808 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1239/2430] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:27:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:27:50.746679 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae1e54-683f-4048-bf17-378593d144e9 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:50.750869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7bae1e54-683f-4048-bf17-378593d144e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:50.780564 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:50.788805 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae1e54-683f-4048-bf17-378593d144e9 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:50.804544 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba975f03-8fdd-4e17-9a20-3d75da504910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:50.807162 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba975f03-8fdd-4e17-9a20-3d75da504910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:50.807930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba975f03-8fdd-4e17-9a20-3d75da504910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:50.808960 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba975f03-8fdd-4e17-9a20-3d75da504910 admin admin] PATH_INFO: `/v3/projects/5dfa9545c0ba4f82ac5ccc016b74ca7f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:50.811374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba975f03-8fdd-4e17-9a20-3d75da504910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dfa9545c0ba4f82ac5ccc016b74ca7f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:50.816279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba975f03-8fdd-4e17-9a20-3d75da504910 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:50.960339 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ba975f03-8fdd-4e17-9a20-3d75da504910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dfa9545c0ba4f82ac5ccc016b74ca7f', 'request_id': 'req-ba975f03-8fdd-4e17-9a20-3d75da504910'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:50.969668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ba975f03-8fdd-4e17-9a20-3d75da504910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dfa9545c0ba4f82ac5ccc016b74ca7f', 'request_id': 'req-ba975f03-8fdd-4e17-9a20-3d75da504910'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:50.988853 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ba975f03-8fdd-4e17-9a20-3d75da504910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dfa9545c0ba4f82ac5ccc016b74ca7f', 'request_id': 'req-ba975f03-8fdd-4e17-9a20-3d75da504910'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:51.007407 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ba975f03-8fdd-4e17-9a20-3d75da504910 admin admin] The token cache is being invalidate because project 5dfa9545c0ba4f82ac5ccc016b74ca7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:27:51.007962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ba975f03-8fdd-4e17-9a20-3d75da504910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:51.009331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ba975f03-8fdd-4e17-9a20-3d75da504910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:51.011975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1192/2431] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:27:50 2022] DELETE /identity/v3/projects/5dfa9545c0ba4f82ac5ccc016b74ca7f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:54.721266 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ca5bf-bc4d-4629-a81d-a2e21d622033 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:54.721834 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ca5bf-bc4d-4629-a81d-a2e21d622033 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:54.721984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ca5bf-bc4d-4629-a81d-a2e21d622033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:54.755744 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c62ca5bf-bc4d-4629-a81d-a2e21d622033 None None] MFA Rules not processed for user `c6f04d09f9394463b55a08fa1623e439`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:27:54.757026 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c62ca5bf-bc4d-4629-a81d-a2e21d622033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:54.847339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1240/2432] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:27:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:27:54.852311 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba975f03-8fdd-4e17-9a20-3d75da504910 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:54.854003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ba975f03-8fdd-4e17-9a20-3d75da504910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:54.942289 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba975f03-8fdd-4e17-9a20-3d75da504910 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:54.947238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411a2ec-1366-40d4-8211-83f8c0d3e9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:54.947891 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411a2ec-1366-40d4-8211-83f8c0d3e9fd admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:54.948457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411a2ec-1366-40d4-8211-83f8c0d3e9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:54.948788 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411a2ec-1366-40d4-8211-83f8c0d3e9fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:54.949445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411a2ec-1366-40d4-8211-83f8c0d3e9fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:54.951611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411a2ec-1366-40d4-8211-83f8c0d3e9fd admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:54.999723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1193/2433] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:27:54 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:27:55.005538 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ca5bf-bc4d-4629-a81d-a2e21d622033 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:55.025697 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ca5bf-bc4d-4629-a81d-a2e21d622033 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:55.105478 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744382a7-42f9-408f-9469-a96ac02dfb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:55.105821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744382a7-42f9-408f-9469-a96ac02dfb55 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:55.106107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744382a7-42f9-408f-9469-a96ac02dfb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:55.106386 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744382a7-42f9-408f-9469-a96ac02dfb55 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:55.107071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744382a7-42f9-408f-9469-a96ac02dfb55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:55.109136 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744382a7-42f9-408f-9469-a96ac02dfb55 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:55.137537 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1241/2434] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:27:55 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:27:55.141861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411a2ec-1366-40d4-8211-83f8c0d3e9fd admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:55.155153 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411a2ec-1366-40d4-8211-83f8c0d3e9fd admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:55.166376 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d78fdc-0cdf-44f3-b170-9bf487321717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:55.167135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d78fdc-0cdf-44f3-b170-9bf487321717 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:55.167512 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d78fdc-0cdf-44f3-b170-9bf487321717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:55.167914 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d78fdc-0cdf-44f3-b170-9bf487321717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:55.168768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d78fdc-0cdf-44f3-b170-9bf487321717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:55.170448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d78fdc-0cdf-44f3-b170-9bf487321717 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:55.186172 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1194/2435] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:27:55.191357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744382a7-42f9-408f-9469-a96ac02dfb55 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:55.206235 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744382a7-42f9-408f-9469-a96ac02dfb55 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:55.212855 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5bc12-e373-4c19-81bc-d103825d1a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:55.213607 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5bc12-e373-4c19-81bc-d103825d1a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:55.213936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5bc12-e373-4c19-81bc-d103825d1a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:55.214269 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5bc12-e373-4c19-81bc-d103825d1a8b admin admin] PATH_INFO: `/v3/projects/cd4557e330624e2e88a5ff48b13c16e4/users/150cb6ee570c4a2f9c9e83fd881b9652/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:55.232100 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5bc12-e373-4c19-81bc-d103825d1a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4557e330624e2e88a5ff48b13c16e4, user_id=150cb6ee570c4a2f9c9e83fd881b9652, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:55.234843 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5bc12-e373-4c19-81bc-d103825d1a8b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:55.250287 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1242/2436] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:27:55 2022] PUT /identity/v3/projects/cd4557e330624e2e88a5ff48b13c16e4/users/150cb6ee570c4a2f9c9e83fd881b9652/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:27:55.255843 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d78fdc-0cdf-44f3-b170-9bf487321717 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:55.268646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d78fdc-0cdf-44f3-b170-9bf487321717 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:55.343343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df56a53-193c-444b-a60f-60d45be09b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:55.344622 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df56a53-193c-444b-a60f-60d45be09b8c admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:55.345117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df56a53-193c-444b-a60f-60d45be09b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:55.350307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df56a53-193c-444b-a60f-60d45be09b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:55.351766 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df56a53-193c-444b-a60f-60d45be09b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:55.354533 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df56a53-193c-444b-a60f-60d45be09b8c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:55.358627 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:55.379384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1195/2437] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:27:55.383491 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5bc12-e373-4c19-81bc-d103825d1a8b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:55.405245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5bc12-e373-4c19-81bc-d103825d1a8b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:55.411077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75691456-471f-42fe-804d-aee3c55009ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:55.412296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691456-471f-42fe-804d-aee3c55009ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:55.413014 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691456-471f-42fe-804d-aee3c55009ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:55.413460 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691456-471f-42fe-804d-aee3c55009ff admin admin] PATH_INFO: `/v3/projects/cd4557e330624e2e88a5ff48b13c16e4/users/150cb6ee570c4a2f9c9e83fd881b9652/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:55.417013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75691456-471f-42fe-804d-aee3c55009ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4557e330624e2e88a5ff48b13c16e4, user_id=150cb6ee570c4a2f9c9e83fd881b9652, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:55.422285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75691456-471f-42fe-804d-aee3c55009ff admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:55.443539 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1243/2438] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:27:55 2022] PUT /identity/v3/projects/cd4557e330624e2e88a5ff48b13c16e4/users/150cb6ee570c4a2f9c9e83fd881b9652/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:27:59.750056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df56a53-193c-444b-a60f-60d45be09b8c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:27:59.753929 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1df56a53-193c-444b-a60f-60d45be09b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:27:59.771960 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df56a53-193c-444b-a60f-60d45be09b8c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:27:59.859965 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cb29a-09ef-447b-b06e-43e72d73ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:27:59.860775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cb29a-09ef-447b-b06e-43e72d73ce1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:27:59.861200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cb29a-09ef-447b-b06e-43e72d73ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:27:59.861488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cb29a-09ef-447b-b06e-43e72d73ce1c admin admin] PATH_INFO: `/v3/users/fc8a4d9353224ae4963616185022e76c` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:27:59.862800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cb29a-09ef-447b-b06e-43e72d73ce1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8a4d9353224ae4963616185022e76c)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:27:59.865035 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cb29a-09ef-447b-b06e-43e72d73ce1c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:27:59.945598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd9cb29a-09ef-447b-b06e-43e72d73ce1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8a4d9353224ae4963616185022e76c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:59.950195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd9cb29a-09ef-447b-b06e-43e72d73ce1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8a4d9353224ae4963616185022e76c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:59.973776 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd9cb29a-09ef-447b-b06e-43e72d73ce1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8a4d9353224ae4963616185022e76c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:27:59.995476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd9cb29a-09ef-447b-b06e-43e72d73ce1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8a4d9353224ae4963616185022e76c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:28:00.011023 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd9cb29a-09ef-447b-b06e-43e72d73ce1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8a4d9353224ae4963616185022e76c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:28:00.020109 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1196/2439] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:27:59 2022] DELETE /identity/v3/users/fc8a4d9353224ae4963616185022e76c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:28:00.027461 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d390f8f-c6d4-4cfc-8ddd-c2f2f048c547 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:00.028351 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d390f8f-c6d4-4cfc-8ddd-c2f2f048c547 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:00.030034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d390f8f-c6d4-4cfc-8ddd-c2f2f048c547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:00.054104 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1d390f8f-c6d4-4cfc-8ddd-c2f2f048c547 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:28:00.055760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1d390f8f-c6d4-4cfc-8ddd-c2f2f048c547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:00.115161 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:00.181057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1244/2440] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:28:00.191187 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cb29a-09ef-447b-b06e-43e72d73ce1c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:00.192816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-bd9cb29a-09ef-447b-b06e-43e72d73ce1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:00.350228 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cb29a-09ef-447b-b06e-43e72d73ce1c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:00.366260 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bffb0d-4aeb-4c2c-9ff6-e378916bfccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:00.367859 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bffb0d-4aeb-4c2c-9ff6-e378916bfccd service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:00.368506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bffb0d-4aeb-4c2c-9ff6-e378916bfccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:00.369112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bffb0d-4aeb-4c2c-9ff6-e378916bfccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:00.393983 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bffb0d-4aeb-4c2c-9ff6-e378916bfccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:00.396911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bffb0d-4aeb-4c2c-9ff6-e378916bfccd service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:00.416625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1197/2441] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:28:01.192499 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d390f8f-c6d4-4cfc-8ddd-c2f2f048c547 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:01.195291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1d390f8f-c6d4-4cfc-8ddd-c2f2f048c547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:01.212016 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d390f8f-c6d4-4cfc-8ddd-c2f2f048c547 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:01.225503 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91e68a-e089-4f92-9b73-028e3ebd1c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:01.226700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91e68a-e089-4f92-9b73-028e3ebd1c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:01.227198 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91e68a-e089-4f92-9b73-028e3ebd1c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:01.227949 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91e68a-e089-4f92-9b73-028e3ebd1c74 admin admin] PATH_INFO: `/v3/projects/b75e10339f494640960293882dfe5218` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:01.230156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91e68a-e089-4f92-9b73-028e3ebd1c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75e10339f494640960293882dfe5218)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:01.233093 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91e68a-e089-4f92-9b73-028e3ebd1c74 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:01.308696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5c91e68a-e089-4f92-9b73-028e3ebd1c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75e10339f494640960293882dfe5218', 'request_id': 'req-5c91e68a-e089-4f92-9b73-028e3ebd1c74'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:28:01.321125 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5c91e68a-e089-4f92-9b73-028e3ebd1c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75e10339f494640960293882dfe5218', 'request_id': 'req-5c91e68a-e089-4f92-9b73-028e3ebd1c74'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:28:01.335202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5c91e68a-e089-4f92-9b73-028e3ebd1c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75e10339f494640960293882dfe5218', 'request_id': 'req-5c91e68a-e089-4f92-9b73-028e3ebd1c74'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:28:01.360286 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5c91e68a-e089-4f92-9b73-028e3ebd1c74 admin admin] The token cache is being invalidate because project b75e10339f494640960293882dfe5218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:28:01.360880 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5c91e68a-e089-4f92-9b73-028e3ebd1c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:28:01.362642 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5c91e68a-e089-4f92-9b73-028e3ebd1c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:28:01.366185 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1245/2442] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:28:01 2022] DELETE /identity/v3/projects/b75e10339f494640960293882dfe5218 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:28:01.372437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e1ede-adc7-40e3-ac9f-48f72f7274d4 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:01.372437 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e1ede-adc7-40e3-ac9f-48f72f7274d4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:01.373307 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e1ede-adc7-40e3-ac9f-48f72f7274d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:01.435810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-366e1ede-adc7-40e3-ac9f-48f72f7274d4 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:28:01.437959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-366e1ede-adc7-40e3-ac9f-48f72f7274d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:01.473144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:01.640565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1198/2443] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:28:01.643198 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ffe6d-340c-46a9-b789-59ef7129282c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:01.644587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ffe6d-340c-46a9-b789-59ef7129282c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:01.645370 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ffe6d-340c-46a9-b789-59ef7129282c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:01.656611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5bb34-6cea-4c4e-b0be-98bcdf0cbd48 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:01.656900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5bb34-6cea-4c4e-b0be-98bcdf0cbd48 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:01.657178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5bb34-6cea-4c4e-b0be-98bcdf0cbd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:01.677284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5f5ffe6d-340c-46a9-b789-59ef7129282c None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:28:01.679919 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5f5ffe6d-340c-46a9-b789-59ef7129282c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:01.696360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1246/2444] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:28:01.697004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ffe6d-340c-46a9-b789-59ef7129282c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:01.711220 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-6ed5bb34-6cea-4c4e-b0be-98bcdf0cbd48 None None] MFA Rules not processed for user `150cb6ee570c4a2f9c9e83fd881b9652`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:28:01.713366 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ffe6d-340c-46a9-b789-59ef7129282c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:01.714504 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6ed5bb34-6cea-4c4e-b0be-98bcdf0cbd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:01.720454 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b01c68-1f06-498f-9c90-e5263dac8d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:01.721700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b01c68-1f06-498f-9c90-e5263dac8d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:01.721987 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b01c68-1f06-498f-9c90-e5263dac8d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:01.722272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b01c68-1f06-498f-9c90-e5263dac8d69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:01.722992 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b01c68-1f06-498f-9c90-e5263dac8d69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:28:01.723303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b01c68-1f06-498f-9c90-e5263dac8d69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:01.728016 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b01c68-1f06-498f-9c90-e5263dac8d69 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:01.746177 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1247/2445] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:28:01.746723 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b01c68-1f06-498f-9c90-e5263dac8d69 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:01.759111 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b01c68-1f06-498f-9c90-e5263dac8d69 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:01.764081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362c0ce-6250-4ba4-82b4-7b1c7a8eb16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:01.764889 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362c0ce-6250-4ba4-82b4-7b1c7a8eb16c admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:01.765180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362c0ce-6250-4ba4-82b4-7b1c7a8eb16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:01.765460 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362c0ce-6250-4ba4-82b4-7b1c7a8eb16c admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:01.766133 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362c0ce-6250-4ba4-82b4-7b1c7a8eb16c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:01.768122 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362c0ce-6250-4ba4-82b4-7b1c7a8eb16c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:01.841104 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1248/2446] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:28:01 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:28:01.843329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362c0ce-6250-4ba4-82b4-7b1c7a8eb16c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:01.876362 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1199/2447] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:28:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:28:01.901086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5bb34-6cea-4c4e-b0be-98bcdf0cbd48 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:01.903949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6ed5bb34-6cea-4c4e-b0be-98bcdf0cbd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:01.977080 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362c0ce-6250-4ba4-82b4-7b1c7a8eb16c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:01.995314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82494069-e4cd-4289-b4b0-0473d830efcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:01.997855 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82494069-e4cd-4289-b4b0-0473d830efcc admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:01.997855 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82494069-e4cd-4289-b4b0-0473d830efcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:01.997855 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82494069-e4cd-4289-b4b0-0473d830efcc admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:01.998243 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82494069-e4cd-4289-b4b0-0473d830efcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:02.000429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82494069-e4cd-4289-b4b0-0473d830efcc admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:02.054481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1249/2448] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:28:01 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:28:02.060504 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82494069-e4cd-4289-b4b0-0473d830efcc admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:02.069044 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:02.072865 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82494069-e4cd-4289-b4b0-0473d830efcc admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:02.087784 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da99dd4-981c-41d7-883b-d71aa20d9b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:02.088750 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da99dd4-981c-41d7-883b-d71aa20d9b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:02.089138 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da99dd4-981c-41d7-883b-d71aa20d9b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:02.089423 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da99dd4-981c-41d7-883b-d71aa20d9b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:02.092197 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5bb34-6cea-4c4e-b0be-98bcdf0cbd48 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:02.092381 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da99dd4-981c-41d7-883b-d71aa20d9b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:02.092381 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da99dd4-981c-41d7-883b-d71aa20d9b25 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:02.104748 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1250/2449] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:28:02.110055 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da99dd4-981c-41d7-883b-d71aa20d9b25 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:02.124004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da99dd4-981c-41d7-883b-d71aa20d9b25 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:02.130474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432f209-67c0-453d-90d3-1300b2bc8b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:02.131040 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432f209-67c0-453d-90d3-1300b2bc8b56 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:02.131327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432f209-67c0-453d-90d3-1300b2bc8b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:02.131610 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432f209-67c0-453d-90d3-1300b2bc8b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:02.132402 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432f209-67c0-453d-90d3-1300b2bc8b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:02.134131 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432f209-67c0-453d-90d3-1300b2bc8b56 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:02.156256 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1251/2450] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:28:02.161611 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432f209-67c0-453d-90d3-1300b2bc8b56 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:02.165848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:02.175141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432f209-67c0-453d-90d3-1300b2bc8b56 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:02.180743 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e761c-2e10-492d-a3b9-ff869c134f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:02.182112 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e761c-2e10-492d-a3b9-ff869c134f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:02.182402 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e761c-2e10-492d-a3b9-ff869c134f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:02.182687 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e761c-2e10-492d-a3b9-ff869c134f5b admin admin] PATH_INFO: `/v3/projects/63591e64cf914abba82b9f5e490da6e1/users/416478160d3a4807959ffe00acc60cf1/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:02.199772 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e761c-2e10-492d-a3b9-ff869c134f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63591e64cf914abba82b9f5e490da6e1, user_id=416478160d3a4807959ffe00acc60cf1, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:02.202781 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e761c-2e10-492d-a3b9-ff869c134f5b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:02.212894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442d7da-af87-4208-b18e-a91baaf8bdd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:02.213550 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442d7da-af87-4208-b18e-a91baaf8bdd1 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:02.213832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442d7da-af87-4208-b18e-a91baaf8bdd1 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:02.214110 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442d7da-af87-4208-b18e-a91baaf8bdd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:02.215987 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b442d7da-af87-4208-b18e-a91baaf8bdd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:02.219458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1252/2451] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:28:02 2022] PUT /identity/v3/projects/63591e64cf914abba82b9f5e490da6e1/users/416478160d3a4807959ffe00acc60cf1/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:28:02.232824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a47f2-2093-49aa-ada6-bc07572e7fcb None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:02.233161 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a47f2-2093-49aa-ada6-bc07572e7fcb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:02.233907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a47f2-2093-49aa-ada6-bc07572e7fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:02.284728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-717a47f2-2093-49aa-ada6-bc07572e7fcb None None] MFA Rules not processed for user `416478160d3a4807959ffe00acc60cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:28:02.287372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-717a47f2-2093-49aa-ada6-bc07572e7fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:02.305646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442d7da-af87-4208-b18e-a91baaf8bdd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:02.307286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442d7da-af87-4208-b18e-a91baaf8bdd1 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:02.320354 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1200/2452] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:28:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:28:02.403357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1253/2453] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:28:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:28:02.419665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442d7da-af87-4208-b18e-a91baaf8bdd1 service nova] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:02.421165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b442d7da-af87-4208-b18e-a91baaf8bdd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:02.511309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442d7da-af87-4208-b18e-a91baaf8bdd1 service nova] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:02.644545 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b5cf9-80a4-4142-933f-cbb3f0cc64ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:02.650762 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b5cf9-80a4-4142-933f-cbb3f0cc64ff service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:02.651105 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b5cf9-80a4-4142-933f-cbb3f0cc64ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:02.652527 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b5cf9-80a4-4142-933f-cbb3f0cc64ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:02.677880 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b5cf9-80a4-4142-933f-cbb3f0cc64ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:02.679994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b5cf9-80a4-4142-933f-cbb3f0cc64ff service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:02.717367 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1201/2454] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:28:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:28:03.921025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fbfc7-3463-437a-8bd7-67dfc7e2560b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:03.921590 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fbfc7-3463-437a-8bd7-67dfc7e2560b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:03.921590 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fbfc7-3463-437a-8bd7-67dfc7e2560b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:03.954108 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-906fbfc7-3463-437a-8bd7-67dfc7e2560b None None] MFA Rules not processed for user `c6f04d09f9394463b55a08fa1623e439`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:28:03.956568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-906fbfc7-3463-437a-8bd7-67dfc7e2560b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:04.025719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1254/2455] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:28:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:28:04.484571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f8e2a-e53c-4640-8af4-b3dbbbe3b9b5 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:04.484571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f8e2a-e53c-4640-8af4-b3dbbbe3b9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:04.484571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f8e2a-e53c-4640-8af4-b3dbbbe3b9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:04.514123 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-228f8e2a-e53c-4640-8af4-b3dbbbe3b9b5 None None] MFA Rules not processed for user `416478160d3a4807959ffe00acc60cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:28:04.515988 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-228f8e2a-e53c-4640-8af4-b3dbbbe3b9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:04.530872 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1202/2456] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:28:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:28:14.018879 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=75,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:14.503220 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=85 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:20.962953 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2222bd-123f-4f43-8478-0deb04351ebe None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:20.963485 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2222bd-123f-4f43-8478-0deb04351ebe None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:20.963485 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2222bd-123f-4f43-8478-0deb04351ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:20.982739 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8e2222bd-123f-4f43-8478-0deb04351ebe None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:28:20.983948 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8e2222bd-123f-4f43-8478-0deb04351ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:21.046860 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1255/2457] 10.222.0.109 () {58 vars in 1017 bytes} [Thu Aug 4 10:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:28:21.073302 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f8e2a-e53c-4640-8af4-b3dbbbe3b9b5 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:21.075159 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-228f8e2a-e53c-4640-8af4-b3dbbbe3b9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:21.153713 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f8e2a-e53c-4640-8af4-b3dbbbe3b9b5 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:21.160100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e752cc8-c06c-4f85-9d5c-20708468bf48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:21.160775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e752cc8-c06c-4f85-9d5c-20708468bf48 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:21.161063 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e752cc8-c06c-4f85-9d5c-20708468bf48 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:21.161371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e752cc8-c06c-4f85-9d5c-20708468bf48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:21.170426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e752cc8-c06c-4f85-9d5c-20708468bf48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:21.172455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e752cc8-c06c-4f85-9d5c-20708468bf48 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:21.183462 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1203/2458] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:28:28.193901 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2222bd-123f-4f43-8478-0deb04351ebe None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:28.195611 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8e2222bd-123f-4f43-8478-0deb04351ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:28.272666 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2222bd-123f-4f43-8478-0deb04351ebe None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:28.277686 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a45fd0-a14d-4afe-8720-7f96dbd1f1f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0005b0c9582e430e9cb85704a4505bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:28.278313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a45fd0-a14d-4afe-8720-7f96dbd1f1f1 service placement] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:28.278592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a45fd0-a14d-4afe-8720-7f96dbd1f1f1 service placement] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:28.278865 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a45fd0-a14d-4afe-8720-7f96dbd1f1f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:28.280863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d2a45fd0-a14d-4afe-8720-7f96dbd1f1f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:28.293371 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a45fd0-a14d-4afe-8720-7f96dbd1f1f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:28.294884 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a45fd0-a14d-4afe-8720-7f96dbd1f1f1 service placement] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:28.305701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1256/2459] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:28:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:28:29.188152 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95022bee-bc2e-4d0d-9d87-953a40ca8dad None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:29.189319 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95022bee-bc2e-4d0d-9d87-953a40ca8dad None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:29.189457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95022bee-bc2e-4d0d-9d87-953a40ca8dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:29.210668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-95022bee-bc2e-4d0d-9d87-953a40ca8dad None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:28:29.211909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-95022bee-bc2e-4d0d-9d87-953a40ca8dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:29.220835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1204/2460] 10.222.0.109 () {58 vars in 1017 bytes} [Thu Aug 4 10:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:28:29.243540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a45fd0-a14d-4afe-8720-7f96dbd1f1f1 service placement] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:29.259695 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a45fd0-a14d-4afe-8720-7f96dbd1f1f1 service placement] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:29.265073 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dbc83-75a2-4900-8adc-baef40af56d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:29.265684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dbc83-75a2-4900-8adc-baef40af56d1 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:29.265964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dbc83-75a2-4900-8adc-baef40af56d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:29.266239 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dbc83-75a2-4900-8adc-baef40af56d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:29.275457 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dbc83-75a2-4900-8adc-baef40af56d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:29.277071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10dbc83-75a2-4900-8adc-baef40af56d1 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:29.287223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1257/2461] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:28:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:28:29.701665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f31f0-db19-4eea-8fc4-53b62bd5b559 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:29.701977 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f31f0-db19-4eea-8fc4-53b62bd5b559 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:29.702286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f31f0-db19-4eea-8fc4-53b62bd5b559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:29.723687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-501f31f0-db19-4eea-8fc4-53b62bd5b559 None None] MFA Rules not processed for user `306a5f4d7e0d44bd9a27145bd35a07fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:28:29.724968 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-501f31f0-db19-4eea-8fc4-53b62bd5b559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:29.784059 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1205/2462] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Aug 4 10:28:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:28:29.827817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dbc83-75a2-4900-8adc-baef40af56d1 service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:29.830164 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a10dbc83-75a2-4900-8adc-baef40af56d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:29.903778 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dbc83-75a2-4900-8adc-baef40af56d1 service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:29.909042 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eca6e-8b50-4f3c-b855-93d83d1a85a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878797620be54b74a3e8582c78ba78d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:29.909677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eca6e-8b50-4f3c-b855-93d83d1a85a6 service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:29.909959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eca6e-8b50-4f3c-b855-93d83d1a85a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:29.910234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eca6e-8b50-4f3c-b855-93d83d1a85a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:29.919793 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eca6e-8b50-4f3c-b855-93d83d1a85a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:29.921430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eca6e-8b50-4f3c-b855-93d83d1a85a6 service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:29.930647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1258/2463] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Aug 4 10:28:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 10:28:30.574655 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a34aec-721b-456d-b098-0e94411493c8 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:30.575163 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a34aec-721b-456d-b098-0e94411493c8 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:30.575163 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a34aec-721b-456d-b098-0e94411493c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:30.595935 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-84a34aec-721b-456d-b098-0e94411493c8 None None] MFA Rules not processed for user `306a5f4d7e0d44bd9a27145bd35a07fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:28:30.597330 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-84a34aec-721b-456d-b098-0e94411493c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:30.605308 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1206/2464] 10.222.0.48 () {58 vars in 967 bytes} [Thu Aug 4 10:28:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:28:30.618681 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eca6e-8b50-4f3c-b855-93d83d1a85a6 service swift] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:30.631665 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eca6e-8b50-4f3c-b855-93d83d1a85a6 service swift] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:30.637769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c3d4b-a0d4-4a46-be96-7d75d17ee463 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878797620be54b74a3e8582c78ba78d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:30.638406 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c3d4b-a0d4-4a46-be96-7d75d17ee463 service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:30.638694 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c3d4b-a0d4-4a46-be96-7d75d17ee463 service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:30.638975 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c3d4b-a0d4-4a46-be96-7d75d17ee463 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:30.646181 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:30.649439 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c3d4b-a0d4-4a46-be96-7d75d17ee463 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:30.651199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c3d4b-a0d4-4a46-be96-7d75d17ee463 service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:30.668232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1259/2465] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Aug 4 10:28:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 10:28:30.932633 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914646-d08b-46fa-800a-be907c3372b6 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:30.932922 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914646-d08b-46fa-800a-be907c3372b6 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:30.933206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914646-d08b-46fa-800a-be907c3372b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:30.953094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-86914646-d08b-46fa-800a-be907c3372b6 None None] MFA Rules not processed for user `306a5f4d7e0d44bd9a27145bd35a07fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:28:30.954858 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-86914646-d08b-46fa-800a-be907c3372b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:30.962362 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1207/2466] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Aug 4 10:28:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:28:30.975093 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c3d4b-a0d4-4a46-be96-7d75d17ee463 service swift] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:30.986524 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c3d4b-a0d4-4a46-be96-7d75d17ee463 service swift] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:30.991848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7c18d-2765-4aff-be17-14feeb359fdb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878797620be54b74a3e8582c78ba78d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:30.992498 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7c18d-2765-4aff-be17-14feeb359fdb service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:30.992822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7c18d-2765-4aff-be17-14feeb359fdb service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:30.993103 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7c18d-2765-4aff-be17-14feeb359fdb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:31.001810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7c18d-2765-4aff-be17-14feeb359fdb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:31.003437 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7c18d-2765-4aff-be17-14feeb359fdb service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:31.011872 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1260/2467] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Aug 4 10:28:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 10:28:31.409122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7da29-096b-494c-984c-17937021f8b5 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:31.409411 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7da29-096b-494c-984c-17937021f8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:31.409694 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7da29-096b-494c-984c-17937021f8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:31.431108 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-38d7da29-096b-494c-984c-17937021f8b5 None None] MFA Rules not processed for user `306a5f4d7e0d44bd9a27145bd35a07fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:28:31.432383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-38d7da29-096b-494c-984c-17937021f8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:31.441058 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1208/2468] 10.222.0.48 () {58 vars in 967 bytes} [Thu Aug 4 10:28:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:28:31.458950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7c18d-2765-4aff-be17-14feeb359fdb service swift] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:31.473890 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7c18d-2765-4aff-be17-14feeb359fdb service swift] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:31.479228 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a851916-c87c-4e33-9592-ad196bf1146b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878797620be54b74a3e8582c78ba78d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:31.479546 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a851916-c87c-4e33-9592-ad196bf1146b service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:31.479841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a851916-c87c-4e33-9592-ad196bf1146b service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:31.480114 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a851916-c87c-4e33-9592-ad196bf1146b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:31.490167 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a851916-c87c-4e33-9592-ad196bf1146b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:31.491780 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a851916-c87c-4e33-9592-ad196bf1146b service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:31.501067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1261/2469] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Aug 4 10:28:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 10:28:33.543700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b08325-e05d-46a8-8075-7bdba1f417fe None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:33.544383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b08325-e05d-46a8-8075-7bdba1f417fe None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:33.544383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b08325-e05d-46a8-8075-7bdba1f417fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:33.566133 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-e0b08325-e05d-46a8-8075-7bdba1f417fe None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:28:33.567394 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e0b08325-e05d-46a8-8075-7bdba1f417fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:33.582805 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1209/2470] 10.222.0.109 () {58 vars in 1017 bytes} [Thu Aug 4 10:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:28:33.604004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a851916-c87c-4e33-9592-ad196bf1146b service swift] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:33.616704 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a851916-c87c-4e33-9592-ad196bf1146b service swift] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:33.624361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764552e-ce66-4d83-87ef-580d99936522 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:33.625008 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764552e-ce66-4d83-87ef-580d99936522 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:33.625296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764552e-ce66-4d83-87ef-580d99936522 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:33.625578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764552e-ce66-4d83-87ef-580d99936522 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:33.636402 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764552e-ce66-4d83-87ef-580d99936522 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:33.638783 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764552e-ce66-4d83-87ef-580d99936522 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:33.650778 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1262/2471] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:28:33.709992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b08325-e05d-46a8-8075-7bdba1f417fe None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:33.721756 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b08325-e05d-46a8-8075-7bdba1f417fe None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:33.729358 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887ac7d-89f3-4552-b331-4bb693892fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:33.729878 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887ac7d-89f3-4552-b331-4bb693892fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:33.730235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887ac7d-89f3-4552-b331-4bb693892fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:33.730524 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887ac7d-89f3-4552-b331-4bb693892fc8 admin admin] PATH_INFO: `/v3/users/416478160d3a4807959ffe00acc60cf1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:33.731837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887ac7d-89f3-4552-b331-4bb693892fc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=416478160d3a4807959ffe00acc60cf1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:33.734091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887ac7d-89f3-4552-b331-4bb693892fc8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:33.822549 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c887ac7d-89f3-4552-b331-4bb693892fc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '416478160d3a4807959ffe00acc60cf1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:28:33.823259 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c887ac7d-89f3-4552-b331-4bb693892fc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '416478160d3a4807959ffe00acc60cf1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:28:33.829671 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:33.835733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c887ac7d-89f3-4552-b331-4bb693892fc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '416478160d3a4807959ffe00acc60cf1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:28:33.863801 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c887ac7d-89f3-4552-b331-4bb693892fc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '416478160d3a4807959ffe00acc60cf1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:28:33.878064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c887ac7d-89f3-4552-b331-4bb693892fc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '416478160d3a4807959ffe00acc60cf1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:28:33.889603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1210/2472] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:28:33 2022] DELETE /identity/v3/users/416478160d3a4807959ffe00acc60cf1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:28:33.894619 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c835a72-1ee1-4f12-964b-9fcf45637c7c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:33.895238 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c835a72-1ee1-4f12-964b-9fcf45637c7c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:33.895629 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c835a72-1ee1-4f12-964b-9fcf45637c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:33.926796 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-4c835a72-1ee1-4f12-964b-9fcf45637c7c None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:28:33.928395 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4c835a72-1ee1-4f12-964b-9fcf45637c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:34.000299 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1263/2473] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:28:34.012528 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887ac7d-89f3-4552-b331-4bb693892fc8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:34.014270 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c887ac7d-89f3-4552-b331-4bb693892fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:34.091832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887ac7d-89f3-4552-b331-4bb693892fc8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:34.095733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee8f7a-2432-4214-9361-788248bbb8f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:34.096400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee8f7a-2432-4214-9361-788248bbb8f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:34.096692 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee8f7a-2432-4214-9361-788248bbb8f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:34.096995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee8f7a-2432-4214-9361-788248bbb8f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:34.106475 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee8f7a-2432-4214-9361-788248bbb8f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:34.107959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee8f7a-2432-4214-9361-788248bbb8f6 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:34.119528 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1211/2474] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:28:34.292503 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c835a72-1ee1-4f12-964b-9fcf45637c7c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:34.293946 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4c835a72-1ee1-4f12-964b-9fcf45637c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:34.307728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c835a72-1ee1-4f12-964b-9fcf45637c7c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:34.312446 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a523bc-553c-4de0-8b92-33fc3cb1f547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:34.313115 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a523bc-553c-4de0-8b92-33fc3cb1f547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:34.313605 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a523bc-553c-4de0-8b92-33fc3cb1f547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:34.313878 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a523bc-553c-4de0-8b92-33fc3cb1f547 admin admin] PATH_INFO: `/v3/projects/63591e64cf914abba82b9f5e490da6e1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:34.315105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a523bc-553c-4de0-8b92-33fc3cb1f547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63591e64cf914abba82b9f5e490da6e1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:34.317070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a523bc-553c-4de0-8b92-33fc3cb1f547 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:34.366718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-35a523bc-553c-4de0-8b92-33fc3cb1f547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63591e64cf914abba82b9f5e490da6e1', 'request_id': 'req-35a523bc-553c-4de0-8b92-33fc3cb1f547'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:28:34.373053 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-35a523bc-553c-4de0-8b92-33fc3cb1f547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63591e64cf914abba82b9f5e490da6e1', 'request_id': 'req-35a523bc-553c-4de0-8b92-33fc3cb1f547'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:28:34.380811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-35a523bc-553c-4de0-8b92-33fc3cb1f547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63591e64cf914abba82b9f5e490da6e1', 'request_id': 'req-35a523bc-553c-4de0-8b92-33fc3cb1f547'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:28:34.391242 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-35a523bc-553c-4de0-8b92-33fc3cb1f547 admin admin] The token cache is being invalidate because project 63591e64cf914abba82b9f5e490da6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:28:34.391590 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-35a523bc-553c-4de0-8b92-33fc3cb1f547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:28:34.392342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-35a523bc-553c-4de0-8b92-33fc3cb1f547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:28:34.393907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1264/2475] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:28:34 2022] DELETE /identity/v3/projects/63591e64cf914abba82b9f5e490da6e1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:28:37.632772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1f18f-e684-4b96-b8c6-8933ce4c73ce None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:37.633286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1f18f-e684-4b96-b8c6-8933ce4c73ce None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:37.633384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1f18f-e684-4b96-b8c6-8933ce4c73ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:37.655125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7bf1f18f-e684-4b96-b8c6-8933ce4c73ce None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:28:37.656429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7bf1f18f-e684-4b96-b8c6-8933ce4c73ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:37.720827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1212/2476] 10.222.0.109 () {58 vars in 1017 bytes} [Thu Aug 4 10:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:28:37.744576 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a523bc-553c-4de0-8b92-33fc3cb1f547 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:37.746440 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-35a523bc-553c-4de0-8b92-33fc3cb1f547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:37.797094 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:37.836127 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a523bc-553c-4de0-8b92-33fc3cb1f547 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:37.842335 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d28867-517a-4b6e-90a6-7c8a05fe4e12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:37.843053 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d28867-517a-4b6e-90a6-7c8a05fe4e12 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:37.843340 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d28867-517a-4b6e-90a6-7c8a05fe4e12 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:37.843623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d28867-517a-4b6e-90a6-7c8a05fe4e12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:37.854739 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d28867-517a-4b6e-90a6-7c8a05fe4e12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:37.856412 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d28867-517a-4b6e-90a6-7c8a05fe4e12 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:37.867205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1265/2477] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:28:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:28:44.938763 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee27b99-e6f4-42b4-bb19-7eea3d3ba34a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:44.939332 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee27b99-e6f4-42b4-bb19-7eea3d3ba34a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:44.939903 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee27b99-e6f4-42b4-bb19-7eea3d3ba34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:44.961030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3ee27b99-e6f4-42b4-bb19-7eea3d3ba34a None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:28:44.962086 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3ee27b99-e6f4-42b4-bb19-7eea3d3ba34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:44.970998 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1213/2478] 10.222.0.109 () {58 vars in 1017 bytes} [Thu Aug 4 10:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:28:44.996277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d28867-517a-4b6e-90a6-7c8a05fe4e12 service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:45.008126 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d28867-517a-4b6e-90a6-7c8a05fe4e12 service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:45.013653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e092123-59a3-41c1-b755-ba7bfc020493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:45.014292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e092123-59a3-41c1-b755-ba7bfc020493 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:45.014578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e092123-59a3-41c1-b755-ba7bfc020493 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:45.014861 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e092123-59a3-41c1-b755-ba7bfc020493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:45.023709 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e092123-59a3-41c1-b755-ba7bfc020493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:45.025373 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e092123-59a3-41c1-b755-ba7bfc020493 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:45.035727 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1266/2479] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:28:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:28:48.325605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee27b99-e6f4-42b4-bb19-7eea3d3ba34a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:48.327046 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3ee27b99-e6f4-42b4-bb19-7eea3d3ba34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:48.386150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee27b99-e6f4-42b4-bb19-7eea3d3ba34a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:48.389802 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d057c5-9685-4adc-a131-df90a93c65dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:48.390433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d057c5-9685-4adc-a131-df90a93c65dd service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:48.390720 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d057c5-9685-4adc-a131-df90a93c65dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:48.391000 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d057c5-9685-4adc-a131-df90a93c65dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:48.393096 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-02d057c5-9685-4adc-a131-df90a93c65dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:48.415200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:28:48.466666 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d057c5-9685-4adc-a131-df90a93c65dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:48.468183 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d057c5-9685-4adc-a131-df90a93c65dd service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:48.479379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1214/2480] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:28:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:28:50.169356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e60c7f-3b3f-4823-9716-b660b0aee5d4 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:50.169908 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e60c7f-3b3f-4823-9716-b660b0aee5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:50.169908 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e60c7f-3b3f-4823-9716-b660b0aee5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:50.191297 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-44e60c7f-3b3f-4823-9716-b660b0aee5d4 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:28:50.192576 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-44e60c7f-3b3f-4823-9716-b660b0aee5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:50.201626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1267/2481] 10.222.0.109 () {58 vars in 1017 bytes} [Thu Aug 4 10:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:28:50.232846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d057c5-9685-4adc-a131-df90a93c65dd service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:28:50.234364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-02d057c5-9685-4adc-a131-df90a93c65dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:28:50.250273 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d057c5-9685-4adc-a131-df90a93c65dd service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:28:50.256839 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff79f6-cd5e-4683-99ff-3a7156114fb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:28:50.257472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff79f6-cd5e-4683-99ff-3a7156114fb8 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:28:50.257762 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff79f6-cd5e-4683-99ff-3a7156114fb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:28:50.258044 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff79f6-cd5e-4683-99ff-3a7156114fb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:28:50.267502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff79f6-cd5e-4683-99ff-3a7156114fb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:28:50.269166 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff79f6-cd5e-4683-99ff-3a7156114fb8 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:28:50.291486 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1215/2482] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:29:00.185748 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=26 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:00.286659 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=26 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:07.592921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589cdda-cf6d-492c-b7e8-c3fd628e0bd8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:29:07.593468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589cdda-cf6d-492c-b7e8-c3fd628e0bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:29:07.593573 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589cdda-cf6d-492c-b7e8-c3fd628e0bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:29:07.613844 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b589cdda-cf6d-492c-b7e8-c3fd628e0bd8 None None] MFA Rules not processed for user `a1f98d6cc4c94b4d8e92481a5a08ac15`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:29:07.615055 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b589cdda-cf6d-492c-b7e8-c3fd628e0bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:29:07.675394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1268/2483] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:29:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:29:17.668226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=25 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:24.279272 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac1dfa-2df3-447a-a02c-fa1e6c2f8f43 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:29:24.279881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac1dfa-2df3-447a-a02c-fa1e6c2f8f43 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:29:24.279881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac1dfa-2df3-447a-a02c-fa1e6c2f8f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:29:24.301164 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-50ac1dfa-2df3-447a-a02c-fa1e6c2f8f43 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:29:24.302369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-50ac1dfa-2df3-447a-a02c-fa1e6c2f8f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:29:24.310179 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1216/2484] 10.222.0.109 () {58 vars in 1017 bytes} [Thu Aug 4 10:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:29:24.347732 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589cdda-cf6d-492c-b7e8-c3fd628e0bd8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:29:24.361127 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589cdda-cf6d-492c-b7e8-c3fd628e0bd8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:29:24.366508 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3ff87-7d2c-40c3-8b02-9fcad1c46c15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:29:24.367127 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3ff87-7d2c-40c3-8b02-9fcad1c46c15 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:29:24.367407 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3ff87-7d2c-40c3-8b02-9fcad1c46c15 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:29:24.367681 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3ff87-7d2c-40c3-8b02-9fcad1c46c15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:29:24.376947 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3ff87-7d2c-40c3-8b02-9fcad1c46c15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:29:24.378556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3ff87-7d2c-40c3-8b02-9fcad1c46c15 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:29:24.388223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1269/2485] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:29:28.565278 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0d285-31a3-4add-a9df-1133221adb67 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:29:28.565886 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0d285-31a3-4add-a9df-1133221adb67 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:29:28.565886 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0d285-31a3-4add-a9df-1133221adb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:29:28.585884 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a0c0d285-31a3-4add-a9df-1133221adb67 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:29:28.587095 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a0c0d285-31a3-4add-a9df-1133221adb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:29:28.595046 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1217/2486] 10.222.0.109 () {58 vars in 1017 bytes} [Thu Aug 4 10:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:29:28.630559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3ff87-7d2c-40c3-8b02-9fcad1c46c15 service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:29:28.641961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3ff87-7d2c-40c3-8b02-9fcad1c46c15 service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:29:28.647449 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11044abc-926e-4113-97b6-c974c7a32113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:29:28.648083 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11044abc-926e-4113-97b6-c974c7a32113 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:29:28.648393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11044abc-926e-4113-97b6-c974c7a32113 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:29:28.648668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11044abc-926e-4113-97b6-c974c7a32113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:29:28.657224 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11044abc-926e-4113-97b6-c974c7a32113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:29:28.658824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11044abc-926e-4113-97b6-c974c7a32113 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:29:28.673086 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1270/2487] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:29:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:29:32.684349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413ad87-3d00-47cb-8175-4f7f35c2770b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:29:32.684946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413ad87-3d00-47cb-8175-4f7f35c2770b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:29:32.684946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413ad87-3d00-47cb-8175-4f7f35c2770b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:29:32.705800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d413ad87-3d00-47cb-8175-4f7f35c2770b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:29:32.706506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d413ad87-3d00-47cb-8175-4f7f35c2770b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:29:32.714366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1218/2488] 10.222.0.109 () {58 vars in 1017 bytes} [Thu Aug 4 10:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:29:32.753025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11044abc-926e-4113-97b6-c974c7a32113 service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:29:32.764272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11044abc-926e-4113-97b6-c974c7a32113 service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:29:32.770320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfbc10-4b63-4b4f-a0df-55150ab67713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:29:32.770870 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfbc10-4b63-4b4f-a0df-55150ab67713 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:29:32.771148 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfbc10-4b63-4b4f-a0df-55150ab67713 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:29:32.771420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfbc10-4b63-4b4f-a0df-55150ab67713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:29:32.780426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfbc10-4b63-4b4f-a0df-55150ab67713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:29:32.782582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfbc10-4b63-4b4f-a0df-55150ab67713 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:29:32.792837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1271/2489] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:29:36.862300 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898be058-56fe-4ba4-a33d-c42155465995 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:29:36.862864 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898be058-56fe-4ba4-a33d-c42155465995 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:29:36.862864 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898be058-56fe-4ba4-a33d-c42155465995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:29:36.882285 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-898be058-56fe-4ba4-a33d-c42155465995 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:29:36.883543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-898be058-56fe-4ba4-a33d-c42155465995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:29:36.892103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1219/2490] 10.222.0.109 () {58 vars in 1017 bytes} [Thu Aug 4 10:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:29:36.918849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfbc10-4b63-4b4f-a0df-55150ab67713 service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:29:36.930852 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfbc10-4b63-4b4f-a0df-55150ab67713 service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:29:36.936352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acad68-101c-4f38-87d1-d7ba4d42a2e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:29:36.936999 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acad68-101c-4f38-87d1-d7ba4d42a2e5 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:29:36.938017 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acad68-101c-4f38-87d1-d7ba4d42a2e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:29:36.938296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acad68-101c-4f38-87d1-d7ba4d42a2e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:29:36.946926 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34acad68-101c-4f38-87d1-d7ba4d42a2e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:29:36.948548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34acad68-101c-4f38-87d1-d7ba4d42a2e5 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:29:36.958412 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1272/2491] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:29:41.071697 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417e6de-d92d-4ccf-8ed9-b5974209a631 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:29:41.072326 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417e6de-d92d-4ccf-8ed9-b5974209a631 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:29:41.072326 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417e6de-d92d-4ccf-8ed9-b5974209a631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:29:41.095078 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c417e6de-d92d-4ccf-8ed9-b5974209a631 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:29:41.096355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c417e6de-d92d-4ccf-8ed9-b5974209a631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:29:41.104981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1220/2492] 10.222.0.109 () {58 vars in 1017 bytes} [Thu Aug 4 10:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:29:41.129440 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acad68-101c-4f38-87d1-d7ba4d42a2e5 service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:29:41.141447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acad68-101c-4f38-87d1-d7ba4d42a2e5 service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:29:41.148195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b464b-c194-42d7-89f9-e5308c049eba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:29:41.148848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b464b-c194-42d7-89f9-e5308c049eba service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:29:41.149128 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b464b-c194-42d7-89f9-e5308c049eba service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:29:41.149404 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b464b-c194-42d7-89f9-e5308c049eba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:29:41.159040 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b464b-c194-42d7-89f9-e5308c049eba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:29:41.160720 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b464b-c194-42d7-89f9-e5308c049eba service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:29:41.172118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1273/2493] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:29:51.089038 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=15 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:51.166613 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=30 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:29:56.591161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149828e-a69c-47cd-a48c-f4252e289d1d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:29:56.591815 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149828e-a69c-47cd-a48c-f4252e289d1d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:29:56.591815 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149828e-a69c-47cd-a48c-f4252e289d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:29:56.613182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3149828e-a69c-47cd-a48c-f4252e289d1d None None] MFA Rules not processed for user `9c26da44165845babfb18a1c6ae51d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:29:56.614427 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3149828e-a69c-47cd-a48c-f4252e289d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:29:56.678108 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1221/2494] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:29:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:30:06.669724 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=25 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:09.590051 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b464b-c194-42d7-89f9-e5308c049eba service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:30:09.601502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b464b-c194-42d7-89f9-e5308c049eba service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:30:09.606660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4dffe-8bc9-4a9e-b1a6-47c96373d075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:30:09.607337 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4dffe-8bc9-4a9e-b1a6-47c96373d075 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:09.607748 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4dffe-8bc9-4a9e-b1a6-47c96373d075 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:09.608028 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4dffe-8bc9-4a9e-b1a6-47c96373d075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:09.610216 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-94f4dffe-8bc9-4a9e-b1a6-47c96373d075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:30:09.627803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4dffe-8bc9-4a9e-b1a6-47c96373d075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:30:09.629455 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4dffe-8bc9-4a9e-b1a6-47c96373d075 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:30:09.643362 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1274/2495] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:30:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:30:13.260422 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149828e-a69c-47cd-a48c-f4252e289d1d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:30:13.261999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3149828e-a69c-47cd-a48c-f4252e289d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:30:13.277917 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149828e-a69c-47cd-a48c-f4252e289d1d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:30:13.281030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f77232-9e27-492c-8ab0-ae004d6a23f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:30:13.282031 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f77232-9e27-492c-8ab0-ae004d6a23f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:13.282355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f77232-9e27-492c-8ab0-ae004d6a23f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:13.282630 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f77232-9e27-492c-8ab0-ae004d6a23f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:13.284627 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-16f77232-9e27-492c-8ab0-ae004d6a23f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:30:13.300154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f77232-9e27-492c-8ab0-ae004d6a23f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:30:13.301874 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f77232-9e27-492c-8ab0-ae004d6a23f1 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:30:13.314077 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1222/2496] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:30:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:30:18.047627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4dffe-8bc9-4a9e-b1a6-47c96373d075 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:30:18.053146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-94f4dffe-8bc9-4a9e-b1a6-47c96373d075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:30:18.069561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4dffe-8bc9-4a9e-b1a6-47c96373d075 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:30:18.074444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d223e-a0b9-48ba-9bfe-1dba72e0b26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:30:18.075161 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d223e-a0b9-48ba-9bfe-1dba72e0b26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:18.075442 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d223e-a0b9-48ba-9bfe-1dba72e0b26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:18.075982 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d223e-a0b9-48ba-9bfe-1dba72e0b26e admin admin] PATH_INFO: `/v3/users/a1f98d6cc4c94b4d8e92481a5a08ac15` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:18.077316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d223e-a0b9-48ba-9bfe-1dba72e0b26e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f98d6cc4c94b4d8e92481a5a08ac15)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:30:18.079250 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d223e-a0b9-48ba-9bfe-1dba72e0b26e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:30:18.147797 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e56d223e-a0b9-48ba-9bfe-1dba72e0b26e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f98d6cc4c94b4d8e92481a5a08ac15'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:18.148706 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e56d223e-a0b9-48ba-9bfe-1dba72e0b26e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f98d6cc4c94b4d8e92481a5a08ac15'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:18.158987 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e56d223e-a0b9-48ba-9bfe-1dba72e0b26e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f98d6cc4c94b4d8e92481a5a08ac15'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:18.159738 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e56d223e-a0b9-48ba-9bfe-1dba72e0b26e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f98d6cc4c94b4d8e92481a5a08ac15'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:18.175550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e56d223e-a0b9-48ba-9bfe-1dba72e0b26e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f98d6cc4c94b4d8e92481a5a08ac15'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:18.196671 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1275/2497] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:30:18 2022] DELETE /identity/v3/users/a1f98d6cc4c94b4d8e92481a5a08ac15 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:30:18.449780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f77232-9e27-492c-8ab0-ae004d6a23f1 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:30:18.464349 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f77232-9e27-492c-8ab0-ae004d6a23f1 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:30:18.533549 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b386e0b-6ac0-4a3f-beec-7fd46b589614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:30:18.534296 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b386e0b-6ac0-4a3f-beec-7fd46b589614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:18.534661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b386e0b-6ac0-4a3f-beec-7fd46b589614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:18.535000 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b386e0b-6ac0-4a3f-beec-7fd46b589614 admin admin] PATH_INFO: `/v3/projects/2aee265fc196454fb68ea3d997da52c6` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:18.536344 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b386e0b-6ac0-4a3f-beec-7fd46b589614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aee265fc196454fb68ea3d997da52c6)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:30:18.538494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b386e0b-6ac0-4a3f-beec-7fd46b589614 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:30:18.601458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7b386e0b-6ac0-4a3f-beec-7fd46b589614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aee265fc196454fb68ea3d997da52c6', 'request_id': 'req-7b386e0b-6ac0-4a3f-beec-7fd46b589614'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:18.610561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7b386e0b-6ac0-4a3f-beec-7fd46b589614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aee265fc196454fb68ea3d997da52c6', 'request_id': 'req-7b386e0b-6ac0-4a3f-beec-7fd46b589614'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:18.623368 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7b386e0b-6ac0-4a3f-beec-7fd46b589614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aee265fc196454fb68ea3d997da52c6', 'request_id': 'req-7b386e0b-6ac0-4a3f-beec-7fd46b589614'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:18.644101 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7b386e0b-6ac0-4a3f-beec-7fd46b589614 admin admin] The token cache is being invalidate because project 2aee265fc196454fb68ea3d997da52c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:30:18.644705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7b386e0b-6ac0-4a3f-beec-7fd46b589614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:18.645793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7b386e0b-6ac0-4a3f-beec-7fd46b589614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:18.648485 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1223/2498] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:30:18 2022] DELETE /identity/v3/projects/2aee265fc196454fb68ea3d997da52c6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:30:18.653733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab064b3-7108-4a79-a8e7-9f4e06f6f23d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:18.658136 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab064b3-7108-4a79-a8e7-9f4e06f6f23d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:18.658136 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab064b3-7108-4a79-a8e7-9f4e06f6f23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:18.676543 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-cab064b3-7108-4a79-a8e7-9f4e06f6f23d None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:30:18.677786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-cab064b3-7108-4a79-a8e7-9f4e06f6f23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:30:18.755005 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1276/2499] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:30:18.764235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ae5f7-09c5-46e2-b34c-ec877283b774 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:18.764599 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ae5f7-09c5-46e2-b34c-ec877283b774 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:18.764887 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ae5f7-09c5-46e2-b34c-ec877283b774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:18.787526 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4d5ae5f7-09c5-46e2-b34c-ec877283b774 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:30:18.788956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4d5ae5f7-09c5-46e2-b34c-ec877283b774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:30:18.798269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1224/2500] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:30:18.803172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab064b3-7108-4a79-a8e7-9f4e06f6f23d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:30:18.815017 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab064b3-7108-4a79-a8e7-9f4e06f6f23d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:30:18.820021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d25c1-75bd-4240-91a7-928f1daa6a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:30:18.820735 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d25c1-75bd-4240-91a7-928f1daa6a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:18.821087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d25c1-75bd-4240-91a7-928f1daa6a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:18.821369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d25c1-75bd-4240-91a7-928f1daa6a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:18.822066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d25c1-75bd-4240-91a7-928f1daa6a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:30:18.822387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d25c1-75bd-4240-91a7-928f1daa6a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:30:18.824126 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d25c1-75bd-4240-91a7-928f1daa6a5a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:30:18.840458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1277/2501] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:30:18.845556 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ae5f7-09c5-46e2-b34c-ec877283b774 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:30:18.856935 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ae5f7-09c5-46e2-b34c-ec877283b774 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:30:18.863512 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4f63c-d161-4d5e-a42c-e7a59e2dd7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:30:18.864154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4f63c-d161-4d5e-a42c-e7a59e2dd7eb admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:18.864473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4f63c-d161-4d5e-a42c-e7a59e2dd7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:18.864755 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4f63c-d161-4d5e-a42c-e7a59e2dd7eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:18.865533 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4f63c-d161-4d5e-a42c-e7a59e2dd7eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:30:18.867540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4f63c-d161-4d5e-a42c-e7a59e2dd7eb admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:30:18.901105 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1225/2502] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:30:18 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:30:18.907133 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d25c1-75bd-4240-91a7-928f1daa6a5a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:30:18.928155 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d25c1-75bd-4240-91a7-928f1daa6a5a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:30:18.997576 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:19.015766 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f0942-e249-425b-9e6c-6f818365417e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:30:19.016492 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f0942-e249-425b-9e6c-6f818365417e admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:19.016889 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f0942-e249-425b-9e6c-6f818365417e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:19.017177 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f0942-e249-425b-9e6c-6f818365417e admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:19.017993 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f0942-e249-425b-9e6c-6f818365417e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:30:19.020316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f0942-e249-425b-9e6c-6f818365417e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:30:19.046759 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1278/2503] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:30:18 2022] POST /identity/v3/users => generated 296 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:30:19.052131 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4f63c-d161-4d5e-a42c-e7a59e2dd7eb admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:30:19.066853 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4f63c-d161-4d5e-a42c-e7a59e2dd7eb admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:30:19.072890 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a1d8e-940c-40a3-bf31-15cc32d19900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:30:19.073537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a1d8e-940c-40a3-bf31-15cc32d19900 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:19.073820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a1d8e-940c-40a3-bf31-15cc32d19900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:19.074102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a1d8e-940c-40a3-bf31-15cc32d19900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:19.074902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a1d8e-940c-40a3-bf31-15cc32d19900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:30:19.077554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a1d8e-940c-40a3-bf31-15cc32d19900 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:30:19.090099 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1226/2504] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:30:19.094940 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f0942-e249-425b-9e6c-6f818365417e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:30:19.106408 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f0942-e249-425b-9e6c-6f818365417e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:30:19.111798 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9139eb2-3613-4343-be83-c51aec9cde7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:30:19.112501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9139eb2-3613-4343-be83-c51aec9cde7e admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:19.112951 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9139eb2-3613-4343-be83-c51aec9cde7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:19.113236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9139eb2-3613-4343-be83-c51aec9cde7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:19.114010 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9139eb2-3613-4343-be83-c51aec9cde7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:30:19.115747 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9139eb2-3613-4343-be83-c51aec9cde7e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:30:19.128636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1279/2505] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:30:19.133616 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a1d8e-940c-40a3-bf31-15cc32d19900 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:30:19.150429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a1d8e-940c-40a3-bf31-15cc32d19900 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:30:19.157915 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5076fa-3e90-447e-a6c2-a931833d3b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:30:19.158810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5076fa-3e90-447e-a6c2-a931833d3b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:19.159129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5076fa-3e90-447e-a6c2-a931833d3b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:19.159509 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5076fa-3e90-447e-a6c2-a931833d3b3a admin admin] PATH_INFO: `/v3/projects/d22b081412494427918c07c6f4df0402/users/9269e6469f914b93bc5b271eb058cc5e/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:19.176831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5076fa-3e90-447e-a6c2-a931833d3b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22b081412494427918c07c6f4df0402, user_id=9269e6469f914b93bc5b271eb058cc5e, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:30:19.179497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5076fa-3e90-447e-a6c2-a931833d3b3a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:30:19.196490 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1227/2506] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:30:19 2022] PUT /identity/v3/projects/d22b081412494427918c07c6f4df0402/users/9269e6469f914b93bc5b271eb058cc5e/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:30:19.279520 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0341c-118e-4c7e-ba58-2ccdbcd3a835 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:19.279729 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0341c-118e-4c7e-ba58-2ccdbcd3a835 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:19.280046 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0341c-118e-4c7e-ba58-2ccdbcd3a835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:19.310725 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-90b0341c-118e-4c7e-ba58-2ccdbcd3a835 None None] MFA Rules not processed for user `9269e6469f914b93bc5b271eb058cc5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:30:19.312896 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-90b0341c-118e-4c7e-ba58-2ccdbcd3a835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:30:19.400384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1280/2507] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:30:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:30:19.414653 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5076fa-3e90-447e-a6c2-a931833d3b3a admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:30:19.416612 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cf5076fa-3e90-447e-a6c2-a931833d3b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:30:19.437529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:19.501526 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5076fa-3e90-447e-a6c2-a931833d3b3a admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:30:19.505481 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14204ce-e6c1-4e68-99a2-3c56efa582a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:30:19.506130 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14204ce-e6c1-4e68-99a2-3c56efa582a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:19.506419 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14204ce-e6c1-4e68-99a2-3c56efa582a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:19.506713 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14204ce-e6c1-4e68-99a2-3c56efa582a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:19.517412 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14204ce-e6c1-4e68-99a2-3c56efa582a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:30:19.518882 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14204ce-e6c1-4e68-99a2-3c56efa582a4 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:30:19.529382 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1228/2508] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:30:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:30:20.956368 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0341c-118e-4c7e-ba58-2ccdbcd3a835 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:30:20.957962 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-90b0341c-118e-4c7e-ba58-2ccdbcd3a835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:30:21.048900 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0341c-118e-4c7e-ba58-2ccdbcd3a835 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:30:21.054696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941862a-e13f-42b5-bc58-d1fdea832bf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:30:21.055329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941862a-e13f-42b5-bc58-d1fdea832bf6 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:21.055607 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941862a-e13f-42b5-bc58-d1fdea832bf6 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:21.055885 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941862a-e13f-42b5-bc58-d1fdea832bf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:21.057695 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7941862a-e13f-42b5-bc58-d1fdea832bf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:30:21.117330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:21.130195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941862a-e13f-42b5-bc58-d1fdea832bf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:30:21.132490 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941862a-e13f-42b5-bc58-d1fdea832bf6 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:30:21.144967 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1281/2509] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:30:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:30:29.524598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=20 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:29.981903 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14204ce-e6c1-4e68-99a2-3c56efa582a4 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:30:30.044657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14204ce-e6c1-4e68-99a2-3c56efa582a4 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:30:30.049911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5d5c3-d791-4169-91a1-944c487ae7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:30:30.050554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5d5c3-d791-4169-91a1-944c487ae7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:30.050837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5d5c3-d791-4169-91a1-944c487ae7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:30.051114 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5d5c3-d791-4169-91a1-944c487ae7bc admin admin] PATH_INFO: `/v3/users/9269e6469f914b93bc5b271eb058cc5e` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:30.052297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5d5c3-d791-4169-91a1-944c487ae7bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9269e6469f914b93bc5b271eb058cc5e)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:30:30.054268 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5d5c3-d791-4169-91a1-944c487ae7bc admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:30:30.101270 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-98f5d5c3-d791-4169-91a1-944c487ae7bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9269e6469f914b93bc5b271eb058cc5e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:30.101911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-98f5d5c3-d791-4169-91a1-944c487ae7bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9269e6469f914b93bc5b271eb058cc5e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:30.109271 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-98f5d5c3-d791-4169-91a1-944c487ae7bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9269e6469f914b93bc5b271eb058cc5e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:30.121413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-98f5d5c3-d791-4169-91a1-944c487ae7bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9269e6469f914b93bc5b271eb058cc5e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:30.129541 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-98f5d5c3-d791-4169-91a1-944c487ae7bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9269e6469f914b93bc5b271eb058cc5e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:30.135514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1229/2510] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:30:29 2022] DELETE /identity/v3/users/9269e6469f914b93bc5b271eb058cc5e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:30:30.140234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f137055-a41c-4100-a82d-428618e04424 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:30.140758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f137055-a41c-4100-a82d-428618e04424 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:30.140888 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f137055-a41c-4100-a82d-428618e04424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:30.161363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7f137055-a41c-4100-a82d-428618e04424 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:30:30.162591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7f137055-a41c-4100-a82d-428618e04424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:30:30.231429 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1282/2511] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:30:30.241832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5d5c3-d791-4169-91a1-944c487ae7bc admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:30:30.243312 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-98f5d5c3-d791-4169-91a1-944c487ae7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:30:30.305712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5d5c3-d791-4169-91a1-944c487ae7bc admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:30:30.309466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49637b35-1acb-488c-ba9f-565281ab6782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:30:30.310092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49637b35-1acb-488c-ba9f-565281ab6782 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:30.310379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49637b35-1acb-488c-ba9f-565281ab6782 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:30.310659 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49637b35-1acb-488c-ba9f-565281ab6782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:30.320848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49637b35-1acb-488c-ba9f-565281ab6782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:30:30.322661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49637b35-1acb-488c-ba9f-565281ab6782 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:30:30.333885 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1230/2512] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:30:30.627535 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f137055-a41c-4100-a82d-428618e04424 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:30:30.629065 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7f137055-a41c-4100-a82d-428618e04424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:30:30.642247 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f137055-a41c-4100-a82d-428618e04424 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:30:30.647846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41944b-51ed-4007-b414-3f0870a72c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:30:30.648741 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41944b-51ed-4007-b414-3f0870a72c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:30:30.649022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41944b-51ed-4007-b414-3f0870a72c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:30:30.649292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41944b-51ed-4007-b414-3f0870a72c40 admin admin] PATH_INFO: `/v3/projects/d22b081412494427918c07c6f4df0402` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:30:30.650649 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41944b-51ed-4007-b414-3f0870a72c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d22b081412494427918c07c6f4df0402)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:30:30.653599 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41944b-51ed-4007-b414-3f0870a72c40 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:30:30.704568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3c41944b-51ed-4007-b414-3f0870a72c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22b081412494427918c07c6f4df0402', 'request_id': 'req-3c41944b-51ed-4007-b414-3f0870a72c40'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:30.711186 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3c41944b-51ed-4007-b414-3f0870a72c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22b081412494427918c07c6f4df0402', 'request_id': 'req-3c41944b-51ed-4007-b414-3f0870a72c40'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:30.719334 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3c41944b-51ed-4007-b414-3f0870a72c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22b081412494427918c07c6f4df0402', 'request_id': 'req-3c41944b-51ed-4007-b414-3f0870a72c40'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:30.730285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3c41944b-51ed-4007-b414-3f0870a72c40 admin admin] The token cache is being invalidate because project d22b081412494427918c07c6f4df0402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:30:30.730577 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3c41944b-51ed-4007-b414-3f0870a72c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:30.731248 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3c41944b-51ed-4007-b414-3f0870a72c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:30:30.732818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1283/2513] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:30:30 2022] DELETE /identity/v3/projects/d22b081412494427918c07c6f4df0402 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:30:40.328951 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:40.727063 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:59.942993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49637b35-1acb-488c-ba9f-565281ab6782 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:30:59.944468 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-49637b35-1acb-488c-ba9f-565281ab6782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:00.002126 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49637b35-1acb-488c-ba9f-565281ab6782 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:00.051139 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a9e1b-de2d-4206-a975-ad7a05c95a0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:00.051772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a9e1b-de2d-4206-a975-ad7a05c95a0c service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:00.052088 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a9e1b-de2d-4206-a975-ad7a05c95a0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:00.052406 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a9e1b-de2d-4206-a975-ad7a05c95a0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:00.054216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-756a9e1b-de2d-4206-a975-ad7a05c95a0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:00.113809 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a9e1b-de2d-4206-a975-ad7a05c95a0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:00.115274 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a9e1b-de2d-4206-a975-ad7a05c95a0c service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:00.125169 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1231/2514] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:30:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:31:06.575243 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41944b-51ed-4007-b414-3f0870a72c40 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:06.579416 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3c41944b-51ed-4007-b414-3f0870a72c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:06.691028 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41944b-51ed-4007-b414-3f0870a72c40 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:06.701036 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141270e-73a7-4fe2-9426-eb40b414e8a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:06.702747 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141270e-73a7-4fe2-9426-eb40b414e8a5 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:06.703049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141270e-73a7-4fe2-9426-eb40b414e8a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:06.703334 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141270e-73a7-4fe2-9426-eb40b414e8a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:06.705561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c141270e-73a7-4fe2-9426-eb40b414e8a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:06.720195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141270e-73a7-4fe2-9426-eb40b414e8a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:06.722002 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141270e-73a7-4fe2-9426-eb40b414e8a5 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:06.745090 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1284/2515] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:31:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:31:09.395856 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a9e1b-de2d-4206-a975-ad7a05c95a0c service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:09.397339 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-756a9e1b-de2d-4206-a975-ad7a05c95a0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:09.472343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a9e1b-de2d-4206-a975-ad7a05c95a0c service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:09.476211 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9571e-6513-4018-811d-1ca9bf1e8f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:09.477743 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9571e-6513-4018-811d-1ca9bf1e8f81 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:09.477743 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9571e-6513-4018-811d-1ca9bf1e8f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:09.477743 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9571e-6513-4018-811d-1ca9bf1e8f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:09.480066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-89f9571e-6513-4018-811d-1ca9bf1e8f81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:09.491611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9571e-6513-4018-811d-1ca9bf1e8f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:09.493343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9571e-6513-4018-811d-1ca9bf1e8f81 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:09.504154 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1232/2516] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:31:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:31:16.736763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=34 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:19.118786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141270e-73a7-4fe2-9426-eb40b414e8a5 service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:19.120282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c141270e-73a7-4fe2-9426-eb40b414e8a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:19.132193 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141270e-73a7-4fe2-9426-eb40b414e8a5 service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:19.135761 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc45fe1-ee5d-44d4-a53f-84f417513537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:19.136408 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc45fe1-ee5d-44d4-a53f-84f417513537 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:19.136688 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc45fe1-ee5d-44d4-a53f-84f417513537 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:19.136959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc45fe1-ee5d-44d4-a53f-84f417513537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:19.138969 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2cc45fe1-ee5d-44d4-a53f-84f417513537 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:19.211580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc45fe1-ee5d-44d4-a53f-84f417513537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:19.213264 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc45fe1-ee5d-44d4-a53f-84f417513537 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:19.223702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1285/2517] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:31:19.499224 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=94 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:22.897847 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9571e-6513-4018-811d-1ca9bf1e8f81 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:22.899286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-89f9571e-6513-4018-811d-1ca9bf1e8f81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:22.992468 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9571e-6513-4018-811d-1ca9bf1e8f81 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:22.999110 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb07a6-eeae-42c5-bbad-7d6f9cd3db11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0005b0c9582e430e9cb85704a4505bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:22.999845 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb07a6-eeae-42c5-bbad-7d6f9cd3db11 service placement] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:23.000143 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb07a6-eeae-42c5-bbad-7d6f9cd3db11 service placement] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:23.000443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb07a6-eeae-42c5-bbad-7d6f9cd3db11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:23.002443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-03eb07a6-eeae-42c5-bbad-7d6f9cd3db11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:23.016812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb07a6-eeae-42c5-bbad-7d6f9cd3db11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:23.018314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb07a6-eeae-42c5-bbad-7d6f9cd3db11 service placement] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:23.028534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc45fe1-ee5d-44d4-a53f-84f417513537 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:23.031094 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2cc45fe1-ee5d-44d4-a53f-84f417513537 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:23.036726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1233/2518] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:31:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:31:23.047563 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc45fe1-ee5d-44d4-a53f-84f417513537 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:23.052269 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf4138-ec64-4704-99d9-c54236dc2f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:23.052930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf4138-ec64-4704-99d9-c54236dc2f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:23.053212 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf4138-ec64-4704-99d9-c54236dc2f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:23.053487 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf4138-ec64-4704-99d9-c54236dc2f53 admin admin] PATH_INFO: `/v3/users/9c26da44165845babfb18a1c6ae51d06` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:23.054687 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf4138-ec64-4704-99d9-c54236dc2f53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c26da44165845babfb18a1c6ae51d06)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:23.056667 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf4138-ec64-4704-99d9-c54236dc2f53 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:23.114917 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-95cf4138-ec64-4704-99d9-c54236dc2f53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c26da44165845babfb18a1c6ae51d06'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:31:23.115601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-95cf4138-ec64-4704-99d9-c54236dc2f53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c26da44165845babfb18a1c6ae51d06'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:31:23.122912 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-95cf4138-ec64-4704-99d9-c54236dc2f53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c26da44165845babfb18a1c6ae51d06'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:31:23.123932 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-95cf4138-ec64-4704-99d9-c54236dc2f53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c26da44165845babfb18a1c6ae51d06'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:31:23.136814 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-95cf4138-ec64-4704-99d9-c54236dc2f53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c26da44165845babfb18a1c6ae51d06'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:31:23.152964 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1286/2519] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:31:23 2022] DELETE /identity/v3/users/9c26da44165845babfb18a1c6ae51d06 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:31:23.361677 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb07a6-eeae-42c5-bbad-7d6f9cd3db11 service placement] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:23.373496 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb07a6-eeae-42c5-bbad-7d6f9cd3db11 service placement] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:23.455452 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a95fd8-335b-433e-8264-331bc15e14b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:23.456968 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a95fd8-335b-433e-8264-331bc15e14b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:23.457266 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a95fd8-335b-433e-8264-331bc15e14b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:23.457544 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a95fd8-335b-433e-8264-331bc15e14b9 admin admin] PATH_INFO: `/v3/projects/1793eb7200be449f9c38aa58debccdaa` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:23.458843 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a95fd8-335b-433e-8264-331bc15e14b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1793eb7200be449f9c38aa58debccdaa)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:23.461297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a95fd8-335b-433e-8264-331bc15e14b9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:23.550333 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-50a95fd8-335b-433e-8264-331bc15e14b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1793eb7200be449f9c38aa58debccdaa', 'request_id': 'req-50a95fd8-335b-433e-8264-331bc15e14b9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:31:23.563606 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-50a95fd8-335b-433e-8264-331bc15e14b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1793eb7200be449f9c38aa58debccdaa', 'request_id': 'req-50a95fd8-335b-433e-8264-331bc15e14b9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:31:23.588753 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-50a95fd8-335b-433e-8264-331bc15e14b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1793eb7200be449f9c38aa58debccdaa', 'request_id': 'req-50a95fd8-335b-433e-8264-331bc15e14b9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:31:23.608432 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-50a95fd8-335b-433e-8264-331bc15e14b9 admin admin] The token cache is being invalidate because project 1793eb7200be449f9c38aa58debccdaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:31:23.608735 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-50a95fd8-335b-433e-8264-331bc15e14b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:31:23.615160 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-50a95fd8-335b-433e-8264-331bc15e14b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:31:23.620215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1234/2520] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:31:23 2022] DELETE /identity/v3/projects/1793eb7200be449f9c38aa58debccdaa => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:31:23.622276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fec8d-a1e3-4cfd-bf38-e620c90cc7f0 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:23.622750 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fec8d-a1e3-4cfd-bf38-e620c90cc7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:23.623039 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fec8d-a1e3-4cfd-bf38-e620c90cc7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:23.649381 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d51fec8d-a1e3-4cfd-bf38-e620c90cc7f0 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:31:23.650639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d51fec8d-a1e3-4cfd-bf38-e620c90cc7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:23.756250 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1287/2521] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:31:23.760428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a7a83-3d9e-44ce-a5d7-a5bde15bb542 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:23.760720 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a7a83-3d9e-44ce-a5d7-a5bde15bb542 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:23.761005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a7a83-3d9e-44ce-a5d7-a5bde15bb542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:23.784749 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-2e3a7a83-3d9e-44ce-a5d7-a5bde15bb542 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:31:23.785918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2e3a7a83-3d9e-44ce-a5d7-a5bde15bb542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:23.794248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1235/2522] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:31:23.799143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fec8d-a1e3-4cfd-bf38-e620c90cc7f0 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:23.809059 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fec8d-a1e3-4cfd-bf38-e620c90cc7f0 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:23.813872 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3c275-d6cf-42ff-8fad-9af67e836873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:23.814492 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3c275-d6cf-42ff-8fad-9af67e836873 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:23.814778 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3c275-d6cf-42ff-8fad-9af67e836873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:23.815056 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3c275-d6cf-42ff-8fad-9af67e836873 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:23.815899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3c275-d6cf-42ff-8fad-9af67e836873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:31:23.816230 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3c275-d6cf-42ff-8fad-9af67e836873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:23.817883 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3c275-d6cf-42ff-8fad-9af67e836873 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:23.819510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:23.837029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1288/2523] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:31:23.838260 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a7a83-3d9e-44ce-a5d7-a5bde15bb542 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:23.848466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a7a83-3d9e-44ce-a5d7-a5bde15bb542 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:23.853219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ea7bd-2fb8-4854-b933-f2070e6df547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:23.853840 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ea7bd-2fb8-4854-b933-f2070e6df547 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:23.854116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ea7bd-2fb8-4854-b933-f2070e6df547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:23.854391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ea7bd-2fb8-4854-b933-f2070e6df547 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:23.855077 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ea7bd-2fb8-4854-b933-f2070e6df547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:23.857059 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ea7bd-2fb8-4854-b933-f2070e6df547 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:23.869319 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:23.896938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1236/2524] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:31:23 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:31:23.898441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3c275-d6cf-42ff-8fad-9af67e836873 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:23.910173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3c275-d6cf-42ff-8fad-9af67e836873 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:23.972842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176c9cd-03ac-4dba-b05c-7630c775dece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:23.973100 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176c9cd-03ac-4dba-b05c-7630c775dece admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:23.973438 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176c9cd-03ac-4dba-b05c-7630c775dece admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:23.973725 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176c9cd-03ac-4dba-b05c-7630c775dece admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:23.974550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176c9cd-03ac-4dba-b05c-7630c775dece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:23.976538 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176c9cd-03ac-4dba-b05c-7630c775dece admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:24.001648 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1289/2525] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:31:23 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:31:24.005935 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ea7bd-2fb8-4854-b933-f2070e6df547 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:24.018497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ea7bd-2fb8-4854-b933-f2070e6df547 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:24.025484 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ce0eb-a888-46eb-a903-5df7fdb9871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:24.027030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ce0eb-a888-46eb-a903-5df7fdb9871b admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:24.027456 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ce0eb-a888-46eb-a903-5df7fdb9871b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:24.027861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ce0eb-a888-46eb-a903-5df7fdb9871b admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:24.029658 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ce0eb-a888-46eb-a903-5df7fdb9871b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:24.031927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ce0eb-a888-46eb-a903-5df7fdb9871b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:24.049520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1237/2526] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:31:24.054553 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176c9cd-03ac-4dba-b05c-7630c775dece admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:24.067081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176c9cd-03ac-4dba-b05c-7630c775dece admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:24.073299 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8957b55-6a8f-4e51-bfd5-b1fcf3e7c377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:24.073902 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8957b55-6a8f-4e51-bfd5-b1fcf3e7c377 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:24.074196 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8957b55-6a8f-4e51-bfd5-b1fcf3e7c377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:24.074540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8957b55-6a8f-4e51-bfd5-b1fcf3e7c377 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:24.075339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8957b55-6a8f-4e51-bfd5-b1fcf3e7c377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:24.077338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8957b55-6a8f-4e51-bfd5-b1fcf3e7c377 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:24.089935 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1290/2527] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:31:24.094303 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ce0eb-a888-46eb-a903-5df7fdb9871b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:24.108113 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ce0eb-a888-46eb-a903-5df7fdb9871b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:24.113732 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63d4d3-7ab6-49a4-8d58-a13a2818fef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:24.114432 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63d4d3-7ab6-49a4-8d58-a13a2818fef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:24.114774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63d4d3-7ab6-49a4-8d58-a13a2818fef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:24.115067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63d4d3-7ab6-49a4-8d58-a13a2818fef5 admin admin] PATH_INFO: `/v3/projects/6303ae034173448e844a01c9f61484b4/users/83efb092913842088cc1418123db4359/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:24.135696 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63d4d3-7ab6-49a4-8d58-a13a2818fef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6303ae034173448e844a01c9f61484b4, user_id=83efb092913842088cc1418123db4359, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:24.139624 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63d4d3-7ab6-49a4-8d58-a13a2818fef5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:24.160564 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1238/2528] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:31:24 2022] PUT /identity/v3/projects/6303ae034173448e844a01c9f61484b4/users/83efb092913842088cc1418123db4359/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:31:24.162523 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59c202-61b4-4a04-a082-2eaa2e5acb9b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:24.162811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59c202-61b4-4a04-a082-2eaa2e5acb9b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:24.163150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59c202-61b4-4a04-a082-2eaa2e5acb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:24.182841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-fe59c202-61b4-4a04-a082-2eaa2e5acb9b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:31:24.184070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-fe59c202-61b4-4a04-a082-2eaa2e5acb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:24.251667 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1291/2529] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:31:24.261200 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63d4d3-7ab6-49a4-8d58-a13a2818fef5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:24.262895 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-aa63d4d3-7ab6-49a4-8d58-a13a2818fef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:24.328151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63d4d3-7ab6-49a4-8d58-a13a2818fef5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:24.336326 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e93d59-4edf-48d5-a172-7f59d675c43d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:24.336744 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e93d59-4edf-48d5-a172-7f59d675c43d service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:24.337032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e93d59-4edf-48d5-a172-7f59d675c43d service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:24.337314 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e93d59-4edf-48d5-a172-7f59d675c43d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:24.349054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e93d59-4edf-48d5-a172-7f59d675c43d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:24.350515 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e93d59-4edf-48d5-a172-7f59d675c43d service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:24.362797 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1239/2530] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:31:26.846608 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941632a-ba0f-438e-b1eb-e1c30a454120 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:26.847146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941632a-ba0f-438e-b1eb-e1c30a454120 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:26.847146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941632a-ba0f-438e-b1eb-e1c30a454120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:26.877422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e941632a-ba0f-438e-b1eb-e1c30a454120 None None] MFA Rules not processed for user `93e3f08697b14594af221fcc1773e592`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:31:26.878852 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e941632a-ba0f-438e-b1eb-e1c30a454120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:26.948033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1292/2531] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:31:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:31:27.579210 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e93d59-4edf-48d5-a172-7f59d675c43d service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:27.588461 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e93d59-4edf-48d5-a172-7f59d675c43d service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:27.595998 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b3de1-cf4f-45db-b8f9-05c0df1f7293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:27.596697 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b3de1-cf4f-45db-b8f9-05c0df1f7293 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:27.597326 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b3de1-cf4f-45db-b8f9-05c0df1f7293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:27.597685 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b3de1-cf4f-45db-b8f9-05c0df1f7293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:27.599727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-107b3de1-cf4f-45db-b8f9-05c0df1f7293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:27.612243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b3de1-cf4f-45db-b8f9-05c0df1f7293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:27.613703 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b3de1-cf4f-45db-b8f9-05c0df1f7293 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:27.624260 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1240/2532] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:31:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:31:28.164360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941632a-ba0f-438e-b1eb-e1c30a454120 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:28.166464 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e941632a-ba0f-438e-b1eb-e1c30a454120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:28.189510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:28.263985 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941632a-ba0f-438e-b1eb-e1c30a454120 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:28.269146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876bc29-4c89-440f-b203-3cd34e17d4f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0005b0c9582e430e9cb85704a4505bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:28.270010 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876bc29-4c89-440f-b203-3cd34e17d4f9 service placement] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:28.270301 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876bc29-4c89-440f-b203-3cd34e17d4f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:28.270583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876bc29-4c89-440f-b203-3cd34e17d4f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:28.273022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b876bc29-4c89-440f-b203-3cd34e17d4f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:28.286820 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876bc29-4c89-440f-b203-3cd34e17d4f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:28.288616 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876bc29-4c89-440f-b203-3cd34e17d4f9 service placement] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:28.301074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1293/2533] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:31:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:31:29.813000 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3acf-91d4-4fb1-b68d-88d29b1e0fc7 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:29.813936 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3acf-91d4-4fb1-b68d-88d29b1e0fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:29.814598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3acf-91d4-4fb1-b68d-88d29b1e0fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:29.851578 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3fbe3acf-91d4-4fb1-b68d-88d29b1e0fc7 None None] MFA Rules not processed for user `83efb092913842088cc1418123db4359`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:31:29.852887 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3fbe3acf-91d4-4fb1-b68d-88d29b1e0fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:29.947642 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1241/2534] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:31:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:31:29.961410 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876bc29-4c89-440f-b203-3cd34e17d4f9 service placement] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:29.962884 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b876bc29-4c89-440f-b203-3cd34e17d4f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:30.047708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876bc29-4c89-440f-b203-3cd34e17d4f9 service placement] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:30.054297 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746df74-9d81-4737-a94c-ec68fcadd0ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:30.054942 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746df74-9d81-4737-a94c-ec68fcadd0ec service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:30.055430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746df74-9d81-4737-a94c-ec68fcadd0ec service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:30.055712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746df74-9d81-4737-a94c-ec68fcadd0ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:30.065214 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746df74-9d81-4737-a94c-ec68fcadd0ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:30.067067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746df74-9d81-4737-a94c-ec68fcadd0ec service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:30.077321 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1294/2535] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:31:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:31:32.518351 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec97a32-6821-4f4f-aba3-862d5ac3369a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:32.518937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec97a32-6821-4f4f-aba3-862d5ac3369a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:32.518937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec97a32-6821-4f4f-aba3-862d5ac3369a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:32.545971 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-1ec97a32-6821-4f4f-aba3-862d5ac3369a None None] MFA Rules not processed for user `83efb092913842088cc1418123db4359`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:31:32.547300 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1ec97a32-6821-4f4f-aba3-862d5ac3369a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:32.557712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1242/2536] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:31:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:31:38.299556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746df74-9d81-4737-a94c-ec68fcadd0ec service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:38.301297 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9746df74-9d81-4737-a94c-ec68fcadd0ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:38.319694 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746df74-9d81-4737-a94c-ec68fcadd0ec service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:38.325298 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad45e0-eeee-4f02-9dde-75d10c605b1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:38.326026 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad45e0-eeee-4f02-9dde-75d10c605b1d service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:38.326313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad45e0-eeee-4f02-9dde-75d10c605b1d service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:38.326600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad45e0-eeee-4f02-9dde-75d10c605b1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:38.328685 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-39ad45e0-eeee-4f02-9dde-75d10c605b1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:38.342065 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad45e0-eeee-4f02-9dde-75d10c605b1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:38.343850 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad45e0-eeee-4f02-9dde-75d10c605b1d service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:38.357383 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1295/2537] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:31:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:31:42.539485 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=85,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:43.122858 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec97a32-6821-4f4f-aba3-862d5ac3369a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:43.136747 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec97a32-6821-4f4f-aba3-862d5ac3369a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:43.143728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd06f2-f331-48cf-b2d5-209bcf08a09c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:43.144554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd06f2-f331-48cf-b2d5-209bcf08a09c service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:43.144846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd06f2-f331-48cf-b2d5-209bcf08a09c service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:43.145129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd06f2-f331-48cf-b2d5-209bcf08a09c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:43.147051 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-dddd06f2-f331-48cf-b2d5-209bcf08a09c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:43.172811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd06f2-f331-48cf-b2d5-209bcf08a09c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:43.176013 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd06f2-f331-48cf-b2d5-209bcf08a09c service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:43.188919 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1243/2538] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:31:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:31:48.352909 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=64 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:31:51.059623 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162698f1-de75-4375-ab96-1c448d222a47 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:51.061356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162698f1-de75-4375-ab96-1c448d222a47 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:51.061983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162698f1-de75-4375-ab96-1c448d222a47 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:51.064617 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1296/2539] 10.222.0.48 () {54 vars in 921 bytes} [Thu Aug 4 10:31:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:31:51.072386 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1792d-644c-4f09-a70a-3d2f9ae0f926 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:51.072973 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1792d-644c-4f09-a70a-3d2f9ae0f926 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:51.073236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1792d-644c-4f09-a70a-3d2f9ae0f926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:51.096438 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-04c1792d-644c-4f09-a70a-3d2f9ae0f926 None None] MFA Rules not processed for user `2021ac71491f4bebb0fbd91c533dc383`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:31:51.097682 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-04c1792d-644c-4f09-a70a-3d2f9ae0f926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:51.104728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1244/2540] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Aug 4 10:31:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:31:51.117793 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162698f1-de75-4375-ab96-1c448d222a47 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:51.132874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162698f1-de75-4375-ab96-1c448d222a47 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:51.136889 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225eb69f-bec7-4b5e-8d53-3b61794dc2b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:51.137514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eb69f-bec7-4b5e-8d53-3b61794dc2b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:51.138143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eb69f-bec7-4b5e-8d53-3b61794dc2b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:51.138424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eb69f-bec7-4b5e-8d53-3b61794dc2b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:51.147103 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225eb69f-bec7-4b5e-8d53-3b61794dc2b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:51.148743 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225eb69f-bec7-4b5e-8d53-3b61794dc2b6 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:51.165112 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1297/2541] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:31:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:31:51.287241 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2264afa-b426-4ce1-b597-bb9b424370ae None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:51.287538 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2264afa-b426-4ce1-b597-bb9b424370ae None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:51.287825 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2264afa-b426-4ce1-b597-bb9b424370ae None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:51.290338 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1245/2542] 10.222.0.48 () {54 vars in 921 bytes} [Thu Aug 4 10:31:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:31:51.300619 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4fea1-71ae-43ff-ba49-70b95a0789c9 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:51.301786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4fea1-71ae-43ff-ba49-70b95a0789c9 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:51.302105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4fea1-71ae-43ff-ba49-70b95a0789c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:51.335813 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8fb4fea1-71ae-43ff-ba49-70b95a0789c9 None None] MFA Rules not processed for user `592539924feb44ad8ea520d8539b6608`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:31:51.337365 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8fb4fea1-71ae-43ff-ba49-70b95a0789c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:31:51.349740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1298/2543] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Aug 4 10:31:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:31:51.365930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2264afa-b426-4ce1-b597-bb9b424370ae None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:31:51.381396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2264afa-b426-4ce1-b597-bb9b424370ae None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:31:51.386038 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eb5cf-81da-415b-be53-9bc256999848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:31:51.387681 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eb5cf-81da-415b-be53-9bc256999848 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:31:51.388806 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eb5cf-81da-415b-be53-9bc256999848 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:31:51.389202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eb5cf-81da-415b-be53-9bc256999848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:31:51.407248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102eb5cf-81da-415b-be53-9bc256999848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:31:51.409735 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102eb5cf-81da-415b-be53-9bc256999848 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:31:51.424472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1246/2544] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:31:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:32:01.329350 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=9 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:32:01.420531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=15 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:21.261427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4fea1-71ae-43ff-ba49-70b95a0789c9 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:21.262866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8fb4fea1-71ae-43ff-ba49-70b95a0789c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:21.338137 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4fea1-71ae-43ff-ba49-70b95a0789c9 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:21.342170 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a67c9-f674-49dc-83c3-ad4949117832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:21.342794 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a67c9-f674-49dc-83c3-ad4949117832 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:21.343085 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a67c9-f674-49dc-83c3-ad4949117832 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:21.343354 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a67c9-f674-49dc-83c3-ad4949117832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:21.345143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ed3a67c9-f674-49dc-83c3-ad4949117832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:21.409284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a67c9-f674-49dc-83c3-ad4949117832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:21.412281 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a67c9-f674-49dc-83c3-ad4949117832 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:21.441548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1299/2545] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:33:25.152457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eb5cf-81da-415b-be53-9bc256999848 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:25.154074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-102eb5cf-81da-415b-be53-9bc256999848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:25.196760 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eb5cf-81da-415b-be53-9bc256999848 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:25.202446 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d3f92-3500-48a3-93bb-d72ef01a4686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:25.203114 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d3f92-3500-48a3-93bb-d72ef01a4686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:25.203397 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d3f92-3500-48a3-93bb-d72ef01a4686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:25.203680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d3f92-3500-48a3-93bb-d72ef01a4686 admin admin] PATH_INFO: `/v3/users/93e3f08697b14594af221fcc1773e592` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:25.205182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d3f92-3500-48a3-93bb-d72ef01a4686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e3f08697b14594af221fcc1773e592)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:25.207119 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d3f92-3500-48a3-93bb-d72ef01a4686 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:25.258697 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-229d3f92-3500-48a3-93bb-d72ef01a4686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e3f08697b14594af221fcc1773e592'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:25.259386 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-229d3f92-3500-48a3-93bb-d72ef01a4686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e3f08697b14594af221fcc1773e592'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:25.267343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-229d3f92-3500-48a3-93bb-d72ef01a4686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e3f08697b14594af221fcc1773e592'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:25.280744 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-229d3f92-3500-48a3-93bb-d72ef01a4686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e3f08697b14594af221fcc1773e592'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:25.294265 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-229d3f92-3500-48a3-93bb-d72ef01a4686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e3f08697b14594af221fcc1773e592'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:25.301509 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1247/2546] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:33:25 2022] DELETE /identity/v3/users/93e3f08697b14594af221fcc1773e592 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:33:25.500636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a67c9-f674-49dc-83c3-ad4949117832 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:25.519074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a67c9-f674-49dc-83c3-ad4949117832 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:25.622126 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d433f3-b6d3-49f0-93da-1f6e89035240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:25.623027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d433f3-b6d3-49f0-93da-1f6e89035240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:25.623440 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d433f3-b6d3-49f0-93da-1f6e89035240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:25.623877 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d433f3-b6d3-49f0-93da-1f6e89035240 admin admin] PATH_INFO: `/v3/projects/b79275ad36b64341bcd8fd4f3fcfb3de` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:25.625401 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d433f3-b6d3-49f0-93da-1f6e89035240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b79275ad36b64341bcd8fd4f3fcfb3de)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:25.628143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d433f3-b6d3-49f0-93da-1f6e89035240 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:25.714268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-37d433f3-b6d3-49f0-93da-1f6e89035240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b79275ad36b64341bcd8fd4f3fcfb3de', 'request_id': 'req-37d433f3-b6d3-49f0-93da-1f6e89035240'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:25.718549 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:25.728213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-37d433f3-b6d3-49f0-93da-1f6e89035240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b79275ad36b64341bcd8fd4f3fcfb3de', 'request_id': 'req-37d433f3-b6d3-49f0-93da-1f6e89035240'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:25.737522 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-37d433f3-b6d3-49f0-93da-1f6e89035240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b79275ad36b64341bcd8fd4f3fcfb3de', 'request_id': 'req-37d433f3-b6d3-49f0-93da-1f6e89035240'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:25.752606 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-37d433f3-b6d3-49f0-93da-1f6e89035240 admin admin] The token cache is being invalidate because project b79275ad36b64341bcd8fd4f3fcfb3de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:33:25.752910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-37d433f3-b6d3-49f0-93da-1f6e89035240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:25.753586 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-37d433f3-b6d3-49f0-93da-1f6e89035240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:25.755147 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1300/2547] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:33:25 2022] DELETE /identity/v3/projects/b79275ad36b64341bcd8fd4f3fcfb3de => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:33:25.760561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89b640-2662-42f6-b876-8618a4380306 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:25.760853 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89b640-2662-42f6-b876-8618a4380306 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:25.761721 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89b640-2662-42f6-b876-8618a4380306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:25.834340 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9e89b640-2662-42f6-b876-8618a4380306 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:25.835585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9e89b640-2662-42f6-b876-8618a4380306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:25.913479 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1248/2548] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:33:25.922010 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a65251-7b0a-4b4e-9464-1135ed73854b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:25.922010 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a65251-7b0a-4b4e-9464-1135ed73854b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:25.922526 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a65251-7b0a-4b4e-9464-1135ed73854b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:25.943254 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a1a65251-7b0a-4b4e-9464-1135ed73854b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:25.944638 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a1a65251-7b0a-4b4e-9464-1135ed73854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:25.958656 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1301/2549] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:33:25.962509 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89b640-2662-42f6-b876-8618a4380306 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:25.974157 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89b640-2662-42f6-b876-8618a4380306 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:25.981748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ec5c0-19dd-4fc9-b44f-56f0df655a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:25.981748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ec5c0-19dd-4fc9-b44f-56f0df655a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:25.981748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ec5c0-19dd-4fc9-b44f-56f0df655a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:25.981748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ec5c0-19dd-4fc9-b44f-56f0df655a27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:25.982218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ec5c0-19dd-4fc9-b44f-56f0df655a27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:33:25.982537 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ec5c0-19dd-4fc9-b44f-56f0df655a27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:25.984286 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ec5c0-19dd-4fc9-b44f-56f0df655a27 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:25.998161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1249/2550] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:33:26.002938 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a65251-7b0a-4b4e-9464-1135ed73854b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:26.014551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a65251-7b0a-4b4e-9464-1135ed73854b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:26.019870 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88445791-666c-4653-ba23-0bfac3b267ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:26.020548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88445791-666c-4653-ba23-0bfac3b267ed admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:26.020829 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88445791-666c-4653-ba23-0bfac3b267ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:26.021442 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88445791-666c-4653-ba23-0bfac3b267ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:26.022123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88445791-666c-4653-ba23-0bfac3b267ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:26.024032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88445791-666c-4653-ba23-0bfac3b267ed admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:26.054185 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1302/2551] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:33:26 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:33:26.059460 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ec5c0-19dd-4fc9-b44f-56f0df655a27 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:26.065999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:26.069941 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ec5c0-19dd-4fc9-b44f-56f0df655a27 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:26.136757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc93248-fa5e-406c-9aa9-d9a5cb28cd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:26.137385 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc93248-fa5e-406c-9aa9-d9a5cb28cd69 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:26.137673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc93248-fa5e-406c-9aa9-d9a5cb28cd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:26.137959 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc93248-fa5e-406c-9aa9-d9a5cb28cd69 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:26.138656 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc93248-fa5e-406c-9aa9-d9a5cb28cd69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:26.140642 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc93248-fa5e-406c-9aa9-d9a5cb28cd69 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:26.163779 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1250/2552] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:33:26 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:33:26.170468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88445791-666c-4653-ba23-0bfac3b267ed admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:26.181109 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88445791-666c-4653-ba23-0bfac3b267ed admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:26.186641 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35756c4a-7f22-41a5-9df4-1e24025642d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:26.187269 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35756c4a-7f22-41a5-9df4-1e24025642d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:26.187553 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35756c4a-7f22-41a5-9df4-1e24025642d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:26.187832 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35756c4a-7f22-41a5-9df4-1e24025642d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:26.188786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35756c4a-7f22-41a5-9df4-1e24025642d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:26.190410 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35756c4a-7f22-41a5-9df4-1e24025642d9 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:26.201059 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1303/2553] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:33:26.205441 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc93248-fa5e-406c-9aa9-d9a5cb28cd69 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:26.216452 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc93248-fa5e-406c-9aa9-d9a5cb28cd69 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:26.222223 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a292c-9e6a-4c61-9d88-98577c79756f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:26.222853 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a292c-9e6a-4c61-9d88-98577c79756f admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:26.223141 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a292c-9e6a-4c61-9d88-98577c79756f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:26.223434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a292c-9e6a-4c61-9d88-98577c79756f admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:26.224133 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a292c-9e6a-4c61-9d88-98577c79756f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:26.225765 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a292c-9e6a-4c61-9d88-98577c79756f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:26.238204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1251/2554] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:33:26.242854 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35756c4a-7f22-41a5-9df4-1e24025642d9 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:26.254487 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35756c4a-7f22-41a5-9df4-1e24025642d9 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:26.259442 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548af97-3e8d-4077-a312-9cd18492b335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:26.260120 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548af97-3e8d-4077-a312-9cd18492b335 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:26.260448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548af97-3e8d-4077-a312-9cd18492b335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:26.260729 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548af97-3e8d-4077-a312-9cd18492b335 admin admin] PATH_INFO: `/v3/projects/1226732aed1642ab9300cfbdf3c8a220/users/d55dfcdff9d14fac98f43cc5ef09eefa/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:26.279882 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548af97-3e8d-4077-a312-9cd18492b335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1226732aed1642ab9300cfbdf3c8a220, user_id=d55dfcdff9d14fac98f43cc5ef09eefa, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:26.282577 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548af97-3e8d-4077-a312-9cd18492b335 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:26.297346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1304/2555] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:33:26 2022] PUT /identity/v3/projects/1226732aed1642ab9300cfbdf3c8a220/users/d55dfcdff9d14fac98f43cc5ef09eefa/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:33:26.310937 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f2424-7e03-4295-b0f7-8d726315f2fe None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:26.311227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f2424-7e03-4295-b0f7-8d726315f2fe None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:26.311509 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f2424-7e03-4295-b0f7-8d726315f2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:26.341420 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3c9f2424-7e03-4295-b0f7-8d726315f2fe None None] MFA Rules not processed for user `d55dfcdff9d14fac98f43cc5ef09eefa`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:26.342693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3c9f2424-7e03-4295-b0f7-8d726315f2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:26.410698 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1252/2556] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:33:26.415405 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548af97-3e8d-4077-a312-9cd18492b335 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:26.486229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548af97-3e8d-4077-a312-9cd18492b335 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:26.491582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60cfc5-3f83-44ee-8615-c9799833e890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:26.492245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60cfc5-3f83-44ee-8615-c9799833e890 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:26.492536 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60cfc5-3f83-44ee-8615-c9799833e890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:26.492817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60cfc5-3f83-44ee-8615-c9799833e890 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:26.493497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60cfc5-3f83-44ee-8615-c9799833e890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:26.495754 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60cfc5-3f83-44ee-8615-c9799833e890 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:26.525040 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1305/2557] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:33:26 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:33:26.530197 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f2424-7e03-4295-b0f7-8d726315f2fe None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:26.551522 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f2424-7e03-4295-b0f7-8d726315f2fe None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:26.626477 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05f039-b51f-4b2c-bf8a-aee5585dc39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:26.627162 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05f039-b51f-4b2c-bf8a-aee5585dc39c admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:26.627431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05f039-b51f-4b2c-bf8a-aee5585dc39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:26.627741 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05f039-b51f-4b2c-bf8a-aee5585dc39c admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:26.628422 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05f039-b51f-4b2c-bf8a-aee5585dc39c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:26.630392 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05f039-b51f-4b2c-bf8a-aee5585dc39c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:26.658133 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1253/2558] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:33:26 2022] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:33:26.659804 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60cfc5-3f83-44ee-8615-c9799833e890 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:26.671582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60cfc5-3f83-44ee-8615-c9799833e890 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:26.676722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfc0b6-2322-4998-85a4-3583c9966b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:26.677314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfc0b6-2322-4998-85a4-3583c9966b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:26.677596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfc0b6-2322-4998-85a4-3583c9966b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:26.677876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfc0b6-2322-4998-85a4-3583c9966b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:26.678594 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfc0b6-2322-4998-85a4-3583c9966b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:26.680210 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfc0b6-2322-4998-85a4-3583c9966b15 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:26.691840 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1306/2559] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:33:26.696574 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05f039-b51f-4b2c-bf8a-aee5585dc39c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:26.703943 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:26.711107 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05f039-b51f-4b2c-bf8a-aee5585dc39c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:26.716630 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a99fc0-d002-44e8-b589-0c98f91f3897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:26.717357 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a99fc0-d002-44e8-b589-0c98f91f3897 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:26.717774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a99fc0-d002-44e8-b589-0c98f91f3897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:26.718267 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a99fc0-d002-44e8-b589-0c98f91f3897 admin admin] PATH_INFO: `/v3/projects/6f1acac8c66a465daed7389b79f48fc8/users/c3af458b20fc4743a0b200b46e33c502/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:26.734798 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a99fc0-d002-44e8-b589-0c98f91f3897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1acac8c66a465daed7389b79f48fc8, user_id=c3af458b20fc4743a0b200b46e33c502, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:26.737522 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a99fc0-d002-44e8-b589-0c98f91f3897 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:26.752414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1254/2560] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:33:26 2022] PUT /identity/v3/projects/6f1acac8c66a465daed7389b79f48fc8/users/c3af458b20fc4743a0b200b46e33c502/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:33:26.756599 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfc0b6-2322-4998-85a4-3583c9966b15 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:26.768660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfc0b6-2322-4998-85a4-3583c9966b15 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:26.819823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:26.839213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff309e8d-359b-4eb4-8708-2dbe105b162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:26.840838 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff309e8d-359b-4eb4-8708-2dbe105b162c admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:26.840838 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff309e8d-359b-4eb4-8708-2dbe105b162c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:26.841329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff309e8d-359b-4eb4-8708-2dbe105b162c admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:26.842144 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff309e8d-359b-4eb4-8708-2dbe105b162c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:26.843992 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff309e8d-359b-4eb4-8708-2dbe105b162c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:26.867945 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1307/2561] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:33:26.869248 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a99fc0-d002-44e8-b589-0c98f91f3897 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:26.883527 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a99fc0-d002-44e8-b589-0c98f91f3897 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:26.892120 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48505c9a-351b-4332-b240-ba91d7a824a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:26.893404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48505c9a-351b-4332-b240-ba91d7a824a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:26.893929 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48505c9a-351b-4332-b240-ba91d7a824a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:26.894468 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48505c9a-351b-4332-b240-ba91d7a824a3 admin admin] PATH_INFO: `/v3/projects/6f1acac8c66a465daed7389b79f48fc8/users/c3af458b20fc4743a0b200b46e33c502/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:26.898199 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48505c9a-351b-4332-b240-ba91d7a824a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1acac8c66a465daed7389b79f48fc8, user_id=c3af458b20fc4743a0b200b46e33c502, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:26.904078 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48505c9a-351b-4332-b240-ba91d7a824a3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:26.924600 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1255/2562] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:33:26 2022] PUT /identity/v3/projects/6f1acac8c66a465daed7389b79f48fc8/users/c3af458b20fc4743a0b200b46e33c502/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:33:26.946586 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d87d14-0112-4320-8be1-7360337c3bb3 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:26.947117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d87d14-0112-4320-8be1-7360337c3bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:26.947647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d87d14-0112-4320-8be1-7360337c3bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:26.991255 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c8d87d14-0112-4320-8be1-7360337c3bb3 None None] MFA Rules not processed for user `c3af458b20fc4743a0b200b46e33c502`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:26.992615 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c8d87d14-0112-4320-8be1-7360337c3bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:27.099570 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1308/2563] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:33:27.109310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48505c9a-351b-4332-b240-ba91d7a824a3 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:27.111632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-48505c9a-351b-4332-b240-ba91d7a824a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:27.210419 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48505c9a-351b-4332-b240-ba91d7a824a3 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:27.218434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66faaec5-f5e4-41bb-afa8-d5e3fd19392a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:27.218434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faaec5-f5e4-41bb-afa8-d5e3fd19392a service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:27.218434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faaec5-f5e4-41bb-afa8-d5e3fd19392a service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:27.218434 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faaec5-f5e4-41bb-afa8-d5e3fd19392a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:27.229061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66faaec5-f5e4-41bb-afa8-d5e3fd19392a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:27.236708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66faaec5-f5e4-41bb-afa8-d5e3fd19392a service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:27.249387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1256/2564] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:33:27.292808 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d87d14-0112-4320-8be1-7360337c3bb3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:27.407845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d87d14-0112-4320-8be1-7360337c3bb3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:27.416142 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902a375-5094-47ca-af2b-e3f492bdf2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:27.418410 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902a375-5094-47ca-af2b-e3f492bdf2ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:27.418915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902a375-5094-47ca-af2b-e3f492bdf2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:27.419360 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902a375-5094-47ca-af2b-e3f492bdf2ea admin admin] PATH_INFO: `/v3/users/d55dfcdff9d14fac98f43cc5ef09eefa` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:27.420942 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902a375-5094-47ca-af2b-e3f492bdf2ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d55dfcdff9d14fac98f43cc5ef09eefa)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:27.422943 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902a375-5094-47ca-af2b-e3f492bdf2ea admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:27.478036 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8902a375-5094-47ca-af2b-e3f492bdf2ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd55dfcdff9d14fac98f43cc5ef09eefa'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:27.478659 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8902a375-5094-47ca-af2b-e3f492bdf2ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd55dfcdff9d14fac98f43cc5ef09eefa'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:27.487956 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8902a375-5094-47ca-af2b-e3f492bdf2ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd55dfcdff9d14fac98f43cc5ef09eefa'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:27.488749 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8902a375-5094-47ca-af2b-e3f492bdf2ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd55dfcdff9d14fac98f43cc5ef09eefa'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:27.503651 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8902a375-5094-47ca-af2b-e3f492bdf2ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd55dfcdff9d14fac98f43cc5ef09eefa'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:27.506004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:27.519798 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1309/2565] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:33:27 2022] DELETE /identity/v3/users/d55dfcdff9d14fac98f43cc5ef09eefa => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:33:27.524500 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d823c0-faa5-4445-86dd-2ba920afaecd None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:27.524808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d823c0-faa5-4445-86dd-2ba920afaecd None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:27.525089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d823c0-faa5-4445-86dd-2ba920afaecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:27.557358 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d1d823c0-faa5-4445-86dd-2ba920afaecd None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:27.558729 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d1d823c0-faa5-4445-86dd-2ba920afaecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:27.637416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1257/2566] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:33:27.648042 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902a375-5094-47ca-af2b-e3f492bdf2ea admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:27.649732 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8902a375-5094-47ca-af2b-e3f492bdf2ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:27.725452 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902a375-5094-47ca-af2b-e3f492bdf2ea admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:27.729406 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ea144-0000-4221-ac54-fe38bc75891d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:27.730101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ea144-0000-4221-ac54-fe38bc75891d service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:27.730393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ea144-0000-4221-ac54-fe38bc75891d service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:27.730668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ea144-0000-4221-ac54-fe38bc75891d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:27.741026 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ea144-0000-4221-ac54-fe38bc75891d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:27.742541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ea144-0000-4221-ac54-fe38bc75891d service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:27.754185 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1310/2567] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:33:28.091080 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d823c0-faa5-4445-86dd-2ba920afaecd None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:28.092687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d1d823c0-faa5-4445-86dd-2ba920afaecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:28.116596 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d823c0-faa5-4445-86dd-2ba920afaecd None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:28.122877 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693c358-c906-457c-8d13-3636e9948cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:28.123558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693c358-c906-457c-8d13-3636e9948cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:28.123929 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693c358-c906-457c-8d13-3636e9948cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:28.124113 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693c358-c906-457c-8d13-3636e9948cf7 admin admin] PATH_INFO: `/v3/projects/1226732aed1642ab9300cfbdf3c8a220` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:28.125716 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693c358-c906-457c-8d13-3636e9948cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1226732aed1642ab9300cfbdf3c8a220)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:28.128435 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693c358-c906-457c-8d13-3636e9948cf7 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:28.179494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:28.185399 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4693c358-c906-457c-8d13-3636e9948cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1226732aed1642ab9300cfbdf3c8a220', 'request_id': 'req-4693c358-c906-457c-8d13-3636e9948cf7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:28.193464 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4693c358-c906-457c-8d13-3636e9948cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1226732aed1642ab9300cfbdf3c8a220', 'request_id': 'req-4693c358-c906-457c-8d13-3636e9948cf7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:28.203188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4693c358-c906-457c-8d13-3636e9948cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1226732aed1642ab9300cfbdf3c8a220', 'request_id': 'req-4693c358-c906-457c-8d13-3636e9948cf7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:28.215518 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4693c358-c906-457c-8d13-3636e9948cf7 admin admin] The token cache is being invalidate because project 1226732aed1642ab9300cfbdf3c8a220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:33:28.216255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4693c358-c906-457c-8d13-3636e9948cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:28.216561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4693c358-c906-457c-8d13-3636e9948cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:28.218123 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1258/2568] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:33:28 2022] DELETE /identity/v3/projects/1226732aed1642ab9300cfbdf3c8a220 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:33:28.222130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ea144-0000-4221-ac54-fe38bc75891d service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:28.233006 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ea144-0000-4221-ac54-fe38bc75891d service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:28.299208 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb72ba-e7a8-44cc-b383-c8cf7003f4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:28.299787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb72ba-e7a8-44cc-b383-c8cf7003f4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:28.300068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb72ba-e7a8-44cc-b383-c8cf7003f4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:28.300468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb72ba-e7a8-44cc-b383-c8cf7003f4d4 admin admin] PATH_INFO: `/v3/users/c3af458b20fc4743a0b200b46e33c502` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:28.301818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb72ba-e7a8-44cc-b383-c8cf7003f4d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3af458b20fc4743a0b200b46e33c502)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:28.303848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb72ba-e7a8-44cc-b383-c8cf7003f4d4 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:28.361371 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-16eb72ba-e7a8-44cc-b383-c8cf7003f4d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3af458b20fc4743a0b200b46e33c502'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:28.362074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-16eb72ba-e7a8-44cc-b383-c8cf7003f4d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3af458b20fc4743a0b200b46e33c502'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:28.369969 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-16eb72ba-e7a8-44cc-b383-c8cf7003f4d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3af458b20fc4743a0b200b46e33c502'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:28.370736 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-16eb72ba-e7a8-44cc-b383-c8cf7003f4d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3af458b20fc4743a0b200b46e33c502'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:28.390549 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-16eb72ba-e7a8-44cc-b383-c8cf7003f4d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3af458b20fc4743a0b200b46e33c502'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:28.406484 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1311/2569] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:33:28 2022] DELETE /identity/v3/users/c3af458b20fc4743a0b200b46e33c502 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:33:28.694994 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693c358-c906-457c-8d13-3636e9948cf7 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:28.697544 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4693c358-c906-457c-8d13-3636e9948cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:28.714551 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693c358-c906-457c-8d13-3636e9948cf7 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:28.781928 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666af69-4c8c-4703-b6ec-4078ec3ec540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:28.782588 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666af69-4c8c-4703-b6ec-4078ec3ec540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:28.782873 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666af69-4c8c-4703-b6ec-4078ec3ec540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:28.783186 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666af69-4c8c-4703-b6ec-4078ec3ec540 admin admin] PATH_INFO: `/v3/projects/6f1acac8c66a465daed7389b79f48fc8` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:28.784416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666af69-4c8c-4703-b6ec-4078ec3ec540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f1acac8c66a465daed7389b79f48fc8)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:28.786365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666af69-4c8c-4703-b6ec-4078ec3ec540 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:28.840892 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d666af69-4c8c-4703-b6ec-4078ec3ec540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f1acac8c66a465daed7389b79f48fc8', 'request_id': 'req-d666af69-4c8c-4703-b6ec-4078ec3ec540'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:28.847317 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d666af69-4c8c-4703-b6ec-4078ec3ec540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f1acac8c66a465daed7389b79f48fc8', 'request_id': 'req-d666af69-4c8c-4703-b6ec-4078ec3ec540'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:28.857771 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d666af69-4c8c-4703-b6ec-4078ec3ec540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f1acac8c66a465daed7389b79f48fc8', 'request_id': 'req-d666af69-4c8c-4703-b6ec-4078ec3ec540'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:28.872594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d666af69-4c8c-4703-b6ec-4078ec3ec540 admin admin] The token cache is being invalidate because project 6f1acac8c66a465daed7389b79f48fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:33:28.872868 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d666af69-4c8c-4703-b6ec-4078ec3ec540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:28.873566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d666af69-4c8c-4703-b6ec-4078ec3ec540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:28.875168 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1259/2570] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:33:28 2022] DELETE /identity/v3/projects/6f1acac8c66a465daed7389b79f48fc8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:33:28.885223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e0e7a-0507-4a6b-8e05-db628924b3ce None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:28.885771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e0e7a-0507-4a6b-8e05-db628924b3ce None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:28.886613 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e0e7a-0507-4a6b-8e05-db628924b3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:28.907581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-ba1e0e7a-0507-4a6b-8e05-db628924b3ce None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:28.908955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ba1e0e7a-0507-4a6b-8e05-db628924b3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:28.918357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:29.007611 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1312/2571] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:33:29.009854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cb73e-09b0-41af-9a5c-4baf67f4aceb None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:29.010597 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cb73e-09b0-41af-9a5c-4baf67f4aceb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:29.010947 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cb73e-09b0-41af-9a5c-4baf67f4aceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:29.037806 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d74cb73e-09b0-41af-9a5c-4baf67f4aceb None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:29.039233 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d74cb73e-09b0-41af-9a5c-4baf67f4aceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:29.049215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1260/2572] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:33:29.055380 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e0e7a-0507-4a6b-8e05-db628924b3ce None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:29.070458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e0e7a-0507-4a6b-8e05-db628924b3ce None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:29.076352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb117f-10b9-4d18-a7be-0baaa0519f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:29.076971 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb117f-10b9-4d18-a7be-0baaa0519f9e admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:29.077253 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb117f-10b9-4d18-a7be-0baaa0519f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:29.077527 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb117f-10b9-4d18-a7be-0baaa0519f9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:29.078218 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb117f-10b9-4d18-a7be-0baaa0519f9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:33:29.078520 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb117f-10b9-4d18-a7be-0baaa0519f9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:29.080406 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb117f-10b9-4d18-a7be-0baaa0519f9e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:29.093712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1313/2573] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:33:29.098881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cb73e-09b0-41af-9a5c-4baf67f4aceb None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:29.108602 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cb73e-09b0-41af-9a5c-4baf67f4aceb None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:29.117316 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87f6a4-7c30-4087-a653-e701b404a120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:29.118017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87f6a4-7c30-4087-a653-e701b404a120 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:29.118296 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87f6a4-7c30-4087-a653-e701b404a120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:29.118571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87f6a4-7c30-4087-a653-e701b404a120 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:29.119281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87f6a4-7c30-4087-a653-e701b404a120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:29.121835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87f6a4-7c30-4087-a653-e701b404a120 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:29.151081 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1261/2574] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:33:29 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:33:29.158206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb117f-10b9-4d18-a7be-0baaa0519f9e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:29.168894 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb117f-10b9-4d18-a7be-0baaa0519f9e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:29.228936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30739c8-e9bd-4f47-8633-00d56e799047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:29.229571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30739c8-e9bd-4f47-8633-00d56e799047 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:29.230067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30739c8-e9bd-4f47-8633-00d56e799047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:29.230531 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30739c8-e9bd-4f47-8633-00d56e799047 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:29.231198 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30739c8-e9bd-4f47-8633-00d56e799047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:29.233162 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30739c8-e9bd-4f47-8633-00d56e799047 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:29.254807 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1314/2575] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:33:29 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:33:29.258917 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87f6a4-7c30-4087-a653-e701b404a120 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:29.270628 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87f6a4-7c30-4087-a653-e701b404a120 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:29.275305 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2f3a1-c0ac-46f2-80df-738230b174ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:29.275935 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2f3a1-c0ac-46f2-80df-738230b174ab admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:29.276245 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2f3a1-c0ac-46f2-80df-738230b174ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:29.276528 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2f3a1-c0ac-46f2-80df-738230b174ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:29.278227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2f3a1-c0ac-46f2-80df-738230b174ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:29.279628 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2f3a1-c0ac-46f2-80df-738230b174ab admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:29.290799 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1262/2576] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:33:29.296912 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30739c8-e9bd-4f47-8633-00d56e799047 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:29.308306 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30739c8-e9bd-4f47-8633-00d56e799047 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:29.313427 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4909536-56e2-4dca-b59b-049e80254567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:29.314047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4909536-56e2-4dca-b59b-049e80254567 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:29.314333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4909536-56e2-4dca-b59b-049e80254567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:29.314603 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4909536-56e2-4dca-b59b-049e80254567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:29.315291 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4909536-56e2-4dca-b59b-049e80254567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:29.316973 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4909536-56e2-4dca-b59b-049e80254567 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:29.329266 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1315/2577] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:33:29.335258 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2f3a1-c0ac-46f2-80df-738230b174ab admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:29.346782 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2f3a1-c0ac-46f2-80df-738230b174ab admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:29.352128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbdfd6-15b9-4d81-beca-1b8b9895f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:29.352830 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbdfd6-15b9-4d81-beca-1b8b9895f0b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:29.353108 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbdfd6-15b9-4d81-beca-1b8b9895f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:29.353383 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbdfd6-15b9-4d81-beca-1b8b9895f0b9 admin admin] PATH_INFO: `/v3/projects/b5819cbbffe04fac99067fd72acb1908/users/a0436d1e49db4688b30bbf8cf512d201/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:29.369974 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbdfd6-15b9-4d81-beca-1b8b9895f0b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5819cbbffe04fac99067fd72acb1908, user_id=a0436d1e49db4688b30bbf8cf512d201, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:29.373168 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbdfd6-15b9-4d81-beca-1b8b9895f0b9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:29.381850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:29.389851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1263/2578] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:33:29 2022] PUT /identity/v3/projects/b5819cbbffe04fac99067fd72acb1908/users/a0436d1e49db4688b30bbf8cf512d201/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:33:29.402610 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad36f09-860f-47be-b8ae-05e62735e6c6 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:29.403085 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad36f09-860f-47be-b8ae-05e62735e6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:29.403494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad36f09-860f-47be-b8ae-05e62735e6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:29.432161 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-dad36f09-860f-47be-b8ae-05e62735e6c6 None None] MFA Rules not processed for user `a0436d1e49db4688b30bbf8cf512d201`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:29.434172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-dad36f09-860f-47be-b8ae-05e62735e6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:29.507835 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1316/2579] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:33:29.513081 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbdfd6-15b9-4d81-beca-1b8b9895f0b9 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:29.591197 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbdfd6-15b9-4d81-beca-1b8b9895f0b9 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:29.599181 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285d229-8639-4917-aecb-aa6232307551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:29.600293 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285d229-8639-4917-aecb-aa6232307551 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:29.600834 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285d229-8639-4917-aecb-aa6232307551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:29.601361 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285d229-8639-4917-aecb-aa6232307551 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:29.602694 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285d229-8639-4917-aecb-aa6232307551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:29.606837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285d229-8639-4917-aecb-aa6232307551 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:29.652849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1264/2580] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:33:29 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:33:29.654134 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad36f09-860f-47be-b8ae-05e62735e6c6 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:29.666609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad36f09-860f-47be-b8ae-05e62735e6c6 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:29.672999 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:29.739361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11105bfb-1e62-4444-bade-cbbe30714309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:29.739999 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11105bfb-1e62-4444-bade-cbbe30714309 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:29.740337 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11105bfb-1e62-4444-bade-cbbe30714309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:29.740621 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11105bfb-1e62-4444-bade-cbbe30714309 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:29.741309 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11105bfb-1e62-4444-bade-cbbe30714309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:29.743283 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11105bfb-1e62-4444-bade-cbbe30714309 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:29.766227 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1317/2581] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:33:29 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:33:29.770198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285d229-8639-4917-aecb-aa6232307551 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:29.782925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285d229-8639-4917-aecb-aa6232307551 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:29.787881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e5712-8085-4487-8c36-9134b6d3d554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:29.788542 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e5712-8085-4487-8c36-9134b6d3d554 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:29.788817 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e5712-8085-4487-8c36-9134b6d3d554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:29.789091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e5712-8085-4487-8c36-9134b6d3d554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:29.789784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e5712-8085-4487-8c36-9134b6d3d554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:29.791464 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e5712-8085-4487-8c36-9134b6d3d554 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:29.804004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1265/2582] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:33:29.808995 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11105bfb-1e62-4444-bade-cbbe30714309 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:29.819519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11105bfb-1e62-4444-bade-cbbe30714309 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:29.826022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e1db5-9161-4bc2-96de-1a4a8ad11594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:29.826842 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e1db5-9161-4bc2-96de-1a4a8ad11594 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:29.827165 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e1db5-9161-4bc2-96de-1a4a8ad11594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:29.827483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e1db5-9161-4bc2-96de-1a4a8ad11594 admin admin] PATH_INFO: `/v3/projects/edf894908dd04b6eae9458a88f44e0a4/users/450d17a9859d46b095108900dc403aa7/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:29.846159 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e1db5-9161-4bc2-96de-1a4a8ad11594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf894908dd04b6eae9458a88f44e0a4, user_id=450d17a9859d46b095108900dc403aa7, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:29.848890 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e1db5-9161-4bc2-96de-1a4a8ad11594 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:29.867841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1318/2583] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:33:29 2022] PUT /identity/v3/projects/edf894908dd04b6eae9458a88f44e0a4/users/450d17a9859d46b095108900dc403aa7/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:33:29.872103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e5712-8085-4487-8c36-9134b6d3d554 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:29.882753 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e5712-8085-4487-8c36-9134b6d3d554 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:29.948008 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e2c1c-14ce-4f39-bacb-a25d01b1b96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:29.948677 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e2c1c-14ce-4f39-bacb-a25d01b1b96d admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:29.948963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e2c1c-14ce-4f39-bacb-a25d01b1b96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:29.949243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e2c1c-14ce-4f39-bacb-a25d01b1b96d admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:29.949970 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e2c1c-14ce-4f39-bacb-a25d01b1b96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:29.951584 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e2c1c-14ce-4f39-bacb-a25d01b1b96d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:29.962080 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1266/2584] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:33:29.967164 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e1db5-9161-4bc2-96de-1a4a8ad11594 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:29.977659 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e1db5-9161-4bc2-96de-1a4a8ad11594 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:29.982927 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7de982-00ed-407e-aa0f-32385fbb6483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:29.983602 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7de982-00ed-407e-aa0f-32385fbb6483 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:29.983883 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7de982-00ed-407e-aa0f-32385fbb6483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:29.984160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7de982-00ed-407e-aa0f-32385fbb6483 admin admin] PATH_INFO: `/v3/projects/edf894908dd04b6eae9458a88f44e0a4/users/450d17a9859d46b095108900dc403aa7/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:29.986221 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7de982-00ed-407e-aa0f-32385fbb6483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf894908dd04b6eae9458a88f44e0a4, user_id=450d17a9859d46b095108900dc403aa7, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:29.988925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7de982-00ed-407e-aa0f-32385fbb6483 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:30.001017 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1319/2585] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:33:29 2022] PUT /identity/v3/projects/edf894908dd04b6eae9458a88f44e0a4/users/450d17a9859d46b095108900dc403aa7/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:33:30.011178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd77de-d315-4968-905c-c00c81b2881e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:30.011462 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd77de-d315-4968-905c-c00c81b2881e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:30.011739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd77de-d315-4968-905c-c00c81b2881e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:30.040561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c5fd77de-d315-4968-905c-c00c81b2881e None None] MFA Rules not processed for user `450d17a9859d46b095108900dc403aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:30.041784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c5fd77de-d315-4968-905c-c00c81b2881e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:30.104429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:30.117151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1267/2586] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:33:30.129265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7de982-00ed-407e-aa0f-32385fbb6483 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:30.131002 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4a7de982-00ed-407e-aa0f-32385fbb6483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:30.200594 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7de982-00ed-407e-aa0f-32385fbb6483 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:30.206287 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c6108-cc2d-413e-8a02-353170104bb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:30.207223 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c6108-cc2d-413e-8a02-353170104bb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:30.207640 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c6108-cc2d-413e-8a02-353170104bb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:30.208065 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c6108-cc2d-413e-8a02-353170104bb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:30.293683 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c6108-cc2d-413e-8a02-353170104bb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:30.295134 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c6108-cc2d-413e-8a02-353170104bb7 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:30.304553 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1320/2587] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:33:31.735674 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd77de-d315-4968-905c-c00c81b2881e None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:31.737083 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c5fd77de-d315-4968-905c-c00c81b2881e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:31.753586 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd77de-d315-4968-905c-c00c81b2881e None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:31.759455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dae349-b63e-493e-b09d-81c790f87201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:31.760400 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dae349-b63e-493e-b09d-81c790f87201 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:31.760701 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dae349-b63e-493e-b09d-81c790f87201 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:31.761122 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dae349-b63e-493e-b09d-81c790f87201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:31.774911 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dae349-b63e-493e-b09d-81c790f87201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:31.777565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dae349-b63e-493e-b09d-81c790f87201 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:31.798369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1268/2588] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:33:31.807109 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f3ee7-2aaa-4b27-b1d1-3fecd1820a33 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:31.807612 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f3ee7-2aaa-4b27-b1d1-3fecd1820a33 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:31.807612 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f3ee7-2aaa-4b27-b1d1-3fecd1820a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:31.833434 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:31.839911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a78f3ee7-2aaa-4b27-b1d1-3fecd1820a33 None None] MFA Rules not processed for user `306a5f4d7e0d44bd9a27145bd35a07fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:31.841741 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a78f3ee7-2aaa-4b27-b1d1-3fecd1820a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:31.924031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1321/2589] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Aug 4 10:33:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:33:31.994802 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dae349-b63e-493e-b09d-81c790f87201 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:31.996430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-89dae349-b63e-493e-b09d-81c790f87201 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:32.100780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dae349-b63e-493e-b09d-81c790f87201 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:32.106403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a48fa-2de5-4bcb-a876-a3b6cfa452d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878797620be54b74a3e8582c78ba78d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:32.107035 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a48fa-2de5-4bcb-a876-a3b6cfa452d8 service swift] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:32.107320 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a48fa-2de5-4bcb-a876-a3b6cfa452d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:32.107598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a48fa-2de5-4bcb-a876-a3b6cfa452d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:32.116692 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a48fa-2de5-4bcb-a876-a3b6cfa452d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:32.118409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a48fa-2de5-4bcb-a876-a3b6cfa452d8 service swift] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:32.128295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1269/2590] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Aug 4 10:33:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 10:33:36.046733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f3ee7-2aaa-4b27-b1d1-3fecd1820a33 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:36.158413 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f3ee7-2aaa-4b27-b1d1-3fecd1820a33 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:36.165985 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964e007-5859-4ecc-84cb-0d6c4ca90f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:36.167019 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964e007-5859-4ecc-84cb-0d6c4ca90f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:36.167583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964e007-5859-4ecc-84cb-0d6c4ca90f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:36.168150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964e007-5859-4ecc-84cb-0d6c4ca90f95 admin admin] PATH_INFO: `/v3/users/a0436d1e49db4688b30bbf8cf512d201` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:36.169683 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964e007-5859-4ecc-84cb-0d6c4ca90f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0436d1e49db4688b30bbf8cf512d201)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:36.172541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964e007-5859-4ecc-84cb-0d6c4ca90f95 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:36.239900 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8964e007-5859-4ecc-84cb-0d6c4ca90f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0436d1e49db4688b30bbf8cf512d201'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:36.240580 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8964e007-5859-4ecc-84cb-0d6c4ca90f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0436d1e49db4688b30bbf8cf512d201'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:36.248909 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8964e007-5859-4ecc-84cb-0d6c4ca90f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0436d1e49db4688b30bbf8cf512d201'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:36.249652 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8964e007-5859-4ecc-84cb-0d6c4ca90f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0436d1e49db4688b30bbf8cf512d201'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:36.277921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8964e007-5859-4ecc-84cb-0d6c4ca90f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0436d1e49db4688b30bbf8cf512d201'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:36.299908 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1322/2591] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:33:36 2022] DELETE /identity/v3/users/a0436d1e49db4688b30bbf8cf512d201 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:33:36.301777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e33efe-fc25-40bb-b19e-74159c89f760 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:36.302480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e33efe-fc25-40bb-b19e-74159c89f760 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:36.302480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e33efe-fc25-40bb-b19e-74159c89f760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:36.327125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-84e33efe-fc25-40bb-b19e-74159c89f760 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:36.328644 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-84e33efe-fc25-40bb-b19e-74159c89f760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:36.436211 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1270/2592] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:33:36.451982 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964e007-5859-4ecc-84cb-0d6c4ca90f95 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:36.454172 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8964e007-5859-4ecc-84cb-0d6c4ca90f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:36.505468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:36.556635 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964e007-5859-4ecc-84cb-0d6c4ca90f95 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:36.564515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fef500-2b3c-4a43-a490-1d09ca5e0970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:36.565579 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fef500-2b3c-4a43-a490-1d09ca5e0970 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:36.566281 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fef500-2b3c-4a43-a490-1d09ca5e0970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:36.566636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fef500-2b3c-4a43-a490-1d09ca5e0970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:36.584617 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fef500-2b3c-4a43-a490-1d09ca5e0970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:36.589072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fef500-2b3c-4a43-a490-1d09ca5e0970 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:36.608261 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1323/2593] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:33:37.000684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e33efe-fc25-40bb-b19e-74159c89f760 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:37.002430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-84e33efe-fc25-40bb-b19e-74159c89f760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:37.019113 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e33efe-fc25-40bb-b19e-74159c89f760 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:37.025741 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b81f8-029b-4f9d-9875-09727f461d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:37.027313 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b81f8-029b-4f9d-9875-09727f461d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:37.027639 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b81f8-029b-4f9d-9875-09727f461d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:37.027957 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b81f8-029b-4f9d-9875-09727f461d85 admin admin] PATH_INFO: `/v3/projects/b5819cbbffe04fac99067fd72acb1908` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:37.029673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b81f8-029b-4f9d-9875-09727f461d85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5819cbbffe04fac99067fd72acb1908)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:37.031641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b81f8-029b-4f9d-9875-09727f461d85 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:37.101156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fd3b81f8-029b-4f9d-9875-09727f461d85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5819cbbffe04fac99067fd72acb1908', 'request_id': 'req-fd3b81f8-029b-4f9d-9875-09727f461d85'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:37.109829 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fd3b81f8-029b-4f9d-9875-09727f461d85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5819cbbffe04fac99067fd72acb1908', 'request_id': 'req-fd3b81f8-029b-4f9d-9875-09727f461d85'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:37.122778 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fd3b81f8-029b-4f9d-9875-09727f461d85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5819cbbffe04fac99067fd72acb1908', 'request_id': 'req-fd3b81f8-029b-4f9d-9875-09727f461d85'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:37.132467 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:37.146899 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fd3b81f8-029b-4f9d-9875-09727f461d85 admin admin] The token cache is being invalidate because project b5819cbbffe04fac99067fd72acb1908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:33:37.147814 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fd3b81f8-029b-4f9d-9875-09727f461d85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:37.148810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fd3b81f8-029b-4f9d-9875-09727f461d85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:37.154611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1271/2594] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:33:36 2022] DELETE /identity/v3/projects/b5819cbbffe04fac99067fd72acb1908 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:33:37.160944 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fef500-2b3c-4a43-a490-1d09ca5e0970 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:37.175944 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fef500-2b3c-4a43-a490-1d09ca5e0970 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:37.288324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdab4ae-79c2-4f67-bfec-5878cdf3a9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:37.288924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdab4ae-79c2-4f67-bfec-5878cdf3a9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:37.289205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdab4ae-79c2-4f67-bfec-5878cdf3a9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:37.289481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdab4ae-79c2-4f67-bfec-5878cdf3a9fd admin admin] PATH_INFO: `/v3/users/450d17a9859d46b095108900dc403aa7` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:37.290724 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdab4ae-79c2-4f67-bfec-5878cdf3a9fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=450d17a9859d46b095108900dc403aa7)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:37.293293 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdab4ae-79c2-4f67-bfec-5878cdf3a9fd admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:37.373671 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-acdab4ae-79c2-4f67-bfec-5878cdf3a9fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '450d17a9859d46b095108900dc403aa7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:37.374654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-acdab4ae-79c2-4f67-bfec-5878cdf3a9fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '450d17a9859d46b095108900dc403aa7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:37.383001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-acdab4ae-79c2-4f67-bfec-5878cdf3a9fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '450d17a9859d46b095108900dc403aa7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:37.383959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-acdab4ae-79c2-4f67-bfec-5878cdf3a9fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '450d17a9859d46b095108900dc403aa7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:37.408550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-acdab4ae-79c2-4f67-bfec-5878cdf3a9fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '450d17a9859d46b095108900dc403aa7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:37.426594 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1324/2595] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:33:37 2022] DELETE /identity/v3/users/450d17a9859d46b095108900dc403aa7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:33:37.833976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b81f8-029b-4f9d-9875-09727f461d85 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:37.837195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fd3b81f8-029b-4f9d-9875-09727f461d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:37.865555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b81f8-029b-4f9d-9875-09727f461d85 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:37.966767 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3a85b-9c2c-4fd6-a3e4-c11ebd5e4427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:37.968663 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3a85b-9c2c-4fd6-a3e4-c11ebd5e4427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:37.969894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3a85b-9c2c-4fd6-a3e4-c11ebd5e4427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:37.970302 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3a85b-9c2c-4fd6-a3e4-c11ebd5e4427 admin admin] PATH_INFO: `/v3/projects/edf894908dd04b6eae9458a88f44e0a4` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:37.971820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3a85b-9c2c-4fd6-a3e4-c11ebd5e4427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edf894908dd04b6eae9458a88f44e0a4)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:37.974496 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3a85b-9c2c-4fd6-a3e4-c11ebd5e4427 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:38.052340 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-efb3a85b-9c2c-4fd6-a3e4-c11ebd5e4427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edf894908dd04b6eae9458a88f44e0a4', 'request_id': 'req-efb3a85b-9c2c-4fd6-a3e4-c11ebd5e4427'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:38.061123 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-efb3a85b-9c2c-4fd6-a3e4-c11ebd5e4427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edf894908dd04b6eae9458a88f44e0a4', 'request_id': 'req-efb3a85b-9c2c-4fd6-a3e4-c11ebd5e4427'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:38.071840 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-efb3a85b-9c2c-4fd6-a3e4-c11ebd5e4427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edf894908dd04b6eae9458a88f44e0a4', 'request_id': 'req-efb3a85b-9c2c-4fd6-a3e4-c11ebd5e4427'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:38.096357 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-efb3a85b-9c2c-4fd6-a3e4-c11ebd5e4427 admin admin] The token cache is being invalidate because project edf894908dd04b6eae9458a88f44e0a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:33:38.097062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-efb3a85b-9c2c-4fd6-a3e4-c11ebd5e4427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:38.099212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-efb3a85b-9c2c-4fd6-a3e4-c11ebd5e4427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:38.101968 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1272/2596] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:33:37 2022] DELETE /identity/v3/projects/edf894908dd04b6eae9458a88f44e0a4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:33:38.108639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715d40-8430-4d3b-affa-01feada01b8e None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:38.109339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715d40-8430-4d3b-affa-01feada01b8e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:38.109711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5715d40-8430-4d3b-affa-01feada01b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:38.145625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b5715d40-8430-4d3b-affa-01feada01b8e None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:38.147111 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b5715d40-8430-4d3b-affa-01feada01b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:38.207414 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:38.243000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1325/2597] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:33:38.252816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce69029-387a-49d0-a274-1673b57cc1d7 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:38.253216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce69029-387a-49d0-a274-1673b57cc1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:38.253501 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce69029-387a-49d0-a274-1673b57cc1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:38.275549 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9ce69029-387a-49d0-a274-1673b57cc1d7 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:38.277670 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9ce69029-387a-49d0-a274-1673b57cc1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:38.288159 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1273/2598] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:33:38.292515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5715d40-8430-4d3b-affa-01feada01b8e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:38.305559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5715d40-8430-4d3b-affa-01feada01b8e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:38.310242 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398414a4-13b6-473c-8fc3-8243592d16cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:38.310242 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398414a4-13b6-473c-8fc3-8243592d16cd admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:38.310242 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398414a4-13b6-473c-8fc3-8243592d16cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:38.310543 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398414a4-13b6-473c-8fc3-8243592d16cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:38.311060 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398414a4-13b6-473c-8fc3-8243592d16cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:33:38.311358 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398414a4-13b6-473c-8fc3-8243592d16cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:38.313109 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398414a4-13b6-473c-8fc3-8243592d16cd admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:38.329880 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1326/2599] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:33:38.333956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce69029-387a-49d0-a274-1673b57cc1d7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:38.353869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce69029-387a-49d0-a274-1673b57cc1d7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:38.363677 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931696f-35a4-4c1b-9df9-cf3852841039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:38.364746 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931696f-35a4-4c1b-9df9-cf3852841039 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:38.365239 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931696f-35a4-4c1b-9df9-cf3852841039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:38.365726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931696f-35a4-4c1b-9df9-cf3852841039 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:38.366826 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931696f-35a4-4c1b-9df9-cf3852841039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:38.370710 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931696f-35a4-4c1b-9df9-cf3852841039 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:38.454883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1274/2600] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:33:38 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:33:38.455096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398414a4-13b6-473c-8fc3-8243592d16cd admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:38.465470 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398414a4-13b6-473c-8fc3-8243592d16cd admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:38.549626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea48fe-1df6-44e6-8e4e-6fee52d685f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:38.550806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea48fe-1df6-44e6-8e4e-6fee52d685f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:38.551534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea48fe-1df6-44e6-8e4e-6fee52d685f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:38.552210 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea48fe-1df6-44e6-8e4e-6fee52d685f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:38.553637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea48fe-1df6-44e6-8e4e-6fee52d685f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:38.558182 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea48fe-1df6-44e6-8e4e-6fee52d685f4 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:38.610868 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1327/2601] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:33:38 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:33:38.614765 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931696f-35a4-4c1b-9df9-cf3852841039 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:38.632058 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931696f-35a4-4c1b-9df9-cf3852841039 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:38.644587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e289642-cf80-4c42-9e66-ed8ff9d1904c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:38.645227 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e289642-cf80-4c42-9e66-ed8ff9d1904c admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:38.645509 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e289642-cf80-4c42-9e66-ed8ff9d1904c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:38.645787 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e289642-cf80-4c42-9e66-ed8ff9d1904c admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:38.646511 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e289642-cf80-4c42-9e66-ed8ff9d1904c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:38.649604 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e289642-cf80-4c42-9e66-ed8ff9d1904c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:38.676113 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1275/2602] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:33:38.680141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea48fe-1df6-44e6-8e4e-6fee52d685f4 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:38.694939 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea48fe-1df6-44e6-8e4e-6fee52d685f4 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:38.701038 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9628c-1af2-44a4-ba6f-fb27e2161bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:38.701786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9628c-1af2-44a4-ba6f-fb27e2161bbe admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:38.702214 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9628c-1af2-44a4-ba6f-fb27e2161bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:38.702563 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9628c-1af2-44a4-ba6f-fb27e2161bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:38.703340 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9628c-1af2-44a4-ba6f-fb27e2161bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:38.705413 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9628c-1af2-44a4-ba6f-fb27e2161bbe admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:38.732219 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1328/2603] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:33:38.732473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e289642-cf80-4c42-9e66-ed8ff9d1904c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:38.744677 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e289642-cf80-4c42-9e66-ed8ff9d1904c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:38.752597 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7327f-f508-46a8-bf7a-2521634ff127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:38.753675 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7327f-f508-46a8-bf7a-2521634ff127 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:38.753977 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7327f-f508-46a8-bf7a-2521634ff127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:38.754265 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7327f-f508-46a8-bf7a-2521634ff127 admin admin] PATH_INFO: `/v3/projects/9f8ee5c42bea429392fd0e6a8891b7e9/users/6a46c1061e6243eb9efd5987c9f0ec29/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:38.774853 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7327f-f508-46a8-bf7a-2521634ff127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f8ee5c42bea429392fd0e6a8891b7e9, user_id=6a46c1061e6243eb9efd5987c9f0ec29, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:38.778550 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7327f-f508-46a8-bf7a-2521634ff127 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:38.799253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1276/2604] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:33:38 2022] PUT /identity/v3/projects/9f8ee5c42bea429392fd0e6a8891b7e9/users/6a46c1061e6243eb9efd5987c9f0ec29/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:33:38.812914 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3331827-bea4-49f6-9aec-8eb7b3be7880 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:38.813637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3331827-bea4-49f6-9aec-8eb7b3be7880 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:38.813873 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3331827-bea4-49f6-9aec-8eb7b3be7880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:38.850506 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f3331827-bea4-49f6-9aec-8eb7b3be7880 None None] MFA Rules not processed for user `6a46c1061e6243eb9efd5987c9f0ec29`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:38.851756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f3331827-bea4-49f6-9aec-8eb7b3be7880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:38.939237 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1329/2605] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:33:38.945170 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7327f-f508-46a8-bf7a-2521634ff127 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:38.973329 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:39.039956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7327f-f508-46a8-bf7a-2521634ff127 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:39.048267 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02be941-f297-4f0c-8ff5-c66a40c10f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:39.049327 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02be941-f297-4f0c-8ff5-c66a40c10f33 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:39.049808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02be941-f297-4f0c-8ff5-c66a40c10f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:39.050318 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02be941-f297-4f0c-8ff5-c66a40c10f33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:39.051543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02be941-f297-4f0c-8ff5-c66a40c10f33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:39.055294 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02be941-f297-4f0c-8ff5-c66a40c10f33 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:39.113661 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1277/2606] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:33:38 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:33:39.118031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3331827-bea4-49f6-9aec-8eb7b3be7880 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:39.130157 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3331827-bea4-49f6-9aec-8eb7b3be7880 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:39.191905 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:39.221452 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ae1b5-4255-448f-9375-828bb289705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:39.222408 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ae1b5-4255-448f-9375-828bb289705c admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:39.222947 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ae1b5-4255-448f-9375-828bb289705c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:39.223327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ae1b5-4255-448f-9375-828bb289705c admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:39.224130 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ae1b5-4255-448f-9375-828bb289705c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:39.226677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ae1b5-4255-448f-9375-828bb289705c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:39.255979 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1330/2607] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:33:39 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:33:39.259927 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02be941-f297-4f0c-8ff5-c66a40c10f33 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:39.279292 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02be941-f297-4f0c-8ff5-c66a40c10f33 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:39.284601 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61112b95-69f8-4c60-bcdc-716773550ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:39.285266 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61112b95-69f8-4c60-bcdc-716773550ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:39.285528 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61112b95-69f8-4c60-bcdc-716773550ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:39.285808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61112b95-69f8-4c60-bcdc-716773550ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:39.286648 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61112b95-69f8-4c60-bcdc-716773550ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:39.288330 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61112b95-69f8-4c60-bcdc-716773550ed7 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:39.304452 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1278/2608] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:33:39.309614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ae1b5-4255-448f-9375-828bb289705c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:39.321675 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ae1b5-4255-448f-9375-828bb289705c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:39.328010 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90ac43-d56e-4435-81bc-880979a30605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:39.329087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90ac43-d56e-4435-81bc-880979a30605 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:39.329368 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90ac43-d56e-4435-81bc-880979a30605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:39.329909 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90ac43-d56e-4435-81bc-880979a30605 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:39.330641 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90ac43-d56e-4435-81bc-880979a30605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:39.332391 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90ac43-d56e-4435-81bc-880979a30605 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:39.348364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1331/2609] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:33:39.350977 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61112b95-69f8-4c60-bcdc-716773550ed7 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:39.363967 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61112b95-69f8-4c60-bcdc-716773550ed7 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:39.371098 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901501ac-af99-47b2-8b5a-31b949af65f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:39.371852 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901501ac-af99-47b2-8b5a-31b949af65f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:39.372139 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901501ac-af99-47b2-8b5a-31b949af65f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:39.372452 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901501ac-af99-47b2-8b5a-31b949af65f2 admin admin] PATH_INFO: `/v3/projects/4ac6b93ead224af4a9cd433f42a6060a/users/b32701372a384d2f87a0570cf6863d1b/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:39.402074 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901501ac-af99-47b2-8b5a-31b949af65f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac6b93ead224af4a9cd433f42a6060a, user_id=b32701372a384d2f87a0570cf6863d1b, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:39.406284 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901501ac-af99-47b2-8b5a-31b949af65f2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:39.425366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1279/2610] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:33:39 2022] PUT /identity/v3/projects/4ac6b93ead224af4a9cd433f42a6060a/users/b32701372a384d2f87a0570cf6863d1b/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:33:39.438841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5c4fc-5fcc-40a8-bb94-ff720e84b64e None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:39.439709 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5c4fc-5fcc-40a8-bb94-ff720e84b64e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:39.440481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5c4fc-5fcc-40a8-bb94-ff720e84b64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:39.513071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-71b5c4fc-5fcc-40a8-bb94-ff720e84b64e None None] MFA Rules not processed for user `b32701372a384d2f87a0570cf6863d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:39.516282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-71b5c4fc-5fcc-40a8-bb94-ff720e84b64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:39.652498 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1332/2611] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:33:39.663433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901501ac-af99-47b2-8b5a-31b949af65f2 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:39.771016 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901501ac-af99-47b2-8b5a-31b949af65f2 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:39.786368 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296f328-3c7f-45c4-b713-cacab6f41895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:39.787553 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296f328-3c7f-45c4-b713-cacab6f41895 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:39.787863 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296f328-3c7f-45c4-b713-cacab6f41895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:39.788136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296f328-3c7f-45c4-b713-cacab6f41895 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:39.788862 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296f328-3c7f-45c4-b713-cacab6f41895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:39.790990 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296f328-3c7f-45c4-b713-cacab6f41895 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:39.838568 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1280/2612] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:33:39 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:33:39.840823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5c4fc-5fcc-40a8-bb94-ff720e84b64e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:39.861209 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5c4fc-5fcc-40a8-bb94-ff720e84b64e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:39.990770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a93f1-2167-4f39-8c3c-80a5f3351063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:39.991517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a93f1-2167-4f39-8c3c-80a5f3351063 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:39.991861 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a93f1-2167-4f39-8c3c-80a5f3351063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:39.992244 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a93f1-2167-4f39-8c3c-80a5f3351063 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:39.993083 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a93f1-2167-4f39-8c3c-80a5f3351063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:39.995056 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a93f1-2167-4f39-8c3c-80a5f3351063 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:40.020049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1333/2613] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:33:39 2022] POST /identity/v3/users => generated 300 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:33:40.023835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296f328-3c7f-45c4-b713-cacab6f41895 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:40.037579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296f328-3c7f-45c4-b713-cacab6f41895 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:40.044097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f47f8-2dae-4f05-8607-0b6e2786334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:40.044786 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f47f8-2dae-4f05-8607-0b6e2786334c admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:40.045723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f47f8-2dae-4f05-8607-0b6e2786334c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:40.045723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f47f8-2dae-4f05-8607-0b6e2786334c admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:40.046310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f47f8-2dae-4f05-8607-0b6e2786334c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:40.047910 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f47f8-2dae-4f05-8607-0b6e2786334c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:40.061784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1281/2614] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:33:40.065542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a93f1-2167-4f39-8c3c-80a5f3351063 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:40.085569 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a93f1-2167-4f39-8c3c-80a5f3351063 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:40.095847 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6658a85-f8c3-4022-b781-58bf63c8aeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:40.097330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6658a85-f8c3-4022-b781-58bf63c8aeaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:40.097619 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6658a85-f8c3-4022-b781-58bf63c8aeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:40.098536 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6658a85-f8c3-4022-b781-58bf63c8aeaa admin admin] PATH_INFO: `/v3/projects/650b9190cf54426caef5dda6f9bb845a/users/42728943634742008919a799c28f1434/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:40.123719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6658a85-f8c3-4022-b781-58bf63c8aeaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=650b9190cf54426caef5dda6f9bb845a, user_id=42728943634742008919a799c28f1434, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:40.127824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6658a85-f8c3-4022-b781-58bf63c8aeaa admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:40.148219 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1334/2615] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:33:40 2022] PUT /identity/v3/projects/650b9190cf54426caef5dda6f9bb845a/users/42728943634742008919a799c28f1434/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:33:40.154181 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f47f8-2dae-4f05-8607-0b6e2786334c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:40.166692 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f47f8-2dae-4f05-8607-0b6e2786334c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:40.225491 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:40.246418 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ae07c-552c-4f89-be39-edc81a3adbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:40.247474 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ae07c-552c-4f89-be39-edc81a3adbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:40.247862 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ae07c-552c-4f89-be39-edc81a3adbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:40.248528 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ae07c-552c-4f89-be39-edc81a3adbc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:40.249138 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ae07c-552c-4f89-be39-edc81a3adbc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:40.250885 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ae07c-552c-4f89-be39-edc81a3adbc3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:40.266861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1282/2616] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:33:40.268586 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6658a85-f8c3-4022-b781-58bf63c8aeaa admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:40.280479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6658a85-f8c3-4022-b781-58bf63c8aeaa admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:40.285817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2a262-49fc-4ca6-aa25-e81bc2175ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:40.286516 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2a262-49fc-4ca6-aa25-e81bc2175ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:40.286797 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2a262-49fc-4ca6-aa25-e81bc2175ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:40.287084 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2a262-49fc-4ca6-aa25-e81bc2175ae6 admin admin] PATH_INFO: `/v3/projects/650b9190cf54426caef5dda6f9bb845a/users/42728943634742008919a799c28f1434/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:40.289248 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2a262-49fc-4ca6-aa25-e81bc2175ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=650b9190cf54426caef5dda6f9bb845a, user_id=42728943634742008919a799c28f1434, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:40.292034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2a262-49fc-4ca6-aa25-e81bc2175ae6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:40.305175 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1335/2617] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:33:40 2022] PUT /identity/v3/projects/650b9190cf54426caef5dda6f9bb845a/users/42728943634742008919a799c28f1434/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:33:40.315895 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23b7d4-f5dc-424a-9c52-55ad24630b4f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:40.316207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23b7d4-f5dc-424a-9c52-55ad24630b4f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:40.316643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23b7d4-f5dc-424a-9c52-55ad24630b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:40.369625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-bf23b7d4-f5dc-424a-9c52-55ad24630b4f None None] MFA Rules not processed for user `42728943634742008919a799c28f1434`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:40.371632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-bf23b7d4-f5dc-424a-9c52-55ad24630b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:40.534001 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1283/2618] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:33:40.543140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2a262-49fc-4ca6-aa25-e81bc2175ae6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:40.544907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-59a2a262-49fc-4ca6-aa25-e81bc2175ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:40.550775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:40.630837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2a262-49fc-4ca6-aa25-e81bc2175ae6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:40.635161 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40287e09-9812-433f-a9f8-d33095d59227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:40.635841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40287e09-9812-433f-a9f8-d33095d59227 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:40.636123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40287e09-9812-433f-a9f8-d33095d59227 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:40.636591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40287e09-9812-433f-a9f8-d33095d59227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:40.649213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40287e09-9812-433f-a9f8-d33095d59227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:40.651035 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40287e09-9812-433f-a9f8-d33095d59227 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:40.664855 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1336/2619] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:33:41.394218 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23b7d4-f5dc-424a-9c52-55ad24630b4f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:41.395726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-bf23b7d4-f5dc-424a-9c52-55ad24630b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:41.410686 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23b7d4-f5dc-424a-9c52-55ad24630b4f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:41.415111 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef804428-4ef9-4cb4-a635-b7cf9ac5246d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:41.415812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804428-4ef9-4cb4-a635-b7cf9ac5246d service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:41.416108 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804428-4ef9-4cb4-a635-b7cf9ac5246d service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:41.416450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804428-4ef9-4cb4-a635-b7cf9ac5246d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:41.510063 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef804428-4ef9-4cb4-a635-b7cf9ac5246d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:41.512617 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef804428-4ef9-4cb4-a635-b7cf9ac5246d service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:41.523384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1284/2620] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:33:45.655743 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40287e09-9812-433f-a9f8-d33095d59227 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:45.657313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-40287e09-9812-433f-a9f8-d33095d59227 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:45.696332 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef804428-4ef9-4cb4-a635-b7cf9ac5246d service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:45.706449 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef804428-4ef9-4cb4-a635-b7cf9ac5246d service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:45.710374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f4151-20a6-4be9-9c55-5e18c229db93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:45.711002 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f4151-20a6-4be9-9c55-5e18c229db93 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:45.711281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f4151-20a6-4be9-9c55-5e18c229db93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:45.711558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f4151-20a6-4be9-9c55-5e18c229db93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:45.762389 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40287e09-9812-433f-a9f8-d33095d59227 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:45.768434 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b983dac-057a-4b39-815b-b626339a32b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0005b0c9582e430e9cb85704a4505bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:45.769080 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b983dac-057a-4b39-815b-b626339a32b6 service placement] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:45.769567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b983dac-057a-4b39-815b-b626339a32b6 service placement] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:45.769851 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b983dac-057a-4b39-815b-b626339a32b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:45.772059 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0b983dac-057a-4b39-815b-b626339a32b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:45.785640 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f4151-20a6-4be9-9c55-5e18c229db93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:45.786914 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b983dac-057a-4b39-815b-b626339a32b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:45.788474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b983dac-057a-4b39-815b-b626339a32b6 service placement] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:45.788698 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f4151-20a6-4be9-9c55-5e18c229db93 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:45.802470 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1285/2621] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:33:45.803266 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1337/2622] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:33:46.038803 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f4151-20a6-4be9-9c55-5e18c229db93 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:46.040447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-dd6f4151-20a6-4be9-9c55-5e18c229db93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:46.046995 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:46.128657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f4151-20a6-4be9-9c55-5e18c229db93 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:46.128657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fb23d-b71a-4a3b-b208-40e81a6af6c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:46.128657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fb23d-b71a-4a3b-b208-40e81a6af6c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:46.128657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fb23d-b71a-4a3b-b208-40e81a6af6c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:46.129002 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fb23d-b71a-4a3b-b208-40e81a6af6c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:46.130369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-348fb23d-b71a-4a3b-b208-40e81a6af6c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:46.209522 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fb23d-b71a-4a3b-b208-40e81a6af6c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:46.211306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fb23d-b71a-4a3b-b208-40e81a6af6c7 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:46.223672 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1286/2623] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:33:46.708974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b983dac-057a-4b39-815b-b626339a32b6 service placement] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:46.710600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0b983dac-057a-4b39-815b-b626339a32b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:46.723782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b983dac-057a-4b39-815b-b626339a32b6 service placement] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:46.727536 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb215851-cc52-4b6c-9e0d-13bb5c2a853f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:46.728159 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb215851-cc52-4b6c-9e0d-13bb5c2a853f service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:46.728472 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb215851-cc52-4b6c-9e0d-13bb5c2a853f service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:46.728747 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb215851-cc52-4b6c-9e0d-13bb5c2a853f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:46.731391 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-cb215851-cc52-4b6c-9e0d-13bb5c2a853f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:46.742295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb215851-cc52-4b6c-9e0d-13bb5c2a853f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:46.744070 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb215851-cc52-4b6c-9e0d-13bb5c2a853f service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:46.757925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1338/2624] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:33:46.909607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cbe0e-2b18-4531-8628-9ff6bd8516e0 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:46.911560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cbe0e-2b18-4531-8628-9ff6bd8516e0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:46.912140 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cbe0e-2b18-4531-8628-9ff6bd8516e0 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:46.914462 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1287/2625] 10.222.0.48 () {54 vars in 921 bytes} [Thu Aug 4 10:33:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:33:46.921779 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d04d93-6fc5-4174-b6b6-9b9d2af64d90 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:46.922265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d04d93-6fc5-4174-b6b6-9b9d2af64d90 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:46.922761 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d04d93-6fc5-4174-b6b6-9b9d2af64d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:46.965555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d8d04d93-6fc5-4174-b6b6-9b9d2af64d90 None None] MFA Rules not processed for user `592539924feb44ad8ea520d8539b6608`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:46.966986 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d8d04d93-6fc5-4174-b6b6-9b9d2af64d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:47.024493 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:47.074148 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1339/2626] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Aug 4 10:33:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:33:47.083616 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cbe0e-2b18-4531-8628-9ff6bd8516e0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:47.085655 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-334cbe0e-2b18-4531-8628-9ff6bd8516e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:47.168803 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cbe0e-2b18-4531-8628-9ff6bd8516e0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:47.172844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dd205-d5bb-4888-9ab2-5a91527a945c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc15e64c987488f812d1cdd0c82c7ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:47.173482 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dd205-d5bb-4888-9ab2-5a91527a945c service glance] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:47.173772 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dd205-d5bb-4888-9ab2-5a91527a945c service glance] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:47.174051 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dd205-d5bb-4888-9ab2-5a91527a945c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:47.185852 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4dd205-d5bb-4888-9ab2-5a91527a945c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:47.187889 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4dd205-d5bb-4888-9ab2-5a91527a945c service glance] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:47.200302 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1288/2627] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:33:47.289851 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba5e1c-ad30-4c67-91d8-360a95b0a85a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:47.290168 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba5e1c-ad30-4c67-91d8-360a95b0a85a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:47.290451 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba5e1c-ad30-4c67-91d8-360a95b0a85a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:47.296704 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1340/2628] 10.222.0.48 () {54 vars in 921 bytes} [Thu Aug 4 10:33:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:33:47.297900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaf573-b6e8-42a0-baa8-1567084961ff None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:47.298194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaf573-b6e8-42a0-baa8-1567084961ff None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:47.298475 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaf573-b6e8-42a0-baa8-1567084961ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:47.322295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d5eaf573-b6e8-42a0-baa8-1567084961ff None None] MFA Rules not processed for user `2021ac71491f4bebb0fbd91c533dc383`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:47.330312 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d5eaf573-b6e8-42a0-baa8-1567084961ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:47.339607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1289/2629] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Aug 4 10:33:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:33:47.356843 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba5e1c-ad30-4c67-91d8-360a95b0a85a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:47.379927 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba5e1c-ad30-4c67-91d8-360a95b0a85a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:47.387323 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cbe52-3cb1-48f1-bf47-dfaa810bb121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:47.388521 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cbe52-3cb1-48f1-bf47-dfaa810bb121 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:47.389164 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cbe52-3cb1-48f1-bf47-dfaa810bb121 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:47.389802 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cbe52-3cb1-48f1-bf47-dfaa810bb121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:47.406916 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609cbe52-3cb1-48f1-bf47-dfaa810bb121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:47.409782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609cbe52-3cb1-48f1-bf47-dfaa810bb121 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:47.424810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1341/2630] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:33:47.583870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3804a-1475-4083-8df1-1b3795f39434 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:47.584420 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3804a-1475-4083-8df1-1b3795f39434 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:47.585647 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3804a-1475-4083-8df1-1b3795f39434 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:47.586207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1290/2631] 10.222.0.48 () {54 vars in 921 bytes} [Thu Aug 4 10:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:33:47.595100 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd0874-e9de-425a-bf4b-ee1c4e7f0e69 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:47.595100 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd0874-e9de-425a-bf4b-ee1c4e7f0e69 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:47.595811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd0874-e9de-425a-bf4b-ee1c4e7f0e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:47.630725 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b4bd0874-e9de-425a-bf4b-ee1c4e7f0e69 None None] MFA Rules not processed for user `592539924feb44ad8ea520d8539b6608`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:47.632911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b4bd0874-e9de-425a-bf4b-ee1c4e7f0e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:47.649351 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1342/2632] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Aug 4 10:33:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:33:47.661712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3804a-1475-4083-8df1-1b3795f39434 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:47.676606 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3804a-1475-4083-8df1-1b3795f39434 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:47.680955 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbe039-82ab-4911-a55a-e7636a4fe728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:47.681617 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbe039-82ab-4911-a55a-e7636a4fe728 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:47.681894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbe039-82ab-4911-a55a-e7636a4fe728 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:47.682178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbe039-82ab-4911-a55a-e7636a4fe728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:47.694319 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbe039-82ab-4911-a55a-e7636a4fe728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:47.695882 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbe039-82ab-4911-a55a-e7636a4fe728 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:47.709811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1291/2633] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:33:48.222149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd0874-e9de-425a-bf4b-ee1c4e7f0e69 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:48.296775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd0874-e9de-425a-bf4b-ee1c4e7f0e69 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:48.301808 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc2af2-4d5d-4fc9-adf2-4946076a5833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:48.302468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc2af2-4d5d-4fc9-adf2-4946076a5833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:48.302903 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc2af2-4d5d-4fc9-adf2-4946076a5833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:48.303186 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc2af2-4d5d-4fc9-adf2-4946076a5833 admin admin] PATH_INFO: `/v3/users/6a46c1061e6243eb9efd5987c9f0ec29` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:48.304704 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc2af2-4d5d-4fc9-adf2-4946076a5833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a46c1061e6243eb9efd5987c9f0ec29)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:48.307066 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc2af2-4d5d-4fc9-adf2-4946076a5833 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:48.372721 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9ebc2af2-4d5d-4fc9-adf2-4946076a5833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a46c1061e6243eb9efd5987c9f0ec29'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:48.373412 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9ebc2af2-4d5d-4fc9-adf2-4946076a5833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a46c1061e6243eb9efd5987c9f0ec29'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:48.381410 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9ebc2af2-4d5d-4fc9-adf2-4946076a5833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a46c1061e6243eb9efd5987c9f0ec29'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:48.382123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9ebc2af2-4d5d-4fc9-adf2-4946076a5833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a46c1061e6243eb9efd5987c9f0ec29'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:48.398416 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9ebc2af2-4d5d-4fc9-adf2-4946076a5833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a46c1061e6243eb9efd5987c9f0ec29'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:48.415384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1343/2634] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:33:48 2022] DELETE /identity/v3/users/6a46c1061e6243eb9efd5987c9f0ec29 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:33:48.420462 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c30e8a-d872-4a6b-8b62-64cd15a5ffe4 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:48.421192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c30e8a-d872-4a6b-8b62-64cd15a5ffe4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:48.421192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c30e8a-d872-4a6b-8b62-64cd15a5ffe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:48.441148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-e5c30e8a-d872-4a6b-8b62-64cd15a5ffe4 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:48.442387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e5c30e8a-d872-4a6b-8b62-64cd15a5ffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:48.478363 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:48.508873 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1292/2635] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:33:48.522468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc2af2-4d5d-4fc9-adf2-4946076a5833 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:48.524438 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9ebc2af2-4d5d-4fc9-adf2-4946076a5833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:48.561934 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:48.589440 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc2af2-4d5d-4fc9-adf2-4946076a5833 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:48.593581 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9b472-5705-435f-b5ae-7e2959d3dac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:48.594233 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9b472-5705-435f-b5ae-7e2959d3dac8 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:48.594501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9b472-5705-435f-b5ae-7e2959d3dac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:48.595240 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9b472-5705-435f-b5ae-7e2959d3dac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:48.607655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9b472-5705-435f-b5ae-7e2959d3dac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:48.609192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9b472-5705-435f-b5ae-7e2959d3dac8 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:48.621830 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1344/2636] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:33:49.161463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c30e8a-d872-4a6b-8b62-64cd15a5ffe4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:49.163193 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e5c30e8a-d872-4a6b-8b62-64cd15a5ffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:49.177727 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c30e8a-d872-4a6b-8b62-64cd15a5ffe4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:49.182912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbb079-faef-4daf-bbd0-c4035e060b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:49.183962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbb079-faef-4daf-bbd0-c4035e060b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:49.184321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbb079-faef-4daf-bbd0-c4035e060b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:49.184608 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbb079-faef-4daf-bbd0-c4035e060b24 admin admin] PATH_INFO: `/v3/projects/9f8ee5c42bea429392fd0e6a8891b7e9` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:49.185906 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbb079-faef-4daf-bbd0-c4035e060b24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f8ee5c42bea429392fd0e6a8891b7e9)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:49.188062 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbb079-faef-4daf-bbd0-c4035e060b24 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:49.266078 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-27bbb079-faef-4daf-bbd0-c4035e060b24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f8ee5c42bea429392fd0e6a8891b7e9', 'request_id': 'req-27bbb079-faef-4daf-bbd0-c4035e060b24'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:49.272808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-27bbb079-faef-4daf-bbd0-c4035e060b24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f8ee5c42bea429392fd0e6a8891b7e9', 'request_id': 'req-27bbb079-faef-4daf-bbd0-c4035e060b24'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:49.281506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-27bbb079-faef-4daf-bbd0-c4035e060b24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f8ee5c42bea429392fd0e6a8891b7e9', 'request_id': 'req-27bbb079-faef-4daf-bbd0-c4035e060b24'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:49.297505 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-27bbb079-faef-4daf-bbd0-c4035e060b24 admin admin] The token cache is being invalidate because project 9f8ee5c42bea429392fd0e6a8891b7e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:33:49.297802 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-27bbb079-faef-4daf-bbd0-c4035e060b24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:49.298497 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-27bbb079-faef-4daf-bbd0-c4035e060b24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:49.301051 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1293/2637] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:33:49 2022] DELETE /identity/v3/projects/9f8ee5c42bea429392fd0e6a8891b7e9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:33:49.306546 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9b472-5705-435f-b5ae-7e2959d3dac8 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:49.328517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9b472-5705-435f-b5ae-7e2959d3dac8 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:49.408392 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca00f59-1419-4a9a-b2d4-05dedfd419af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:49.409606 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca00f59-1419-4a9a-b2d4-05dedfd419af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:49.410158 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca00f59-1419-4a9a-b2d4-05dedfd419af admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:49.410745 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca00f59-1419-4a9a-b2d4-05dedfd419af admin admin] PATH_INFO: `/v3/users/b32701372a384d2f87a0570cf6863d1b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:49.412356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca00f59-1419-4a9a-b2d4-05dedfd419af admin admin] RBAC: Authorizing `identity:delete_user(user_id=b32701372a384d2f87a0570cf6863d1b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:49.415494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca00f59-1419-4a9a-b2d4-05dedfd419af admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:49.513108 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-eca00f59-1419-4a9a-b2d4-05dedfd419af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b32701372a384d2f87a0570cf6863d1b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:49.513950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-eca00f59-1419-4a9a-b2d4-05dedfd419af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b32701372a384d2f87a0570cf6863d1b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:49.523474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-eca00f59-1419-4a9a-b2d4-05dedfd419af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b32701372a384d2f87a0570cf6863d1b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:49.524634 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-eca00f59-1419-4a9a-b2d4-05dedfd419af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b32701372a384d2f87a0570cf6863d1b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:49.540384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-eca00f59-1419-4a9a-b2d4-05dedfd419af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b32701372a384d2f87a0570cf6863d1b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:49.565529 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1345/2638] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:33:49 2022] DELETE /identity/v3/users/b32701372a384d2f87a0570cf6863d1b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:33:49.920744 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbb079-faef-4daf-bbd0-c4035e060b24 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:49.923679 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-27bbb079-faef-4daf-bbd0-c4035e060b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:49.960682 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbb079-faef-4daf-bbd0-c4035e060b24 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:50.062645 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c7aeb-1164-440e-8dc8-df101a226baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:50.063402 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c7aeb-1164-440e-8dc8-df101a226baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:50.063760 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c7aeb-1164-440e-8dc8-df101a226baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:50.064112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c7aeb-1164-440e-8dc8-df101a226baf admin admin] PATH_INFO: `/v3/projects/4ac6b93ead224af4a9cd433f42a6060a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:50.076228 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c7aeb-1164-440e-8dc8-df101a226baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac6b93ead224af4a9cd433f42a6060a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:50.076228 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c7aeb-1164-440e-8dc8-df101a226baf admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:50.142693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-414c7aeb-1164-440e-8dc8-df101a226baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac6b93ead224af4a9cd433f42a6060a', 'request_id': 'req-414c7aeb-1164-440e-8dc8-df101a226baf'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:50.154117 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-414c7aeb-1164-440e-8dc8-df101a226baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac6b93ead224af4a9cd433f42a6060a', 'request_id': 'req-414c7aeb-1164-440e-8dc8-df101a226baf'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:50.163450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-414c7aeb-1164-440e-8dc8-df101a226baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac6b93ead224af4a9cd433f42a6060a', 'request_id': 'req-414c7aeb-1164-440e-8dc8-df101a226baf'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:50.168554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:50.178694 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-414c7aeb-1164-440e-8dc8-df101a226baf admin admin] The token cache is being invalidate because project 4ac6b93ead224af4a9cd433f42a6060a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:33:50.179123 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-414c7aeb-1164-440e-8dc8-df101a226baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:50.179789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-414c7aeb-1164-440e-8dc8-df101a226baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:50.182552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1294/2639] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:33:49 2022] DELETE /identity/v3/projects/4ac6b93ead224af4a9cd433f42a6060a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:33:50.186874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca00f59-1419-4a9a-b2d4-05dedfd419af admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:50.188698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-eca00f59-1419-4a9a-b2d4-05dedfd419af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:50.207472 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca00f59-1419-4a9a-b2d4-05dedfd419af admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:50.271877 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:50.287458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744a1f8-811b-458b-9941-1f9274d3ea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:50.288803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744a1f8-811b-458b-9941-1f9274d3ea23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:50.289262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744a1f8-811b-458b-9941-1f9274d3ea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:50.289897 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744a1f8-811b-458b-9941-1f9274d3ea23 admin admin] PATH_INFO: `/v3/users/42728943634742008919a799c28f1434` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:50.291324 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744a1f8-811b-458b-9941-1f9274d3ea23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42728943634742008919a799c28f1434)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:50.293787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744a1f8-811b-458b-9941-1f9274d3ea23 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:50.363547 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e744a1f8-811b-458b-9941-1f9274d3ea23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42728943634742008919a799c28f1434'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:50.364597 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e744a1f8-811b-458b-9941-1f9274d3ea23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42728943634742008919a799c28f1434'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:50.375915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e744a1f8-811b-458b-9941-1f9274d3ea23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42728943634742008919a799c28f1434'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:50.376718 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e744a1f8-811b-458b-9941-1f9274d3ea23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42728943634742008919a799c28f1434'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:50.395769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e744a1f8-811b-458b-9941-1f9274d3ea23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42728943634742008919a799c28f1434'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:50.412595 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1346/2640] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:33:50 2022] DELETE /identity/v3/users/42728943634742008919a799c28f1434 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:33:50.723032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c7aeb-1164-440e-8dc8-df101a226baf admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:50.724600 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-414c7aeb-1164-440e-8dc8-df101a226baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:50.747703 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c7aeb-1164-440e-8dc8-df101a226baf admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:50.842948 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109214a7-dd18-4cec-93d6-d4f3dcecc3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:50.843929 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109214a7-dd18-4cec-93d6-d4f3dcecc3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:50.844472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109214a7-dd18-4cec-93d6-d4f3dcecc3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:50.844924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109214a7-dd18-4cec-93d6-d4f3dcecc3fa admin admin] PATH_INFO: `/v3/projects/650b9190cf54426caef5dda6f9bb845a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:50.846578 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109214a7-dd18-4cec-93d6-d4f3dcecc3fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=650b9190cf54426caef5dda6f9bb845a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:50.848625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109214a7-dd18-4cec-93d6-d4f3dcecc3fa admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:50.907599 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-109214a7-dd18-4cec-93d6-d4f3dcecc3fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '650b9190cf54426caef5dda6f9bb845a', 'request_id': 'req-109214a7-dd18-4cec-93d6-d4f3dcecc3fa'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:50.914263 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-109214a7-dd18-4cec-93d6-d4f3dcecc3fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '650b9190cf54426caef5dda6f9bb845a', 'request_id': 'req-109214a7-dd18-4cec-93d6-d4f3dcecc3fa'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:50.922720 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-109214a7-dd18-4cec-93d6-d4f3dcecc3fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '650b9190cf54426caef5dda6f9bb845a', 'request_id': 'req-109214a7-dd18-4cec-93d6-d4f3dcecc3fa'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:50.934916 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-109214a7-dd18-4cec-93d6-d4f3dcecc3fa admin admin] The token cache is being invalidate because project 650b9190cf54426caef5dda6f9bb845a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:33:50.934916 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-109214a7-dd18-4cec-93d6-d4f3dcecc3fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:50.937067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-109214a7-dd18-4cec-93d6-d4f3dcecc3fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:33:50.938088 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1295/2641] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:33:50 2022] DELETE /identity/v3/projects/650b9190cf54426caef5dda6f9bb845a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:33:50.944787 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33de7b5-8585-4ce2-8cc1-5b27b5a6265d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:50.945081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33de7b5-8585-4ce2-8cc1-5b27b5a6265d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:50.945375 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33de7b5-8585-4ce2-8cc1-5b27b5a6265d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:50.967466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c33de7b5-8585-4ce2-8cc1-5b27b5a6265d None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:50.969091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c33de7b5-8585-4ce2-8cc1-5b27b5a6265d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:51.040682 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1347/2642] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:33:51.049902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba29054-c8bb-4c6e-9ea4-5feb7ccb3abb None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:51.050188 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba29054-c8bb-4c6e-9ea4-5feb7ccb3abb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:51.050465 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba29054-c8bb-4c6e-9ea4-5feb7ccb3abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:51.071773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-aba29054-c8bb-4c6e-9ea4-5feb7ccb3abb None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:51.073902 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-aba29054-c8bb-4c6e-9ea4-5feb7ccb3abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:51.082820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1296/2643] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:33:51.086760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33de7b5-8585-4ce2-8cc1-5b27b5a6265d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:51.097668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33de7b5-8585-4ce2-8cc1-5b27b5a6265d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:51.103227 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68783ee1-230c-4f8c-9149-6353a805cad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:51.103867 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68783ee1-230c-4f8c-9149-6353a805cad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:51.104154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68783ee1-230c-4f8c-9149-6353a805cad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:51.104633 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68783ee1-230c-4f8c-9149-6353a805cad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:51.105578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68783ee1-230c-4f8c-9149-6353a805cad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:33:51.105892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68783ee1-230c-4f8c-9149-6353a805cad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:51.107527 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68783ee1-230c-4f8c-9149-6353a805cad5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:51.125564 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1348/2644] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:33:51.127756 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba29054-c8bb-4c6e-9ea4-5feb7ccb3abb None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:51.140658 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba29054-c8bb-4c6e-9ea4-5feb7ccb3abb None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:51.147093 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06549396-ab55-448b-b045-8b2ef043a318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:51.147810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06549396-ab55-448b-b045-8b2ef043a318 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:51.148093 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06549396-ab55-448b-b045-8b2ef043a318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:51.148401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06549396-ab55-448b-b045-8b2ef043a318 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:51.149092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06549396-ab55-448b-b045-8b2ef043a318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:51.151008 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06549396-ab55-448b-b045-8b2ef043a318 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:51.185800 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1297/2645] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:33:51 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:33:51.189551 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68783ee1-230c-4f8c-9149-6353a805cad5 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:51.201447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68783ee1-230c-4f8c-9149-6353a805cad5 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:51.227718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aca06-60c7-4bb9-b779-aaf4620a0b0a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:51.228303 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aca06-60c7-4bb9-b779-aaf4620a0b0a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:51.228796 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295aca06-60c7-4bb9-b779-aaf4620a0b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:51.250731 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-295aca06-60c7-4bb9-b779-aaf4620a0b0a None None] MFA Rules not processed for user `306a5f4d7e0d44bd9a27145bd35a07fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:51.251963 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-295aca06-60c7-4bb9-b779-aaf4620a0b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:51.283340 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e810094-a4c8-463d-8bfd-b6596984c19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:51.284092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e810094-a4c8-463d-8bfd-b6596984c19f admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:51.284484 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e810094-a4c8-463d-8bfd-b6596984c19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:51.285275 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e810094-a4c8-463d-8bfd-b6596984c19f admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:51.286049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e810094-a4c8-463d-8bfd-b6596984c19f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:51.288505 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e810094-a4c8-463d-8bfd-b6596984c19f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:51.299777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:51.317356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1349/2646] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:33:51 2022] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:33:51.321777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e810094-a4c8-463d-8bfd-b6596984c19f admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:51.330158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:51.334703 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e810094-a4c8-463d-8bfd-b6596984c19f admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:51.341956 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3b084-c25b-42bc-b6b6-9f731e058769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:51.342377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1298/2647] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Aug 4 10:33:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:33:51.343177 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3b084-c25b-42bc-b6b6-9f731e058769 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:51.343690 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3b084-c25b-42bc-b6b6-9f731e058769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:51.343979 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3b084-c25b-42bc-b6b6-9f731e058769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:51.344754 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3b084-c25b-42bc-b6b6-9f731e058769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:51.346382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3b084-c25b-42bc-b6b6-9f731e058769 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:51.357177 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aca06-60c7-4bb9-b779-aaf4620a0b0a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:51.358501 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-295aca06-60c7-4bb9-b779-aaf4620a0b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:51.359631 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1350/2648] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:33:51.365954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3b084-c25b-42bc-b6b6-9f731e058769 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:51.377556 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3b084-c25b-42bc-b6b6-9f731e058769 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:51.383425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0a8de-833e-46e8-9630-12f19440aa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:51.384077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0a8de-833e-46e8-9630-12f19440aa21 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:51.384398 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0a8de-833e-46e8-9630-12f19440aa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:51.384677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0a8de-833e-46e8-9630-12f19440aa21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:51.385381 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0a8de-833e-46e8-9630-12f19440aa21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:51.387685 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0a8de-833e-46e8-9630-12f19440aa21 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:51.398816 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1351/2649] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:33:51.404538 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0a8de-833e-46e8-9630-12f19440aa21 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:51.415075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0a8de-833e-46e8-9630-12f19440aa21 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:51.421053 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4e36e-48d8-49a3-8dfc-1324b728e7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:51.421743 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4e36e-48d8-49a3-8dfc-1324b728e7bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:51.422123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4e36e-48d8-49a3-8dfc-1324b728e7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:51.422431 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4e36e-48d8-49a3-8dfc-1324b728e7bf admin admin] PATH_INFO: `/v3/projects/4672ab35b32d444eb856586432e6db8a/users/8c6b28e87bbc4f44a01f741a8c689b12/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:51.439447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4e36e-48d8-49a3-8dfc-1324b728e7bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4672ab35b32d444eb856586432e6db8a, user_id=8c6b28e87bbc4f44a01f741a8c689b12, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:51.442124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4e36e-48d8-49a3-8dfc-1324b728e7bf admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:51.444706 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295aca06-60c7-4bb9-b779-aaf4620a0b0a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:51.455173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab72a8-89aa-4b05-9503-3e818296c7ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878797620be54b74a3e8582c78ba78d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:51.456355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab72a8-89aa-4b05-9503-3e818296c7ba service swift] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:51.456714 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab72a8-89aa-4b05-9503-3e818296c7ba service swift] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:51.457053 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab72a8-89aa-4b05-9503-3e818296c7ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:51.460469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1352/2650] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:33:51 2022] PUT /identity/v3/projects/4672ab35b32d444eb856586432e6db8a/users/8c6b28e87bbc4f44a01f741a8c689b12/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:33:51.467649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab72a8-89aa-4b05-9503-3e818296c7ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:51.469436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab72a8-89aa-4b05-9503-3e818296c7ba service swift] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:51.472710 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf52459-03d9-4868-ada1-f61cd7e76f5e None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:51.473019 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf52459-03d9-4868-ada1-f61cd7e76f5e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:51.473289 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf52459-03d9-4868-ada1-f61cd7e76f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:51.480352 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1299/2651] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Aug 4 10:33:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 10:33:51.517272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-0bf52459-03d9-4868-ada1-f61cd7e76f5e None None] MFA Rules not processed for user `8c6b28e87bbc4f44a01f741a8c689b12`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:33:51.518546 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0bf52459-03d9-4868-ada1-f61cd7e76f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:51.606869 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1353/2652] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:33:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:33:51.619507 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab72a8-89aa-4b05-9503-3e818296c7ba service swift] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:51.621723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-afab72a8-89aa-4b05-9503-3e818296c7ba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:51.741881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab72a8-89aa-4b05-9503-3e818296c7ba service swift] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:51.819189 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30026a4-b261-4d5a-8390-6bec41c3f557 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc15e64c987488f812d1cdd0c82c7ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:51.820106 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30026a4-b261-4d5a-8390-6bec41c3f557 service glance] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:51.820597 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30026a4-b261-4d5a-8390-6bec41c3f557 service glance] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:51.821005 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30026a4-b261-4d5a-8390-6bec41c3f557 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:51.835947 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30026a4-b261-4d5a-8390-6bec41c3f557 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:51.837752 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30026a4-b261-4d5a-8390-6bec41c3f557 service glance] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:51.857041 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1300/2653] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:33:52.405579 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf52459-03d9-4868-ada1-f61cd7e76f5e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:52.407901 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0bf52459-03d9-4868-ada1-f61cd7e76f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:52.554683 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf52459-03d9-4868-ada1-f61cd7e76f5e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:52.560190 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cfc03-c157-4317-abe6-c6f7fae1129c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:52.561329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cfc03-c157-4317-abe6-c6f7fae1129c service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:52.561955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cfc03-c157-4317-abe6-c6f7fae1129c service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:52.562574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cfc03-c157-4317-abe6-c6f7fae1129c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:52.565154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e17cfc03-c157-4317-abe6-c6f7fae1129c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:52.629530 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:52.664275 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cfc03-c157-4317-abe6-c6f7fae1129c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:52.665793 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cfc03-c157-4317-abe6-c6f7fae1129c service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:52.679443 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1354/2654] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:33:57.888306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30026a4-b261-4d5a-8390-6bec41c3f557 service glance] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:33:57.890825 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c30026a4-b261-4d5a-8390-6bec41c3f557 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:57.966170 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:58.043791 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30026a4-b261-4d5a-8390-6bec41c3f557 service glance] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:33:58.051706 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48772483-e94f-464b-ae22-b9b021bfbb2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0005b0c9582e430e9cb85704a4505bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:33:58.054464 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48772483-e94f-464b-ae22-b9b021bfbb2c service placement] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:33:58.055023 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48772483-e94f-464b-ae22-b9b021bfbb2c service placement] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:33:58.055520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48772483-e94f-464b-ae22-b9b021bfbb2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:33:58.060578 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-48772483-e94f-464b-ae22-b9b021bfbb2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:33:58.087858 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48772483-e94f-464b-ae22-b9b021bfbb2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:33:58.090402 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48772483-e94f-464b-ae22-b9b021bfbb2c service placement] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:33:58.114631 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1301/2655] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:33:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:34:01.648568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cfc03-c157-4317-abe6-c6f7fae1129c service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:01.650302 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e17cfc03-c157-4317-abe6-c6f7fae1129c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:01.669890 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cfc03-c157-4317-abe6-c6f7fae1129c service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:01.674953 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817e256-39a2-4794-ad12-cad21601fb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:01.675687 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817e256-39a2-4794-ad12-cad21601fb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:01.676065 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817e256-39a2-4794-ad12-cad21601fb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:01.676442 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817e256-39a2-4794-ad12-cad21601fb5d admin admin] PATH_INFO: `/v3/users/c6f04d09f9394463b55a08fa1623e439` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:01.677719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817e256-39a2-4794-ad12-cad21601fb5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6f04d09f9394463b55a08fa1623e439)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:01.679747 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817e256-39a2-4794-ad12-cad21601fb5d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:01.741789 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3817e256-39a2-4794-ad12-cad21601fb5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6f04d09f9394463b55a08fa1623e439'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:01.742368 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3817e256-39a2-4794-ad12-cad21601fb5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6f04d09f9394463b55a08fa1623e439'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:01.749681 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3817e256-39a2-4794-ad12-cad21601fb5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6f04d09f9394463b55a08fa1623e439'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:01.750337 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3817e256-39a2-4794-ad12-cad21601fb5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6f04d09f9394463b55a08fa1623e439'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:01.762660 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3817e256-39a2-4794-ad12-cad21601fb5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6f04d09f9394463b55a08fa1623e439'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:01.779955 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1355/2656] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:34:01 2022] DELETE /identity/v3/users/c6f04d09f9394463b55a08fa1623e439 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:34:01.960816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48772483-e94f-464b-ae22-b9b021bfbb2c service placement] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:01.972585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48772483-e94f-464b-ae22-b9b021bfbb2c service placement] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:02.034564 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045267d-7310-4a02-a936-c4f2bf6c289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:02.035212 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045267d-7310-4a02-a936-c4f2bf6c289a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:02.035494 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045267d-7310-4a02-a936-c4f2bf6c289a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:02.035773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045267d-7310-4a02-a936-c4f2bf6c289a admin admin] PATH_INFO: `/v3/projects/4c20f6027a9c418b85d37b1202b82616` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:02.036976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045267d-7310-4a02-a936-c4f2bf6c289a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c20f6027a9c418b85d37b1202b82616)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:02.038889 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045267d-7310-4a02-a936-c4f2bf6c289a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:02.090351 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4045267d-7310-4a02-a936-c4f2bf6c289a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c20f6027a9c418b85d37b1202b82616', 'request_id': 'req-4045267d-7310-4a02-a936-c4f2bf6c289a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:02.096557 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4045267d-7310-4a02-a936-c4f2bf6c289a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c20f6027a9c418b85d37b1202b82616', 'request_id': 'req-4045267d-7310-4a02-a936-c4f2bf6c289a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:02.104429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4045267d-7310-4a02-a936-c4f2bf6c289a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c20f6027a9c418b85d37b1202b82616', 'request_id': 'req-4045267d-7310-4a02-a936-c4f2bf6c289a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:02.115070 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4045267d-7310-4a02-a936-c4f2bf6c289a admin admin] The token cache is being invalidate because project 4c20f6027a9c418b85d37b1202b82616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:34:02.115360 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4045267d-7310-4a02-a936-c4f2bf6c289a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:02.116025 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4045267d-7310-4a02-a936-c4f2bf6c289a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:02.117610 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1302/2657] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:34:01 2022] DELETE /identity/v3/projects/4c20f6027a9c418b85d37b1202b82616 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:34:02.122145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817e256-39a2-4794-ad12-cad21601fb5d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:02.123596 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3817e256-39a2-4794-ad12-cad21601fb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:02.137813 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817e256-39a2-4794-ad12-cad21601fb5d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:02.197388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cc092-ab3e-45a7-bd62-acde3f4ac2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:02.198767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cc092-ab3e-45a7-bd62-acde3f4ac2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:02.199098 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cc092-ab3e-45a7-bd62-acde3f4ac2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:02.199382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cc092-ab3e-45a7-bd62-acde3f4ac2f7 admin admin] PATH_INFO: `/v3/users/150cb6ee570c4a2f9c9e83fd881b9652` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:02.200614 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cc092-ab3e-45a7-bd62-acde3f4ac2f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=150cb6ee570c4a2f9c9e83fd881b9652)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:02.202681 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cc092-ab3e-45a7-bd62-acde3f4ac2f7 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:02.255523 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-118cc092-ab3e-45a7-bd62-acde3f4ac2f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '150cb6ee570c4a2f9c9e83fd881b9652'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:02.256202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-118cc092-ab3e-45a7-bd62-acde3f4ac2f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '150cb6ee570c4a2f9c9e83fd881b9652'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:02.263704 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-118cc092-ab3e-45a7-bd62-acde3f4ac2f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '150cb6ee570c4a2f9c9e83fd881b9652'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:02.264426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-118cc092-ab3e-45a7-bd62-acde3f4ac2f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '150cb6ee570c4a2f9c9e83fd881b9652'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:02.266511 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:02.277990 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-118cc092-ab3e-45a7-bd62-acde3f4ac2f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '150cb6ee570c4a2f9c9e83fd881b9652'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:02.291259 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1356/2658] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:34:02 2022] DELETE /identity/v3/users/150cb6ee570c4a2f9c9e83fd881b9652 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:34:02.474693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045267d-7310-4a02-a936-c4f2bf6c289a admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:02.476304 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4045267d-7310-4a02-a936-c4f2bf6c289a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:02.491057 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045267d-7310-4a02-a936-c4f2bf6c289a admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:02.682603 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4601723-aef4-48a8-a6a2-7add9908a044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:02.683184 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4601723-aef4-48a8-a6a2-7add9908a044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:02.683465 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4601723-aef4-48a8-a6a2-7add9908a044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:02.683738 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4601723-aef4-48a8-a6a2-7add9908a044 admin admin] PATH_INFO: `/v3/projects/cd4557e330624e2e88a5ff48b13c16e4` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:02.684992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4601723-aef4-48a8-a6a2-7add9908a044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4557e330624e2e88a5ff48b13c16e4)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:02.686916 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4601723-aef4-48a8-a6a2-7add9908a044 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:02.698635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:02.739732 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f4601723-aef4-48a8-a6a2-7add9908a044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4557e330624e2e88a5ff48b13c16e4', 'request_id': 'req-f4601723-aef4-48a8-a6a2-7add9908a044'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:02.746326 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f4601723-aef4-48a8-a6a2-7add9908a044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4557e330624e2e88a5ff48b13c16e4', 'request_id': 'req-f4601723-aef4-48a8-a6a2-7add9908a044'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:02.754378 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f4601723-aef4-48a8-a6a2-7add9908a044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4557e330624e2e88a5ff48b13c16e4', 'request_id': 'req-f4601723-aef4-48a8-a6a2-7add9908a044'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:02.766718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f4601723-aef4-48a8-a6a2-7add9908a044 admin admin] The token cache is being invalidate because project cd4557e330624e2e88a5ff48b13c16e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:34:02.767011 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f4601723-aef4-48a8-a6a2-7add9908a044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:02.767722 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f4601723-aef4-48a8-a6a2-7add9908a044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:02.769489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1303/2659] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:34:02 2022] DELETE /identity/v3/projects/cd4557e330624e2e88a5ff48b13c16e4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:34:12.287540 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=7,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:12.762586 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:13.192805 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cc092-ab3e-45a7-bd62-acde3f4ac2f7 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:13.194055 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-118cc092-ab3e-45a7-bd62-acde3f4ac2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:13.208622 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cc092-ab3e-45a7-bd62-acde3f4ac2f7 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:13.277087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8416ec-54c4-4aba-b773-52f7bab9ff5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:13.277756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8416ec-54c4-4aba-b773-52f7bab9ff5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:13.278093 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8416ec-54c4-4aba-b773-52f7bab9ff5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:13.278379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8416ec-54c4-4aba-b773-52f7bab9ff5f admin admin] PATH_INFO: `/v3/users/8c6b28e87bbc4f44a01f741a8c689b12` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:13.279617 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8416ec-54c4-4aba-b773-52f7bab9ff5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c6b28e87bbc4f44a01f741a8c689b12)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:13.281597 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8416ec-54c4-4aba-b773-52f7bab9ff5f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:13.331775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6d8416ec-54c4-4aba-b773-52f7bab9ff5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c6b28e87bbc4f44a01f741a8c689b12'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:13.332586 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6d8416ec-54c4-4aba-b773-52f7bab9ff5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c6b28e87bbc4f44a01f741a8c689b12'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:13.341134 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6d8416ec-54c4-4aba-b773-52f7bab9ff5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c6b28e87bbc4f44a01f741a8c689b12'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:13.341822 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6d8416ec-54c4-4aba-b773-52f7bab9ff5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c6b28e87bbc4f44a01f741a8c689b12'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:13.355042 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6d8416ec-54c4-4aba-b773-52f7bab9ff5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c6b28e87bbc4f44a01f741a8c689b12'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:13.369361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1357/2660] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:34:13 2022] DELETE /identity/v3/users/8c6b28e87bbc4f44a01f741a8c689b12 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:34:13.374165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae825c9-196f-49c2-a01c-f452040964b7 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:13.374444 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae825c9-196f-49c2-a01c-f452040964b7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:13.374783 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae825c9-196f-49c2-a01c-f452040964b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:13.399087 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-0ae825c9-196f-49c2-a01c-f452040964b7 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:34:13.400604 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0ae825c9-196f-49c2-a01c-f452040964b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:13.467462 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1304/2661] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:34:13.477295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8416ec-54c4-4aba-b773-52f7bab9ff5f admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:13.478760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6d8416ec-54c4-4aba-b773-52f7bab9ff5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:13.540513 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8416ec-54c4-4aba-b773-52f7bab9ff5f admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:13.544232 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a141142-33bf-4ab2-8edd-02eb2975f549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:13.544860 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a141142-33bf-4ab2-8edd-02eb2975f549 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:13.545141 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a141142-33bf-4ab2-8edd-02eb2975f549 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:13.545415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a141142-33bf-4ab2-8edd-02eb2975f549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:13.555039 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a141142-33bf-4ab2-8edd-02eb2975f549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:13.556533 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a141142-33bf-4ab2-8edd-02eb2975f549 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:13.566739 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1358/2662] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:34:13.857322 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae825c9-196f-49c2-a01c-f452040964b7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:13.858998 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0ae825c9-196f-49c2-a01c-f452040964b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:13.872150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae825c9-196f-49c2-a01c-f452040964b7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:13.881841 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233dbac-d107-4f59-9c66-13afd7c5f8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:13.881841 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233dbac-d107-4f59-9c66-13afd7c5f8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:13.881841 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233dbac-d107-4f59-9c66-13afd7c5f8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:13.881841 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233dbac-d107-4f59-9c66-13afd7c5f8e7 admin admin] PATH_INFO: `/v3/projects/4672ab35b32d444eb856586432e6db8a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:13.887673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233dbac-d107-4f59-9c66-13afd7c5f8e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4672ab35b32d444eb856586432e6db8a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:13.887673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233dbac-d107-4f59-9c66-13afd7c5f8e7 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:13.951413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6233dbac-d107-4f59-9c66-13afd7c5f8e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4672ab35b32d444eb856586432e6db8a', 'request_id': 'req-6233dbac-d107-4f59-9c66-13afd7c5f8e7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:13.960950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6233dbac-d107-4f59-9c66-13afd7c5f8e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4672ab35b32d444eb856586432e6db8a', 'request_id': 'req-6233dbac-d107-4f59-9c66-13afd7c5f8e7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:13.974677 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6233dbac-d107-4f59-9c66-13afd7c5f8e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4672ab35b32d444eb856586432e6db8a', 'request_id': 'req-6233dbac-d107-4f59-9c66-13afd7c5f8e7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:13.987755 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6233dbac-d107-4f59-9c66-13afd7c5f8e7 admin admin] The token cache is being invalidate because project 4672ab35b32d444eb856586432e6db8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:34:13.988273 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6233dbac-d107-4f59-9c66-13afd7c5f8e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:13.989053 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6233dbac-d107-4f59-9c66-13afd7c5f8e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:13.990839 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1305/2663] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:34:13 2022] DELETE /identity/v3/projects/4672ab35b32d444eb856586432e6db8a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:34:13.996588 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87157227-7ca1-4860-8364-bb1ab36ea353 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:13.996981 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87157227-7ca1-4860-8364-bb1ab36ea353 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:13.997265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87157227-7ca1-4860-8364-bb1ab36ea353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:14.019394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-87157227-7ca1-4860-8364-bb1ab36ea353 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:34:14.020777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-87157227-7ca1-4860-8364-bb1ab36ea353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:14.044205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:14.092192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1359/2664] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:34:14.101242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56af36d-1486-4a47-8b21-4847185ebba7 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:14.101526 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56af36d-1486-4a47-8b21-4847185ebba7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:14.101803 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56af36d-1486-4a47-8b21-4847185ebba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:14.122835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-e56af36d-1486-4a47-8b21-4847185ebba7 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:34:14.124204 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e56af36d-1486-4a47-8b21-4847185ebba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:14.132374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1306/2665] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:34:14.136770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87157227-7ca1-4860-8364-bb1ab36ea353 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:14.146900 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87157227-7ca1-4860-8364-bb1ab36ea353 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:14.151781 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af13dd-52a6-470a-b039-68a2bb7758f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:14.152571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af13dd-52a6-470a-b039-68a2bb7758f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:14.152858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af13dd-52a6-470a-b039-68a2bb7758f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:14.153145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af13dd-52a6-470a-b039-68a2bb7758f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:14.153847 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af13dd-52a6-470a-b039-68a2bb7758f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:34:14.154163 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af13dd-52a6-470a-b039-68a2bb7758f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:14.155770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af13dd-52a6-470a-b039-68a2bb7758f3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:14.168895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1360/2666] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:34:14.173407 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56af36d-1486-4a47-8b21-4847185ebba7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:14.184771 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56af36d-1486-4a47-8b21-4847185ebba7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:14.189779 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997ee47-f157-4d8b-9c32-a956627d35e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:14.190412 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997ee47-f157-4d8b-9c32-a956627d35e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:14.190694 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997ee47-f157-4d8b-9c32-a956627d35e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:14.190969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997ee47-f157-4d8b-9c32-a956627d35e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:14.191633 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997ee47-f157-4d8b-9c32-a956627d35e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:14.193569 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997ee47-f157-4d8b-9c32-a956627d35e2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:14.222774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1307/2667] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:34:14 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:34:14.227154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af13dd-52a6-470a-b039-68a2bb7758f3 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:14.238627 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af13dd-52a6-470a-b039-68a2bb7758f3 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:14.305568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1fc60-6093-4d58-8100-1d606f703e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:14.306208 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1fc60-6093-4d58-8100-1d606f703e90 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:14.306500 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1fc60-6093-4d58-8100-1d606f703e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:14.306780 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1fc60-6093-4d58-8100-1d606f703e90 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:14.308246 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1fc60-6093-4d58-8100-1d606f703e90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:14.310202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1fc60-6093-4d58-8100-1d606f703e90 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:14.333935 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1361/2668] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:34:14 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:34:14.336912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997ee47-f157-4d8b-9c32-a956627d35e2 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:14.347940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997ee47-f157-4d8b-9c32-a956627d35e2 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:14.352925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc615f-ee19-40af-abfa-ee112e1b0c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:14.353554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc615f-ee19-40af-abfa-ee112e1b0c5a admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:14.353854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc615f-ee19-40af-abfa-ee112e1b0c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:14.354134 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc615f-ee19-40af-abfa-ee112e1b0c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:14.354879 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc615f-ee19-40af-abfa-ee112e1b0c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:14.356545 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc615f-ee19-40af-abfa-ee112e1b0c5a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:14.367161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1308/2669] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:34:14.371980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1fc60-6093-4d58-8100-1d606f703e90 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:14.382317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1fc60-6093-4d58-8100-1d606f703e90 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:14.387806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43845f4-0c02-4b2d-a8df-bd39a7a15383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:14.388488 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43845f4-0c02-4b2d-a8df-bd39a7a15383 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:14.388770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43845f4-0c02-4b2d-a8df-bd39a7a15383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:14.389041 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43845f4-0c02-4b2d-a8df-bd39a7a15383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:14.389742 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43845f4-0c02-4b2d-a8df-bd39a7a15383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:14.391372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43845f4-0c02-4b2d-a8df-bd39a7a15383 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:14.403341 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1362/2670] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:34:14.408621 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc615f-ee19-40af-abfa-ee112e1b0c5a admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:14.422988 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc615f-ee19-40af-abfa-ee112e1b0c5a admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:14.429729 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e7e01-be68-41da-a653-954a5fb1f16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:14.430448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e7e01-be68-41da-a653-954a5fb1f16c admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:14.430728 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e7e01-be68-41da-a653-954a5fb1f16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:14.431034 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e7e01-be68-41da-a653-954a5fb1f16c admin admin] PATH_INFO: `/v3/projects/2e49eac8c9bf4ba6a7fb19f6c8a4fbdc/users/b86dda3855fd4f0abc4fb11b76aabe7f/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:14.448779 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e7e01-be68-41da-a653-954a5fb1f16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e49eac8c9bf4ba6a7fb19f6c8a4fbdc, user_id=b86dda3855fd4f0abc4fb11b76aabe7f, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:14.451522 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e7e01-be68-41da-a653-954a5fb1f16c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:14.466694 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1309/2671] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:34:14 2022] PUT /identity/v3/projects/2e49eac8c9bf4ba6a7fb19f6c8a4fbdc/users/b86dda3855fd4f0abc4fb11b76aabe7f/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:34:14.478481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a8645-fcad-4460-9295-6db5ef80410d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:14.478481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a8645-fcad-4460-9295-6db5ef80410d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:14.478481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a8645-fcad-4460-9295-6db5ef80410d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:14.509641 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-fb6a8645-fcad-4460-9295-6db5ef80410d None None] MFA Rules not processed for user `b86dda3855fd4f0abc4fb11b76aabe7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:34:14.511894 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-fb6a8645-fcad-4460-9295-6db5ef80410d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:14.598138 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1363/2672] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:34:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:34:14.602542 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e7e01-be68-41da-a653-954a5fb1f16c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:14.626045 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:14.672781 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e7e01-be68-41da-a653-954a5fb1f16c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:14.677656 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871b9a4-8278-41de-8079-5af138e81976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:14.678306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871b9a4-8278-41de-8079-5af138e81976 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:14.678594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871b9a4-8278-41de-8079-5af138e81976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:14.678876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871b9a4-8278-41de-8079-5af138e81976 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:14.679567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871b9a4-8278-41de-8079-5af138e81976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:14.681524 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871b9a4-8278-41de-8079-5af138e81976 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:14.721547 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1310/2673] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:34:14 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:34:14.726079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a8645-fcad-4460-9295-6db5ef80410d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:14.739152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a8645-fcad-4460-9295-6db5ef80410d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:14.752776 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:14.799123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88088927-26af-418c-b6d1-b17885ecb2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:14.799760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88088927-26af-418c-b6d1-b17885ecb2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:14.800049 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88088927-26af-418c-b6d1-b17885ecb2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:14.800363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88088927-26af-418c-b6d1-b17885ecb2a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:14.801034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88088927-26af-418c-b6d1-b17885ecb2a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:14.802972 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88088927-26af-418c-b6d1-b17885ecb2a8 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:14.828304 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1364/2674] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:34:14 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:34:14.829595 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871b9a4-8278-41de-8079-5af138e81976 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:14.840510 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871b9a4-8278-41de-8079-5af138e81976 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:14.845969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae392-4ee8-474d-844b-fcb840bdcfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:14.846598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae392-4ee8-474d-844b-fcb840bdcfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:14.846912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae392-4ee8-474d-844b-fcb840bdcfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:14.847196 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecae392-4ee8-474d-844b-fcb840bdcfc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:14.847925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecae392-4ee8-474d-844b-fcb840bdcfc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:14.849566 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecae392-4ee8-474d-844b-fcb840bdcfc1 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:14.861004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1311/2675] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:34:14.865143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88088927-26af-418c-b6d1-b17885ecb2a8 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:14.875342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88088927-26af-418c-b6d1-b17885ecb2a8 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:14.879981 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd93827-f087-438b-89f5-81fa159f63bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:14.880635 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd93827-f087-438b-89f5-81fa159f63bf admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:14.880918 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd93827-f087-438b-89f5-81fa159f63bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:14.881195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd93827-f087-438b-89f5-81fa159f63bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:14.881884 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd93827-f087-438b-89f5-81fa159f63bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:14.883481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd93827-f087-438b-89f5-81fa159f63bf admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:14.894979 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1365/2676] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:34:14.899150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae392-4ee8-474d-844b-fcb840bdcfc1 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:14.909891 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecae392-4ee8-474d-844b-fcb840bdcfc1 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:14.914664 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd9901-c97f-45c2-b7bd-cc72b62647f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:14.915336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd9901-c97f-45c2-b7bd-cc72b62647f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:14.915623 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd9901-c97f-45c2-b7bd-cc72b62647f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:14.915909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd9901-c97f-45c2-b7bd-cc72b62647f8 admin admin] PATH_INFO: `/v3/projects/6722e98e8af54dabb8df8d5950ebe1cc/users/5255aa4e15ce4dbe9b3c62d998c9cfed/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:14.931776 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd9901-c97f-45c2-b7bd-cc72b62647f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6722e98e8af54dabb8df8d5950ebe1cc, user_id=5255aa4e15ce4dbe9b3c62d998c9cfed, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:14.934849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd9901-c97f-45c2-b7bd-cc72b62647f8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:14.948837 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1312/2677] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:34:14 2022] PUT /identity/v3/projects/6722e98e8af54dabb8df8d5950ebe1cc/users/5255aa4e15ce4dbe9b3c62d998c9cfed/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:34:14.960608 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15302c-031c-45ed-9d89-3f211f7f9487 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:14.960900 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15302c-031c-45ed-9d89-3f211f7f9487 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:14.961192 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15302c-031c-45ed-9d89-3f211f7f9487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:14.990332 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-df15302c-031c-45ed-9d89-3f211f7f9487 None None] MFA Rules not processed for user `5255aa4e15ce4dbe9b3c62d998c9cfed`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:34:14.991455 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-df15302c-031c-45ed-9d89-3f211f7f9487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:15.058571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1366/2678] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:34:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:34:15.063366 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd9901-c97f-45c2-b7bd-cc72b62647f8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:15.125734 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd9901-c97f-45c2-b7bd-cc72b62647f8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:15.130486 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19dc33-5678-4bed-b3cf-11b1805f1914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:15.131109 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19dc33-5678-4bed-b3cf-11b1805f1914 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:15.131391 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19dc33-5678-4bed-b3cf-11b1805f1914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:15.131666 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19dc33-5678-4bed-b3cf-11b1805f1914 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:15.132385 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19dc33-5678-4bed-b3cf-11b1805f1914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:15.134278 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19dc33-5678-4bed-b3cf-11b1805f1914 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:15.161818 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1313/2679] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:34:15 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:34:15.165919 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15302c-031c-45ed-9d89-3f211f7f9487 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:15.177062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15302c-031c-45ed-9d89-3f211f7f9487 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:15.238039 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1b975-093d-49ed-b997-e4070436b458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:15.238729 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1b975-093d-49ed-b997-e4070436b458 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:15.239017 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1b975-093d-49ed-b997-e4070436b458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:15.239292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1b975-093d-49ed-b997-e4070436b458 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:15.239967 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1b975-093d-49ed-b997-e4070436b458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:15.242137 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1b975-093d-49ed-b997-e4070436b458 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:15.265350 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1367/2680] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:34:15 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:34:15.269489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19dc33-5678-4bed-b3cf-11b1805f1914 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:15.281364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19dc33-5678-4bed-b3cf-11b1805f1914 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:15.286371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea24a9-594c-412d-9ec9-8c6f7441a9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:15.286997 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea24a9-594c-412d-9ec9-8c6f7441a9bb admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:15.287279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea24a9-594c-412d-9ec9-8c6f7441a9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:15.287558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea24a9-594c-412d-9ec9-8c6f7441a9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:15.288284 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea24a9-594c-412d-9ec9-8c6f7441a9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:15.289888 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea24a9-594c-412d-9ec9-8c6f7441a9bb admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:15.300992 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1314/2681] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:34:15.305186 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1b975-093d-49ed-b997-e4070436b458 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:15.316323 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1b975-093d-49ed-b997-e4070436b458 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:15.320973 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54c293-ed26-49a4-9c9f-83ba66a0653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:15.321639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54c293-ed26-49a4-9c9f-83ba66a0653f admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:15.321925 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54c293-ed26-49a4-9c9f-83ba66a0653f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:15.322206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54c293-ed26-49a4-9c9f-83ba66a0653f admin admin] PATH_INFO: `/v3/projects/66f4a1ceded5448d9b321fea6fea0782/users/481f9afc4eaa4b3ca713cd7f2d002eb2/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:15.335522 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:15.338908 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54c293-ed26-49a4-9c9f-83ba66a0653f admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f4a1ceded5448d9b321fea6fea0782, user_id=481f9afc4eaa4b3ca713cd7f2d002eb2, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:15.342362 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54c293-ed26-49a4-9c9f-83ba66a0653f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:15.356226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1368/2682] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:34:15 2022] PUT /identity/v3/projects/66f4a1ceded5448d9b321fea6fea0782/users/481f9afc4eaa4b3ca713cd7f2d002eb2/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:34:15.360243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea24a9-594c-412d-9ec9-8c6f7441a9bb admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:15.370826 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea24a9-594c-412d-9ec9-8c6f7441a9bb admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:15.412369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:15.429643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e0765-58e6-44bd-9970-da68b6053a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:15.430272 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e0765-58e6-44bd-9970-da68b6053a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:15.430557 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e0765-58e6-44bd-9970-da68b6053a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:15.430835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e0765-58e6-44bd-9970-da68b6053a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:15.431534 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e0765-58e6-44bd-9970-da68b6053a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:15.433861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e0765-58e6-44bd-9970-da68b6053a00 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:15.443784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1315/2683] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:34:15.448741 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54c293-ed26-49a4-9c9f-83ba66a0653f admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:15.459353 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54c293-ed26-49a4-9c9f-83ba66a0653f admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:15.464080 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9efda-cf5c-41fe-9d0b-a900435db4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:15.464778 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9efda-cf5c-41fe-9d0b-a900435db4cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:15.465072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9efda-cf5c-41fe-9d0b-a900435db4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:15.465336 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9efda-cf5c-41fe-9d0b-a900435db4cb admin admin] PATH_INFO: `/v3/projects/66f4a1ceded5448d9b321fea6fea0782/users/481f9afc4eaa4b3ca713cd7f2d002eb2/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:15.467298 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9efda-cf5c-41fe-9d0b-a900435db4cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f4a1ceded5448d9b321fea6fea0782, user_id=481f9afc4eaa4b3ca713cd7f2d002eb2, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:15.469988 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9efda-cf5c-41fe-9d0b-a900435db4cb admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:15.480788 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1369/2684] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:34:15 2022] PUT /identity/v3/projects/66f4a1ceded5448d9b321fea6fea0782/users/481f9afc4eaa4b3ca713cd7f2d002eb2/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:34:15.490726 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1964-138d-4dca-a02a-37353ca102bb None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:15.491010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1964-138d-4dca-a02a-37353ca102bb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:15.491284 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1964-138d-4dca-a02a-37353ca102bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:15.520605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-e0cb1964-138d-4dca-a02a-37353ca102bb None None] MFA Rules not processed for user `481f9afc4eaa4b3ca713cd7f2d002eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:34:15.521793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e0cb1964-138d-4dca-a02a-37353ca102bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:15.592819 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1316/2685] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:34:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:34:15.604818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9efda-cf5c-41fe-9d0b-a900435db4cb admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:15.606615 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-68c9efda-cf5c-41fe-9d0b-a900435db4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:15.671012 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9efda-cf5c-41fe-9d0b-a900435db4cb admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:15.674933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8a574-8217-426d-bf41-c360ca46abc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:15.675469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8a574-8217-426d-bf41-c360ca46abc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:15.675753 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8a574-8217-426d-bf41-c360ca46abc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:15.676031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8a574-8217-426d-bf41-c360ca46abc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:15.742729 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8a574-8217-426d-bf41-c360ca46abc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:15.744293 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8a574-8217-426d-bf41-c360ca46abc4 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:15.755074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1370/2686] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:34:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:34:15.819823 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ddeae-8dcc-4cf2-911f-95a74d738af2 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:15.820301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ddeae-8dcc-4cf2-911f-95a74d738af2 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:15.820723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ddeae-8dcc-4cf2-911f-95a74d738af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:15.842883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3a1ddeae-8dcc-4cf2-911f-95a74d738af2 None None] MFA Rules not processed for user `306a5f4d7e0d44bd9a27145bd35a07fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:34:15.844160 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3a1ddeae-8dcc-4cf2-911f-95a74d738af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:15.912519 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1317/2687] 10.222.0.48 () {58 vars in 967 bytes} [Thu Aug 4 10:34:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:34:15.928676 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8a574-8217-426d-bf41-c360ca46abc4 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:15.930307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-99b8a574-8217-426d-bf41-c360ca46abc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:16.013307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8a574-8217-426d-bf41-c360ca46abc4 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:16.027997 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82388db-d58d-40ed-af05-69a3235f0a44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878797620be54b74a3e8582c78ba78d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:16.028818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82388db-d58d-40ed-af05-69a3235f0a44 service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:16.029069 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82388db-d58d-40ed-af05-69a3235f0a44 service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:16.029351 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82388db-d58d-40ed-af05-69a3235f0a44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:16.039568 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82388db-d58d-40ed-af05-69a3235f0a44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:16.041121 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82388db-d58d-40ed-af05-69a3235f0a44 service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:16.051208 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1371/2688] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Aug 4 10:34:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 10:34:17.307548 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ddeae-8dcc-4cf2-911f-95a74d738af2 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:17.309637 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3a1ddeae-8dcc-4cf2-911f-95a74d738af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:17.321678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ddeae-8dcc-4cf2-911f-95a74d738af2 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:17.325416 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0932731-bc8d-41a0-a61b-208b72975a2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:17.326072 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0932731-bc8d-41a0-a61b-208b72975a2d service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:17.326374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0932731-bc8d-41a0-a61b-208b72975a2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:17.326692 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0932731-bc8d-41a0-a61b-208b72975a2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:17.385103 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0932731-bc8d-41a0-a61b-208b72975a2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:17.386550 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0932731-bc8d-41a0-a61b-208b72975a2d service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:17.395757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1318/2689] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:34:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:34:17.970705 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82388db-d58d-40ed-af05-69a3235f0a44 service swift] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:17.980109 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82388db-d58d-40ed-af05-69a3235f0a44 service swift] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:17.983911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90111637-ed92-44aa-9d1b-d128ce6cc04e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:17.984578 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90111637-ed92-44aa-9d1b-d128ce6cc04e service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:17.984864 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90111637-ed92-44aa-9d1b-d128ce6cc04e service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:17.985142 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90111637-ed92-44aa-9d1b-d128ce6cc04e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:17.994748 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90111637-ed92-44aa-9d1b-d128ce6cc04e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:17.996244 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90111637-ed92-44aa-9d1b-d128ce6cc04e service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:18.005888 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1372/2690] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:34:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:34:21.930296 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0932731-bc8d-41a0-a61b-208b72975a2d service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:21.940465 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:21.997583 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0932731-bc8d-41a0-a61b-208b72975a2d service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:22.002143 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19310a-f3a3-40c6-8695-e27ad4c70e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:22.002895 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19310a-f3a3-40c6-8695-e27ad4c70e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:22.003178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19310a-f3a3-40c6-8695-e27ad4c70e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:22.003451 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19310a-f3a3-40c6-8695-e27ad4c70e91 admin admin] PATH_INFO: `/v3/users/b86dda3855fd4f0abc4fb11b76aabe7f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:22.004669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19310a-f3a3-40c6-8695-e27ad4c70e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86dda3855fd4f0abc4fb11b76aabe7f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:22.006590 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19310a-f3a3-40c6-8695-e27ad4c70e91 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:22.055704 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fb19310a-f3a3-40c6-8695-e27ad4c70e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86dda3855fd4f0abc4fb11b76aabe7f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:22.056384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fb19310a-f3a3-40c6-8695-e27ad4c70e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86dda3855fd4f0abc4fb11b76aabe7f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:22.065187 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fb19310a-f3a3-40c6-8695-e27ad4c70e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86dda3855fd4f0abc4fb11b76aabe7f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:22.078161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fb19310a-f3a3-40c6-8695-e27ad4c70e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86dda3855fd4f0abc4fb11b76aabe7f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:22.086092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fb19310a-f3a3-40c6-8695-e27ad4c70e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86dda3855fd4f0abc4fb11b76aabe7f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:22.093385 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1319/2691] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:34:21 2022] DELETE /identity/v3/users/b86dda3855fd4f0abc4fb11b76aabe7f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:34:22.098079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea1eb1-65d2-4bdc-88bf-708aaf454256 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:22.098637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea1eb1-65d2-4bdc-88bf-708aaf454256 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:22.098637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea1eb1-65d2-4bdc-88bf-708aaf454256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:22.119314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-66ea1eb1-65d2-4bdc-88bf-708aaf454256 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:34:22.120481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-66ea1eb1-65d2-4bdc-88bf-708aaf454256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:22.124793 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:22.185757 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1373/2692] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:34:22.195627 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19310a-f3a3-40c6-8695-e27ad4c70e91 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:22.197069 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fb19310a-f3a3-40c6-8695-e27ad4c70e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:22.273219 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19310a-f3a3-40c6-8695-e27ad4c70e91 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:22.276883 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c6091-5b6e-4dca-b31e-751682fd2373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:22.278246 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c6091-5b6e-4dca-b31e-751682fd2373 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:22.278529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c6091-5b6e-4dca-b31e-751682fd2373 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:22.278829 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c6091-5b6e-4dca-b31e-751682fd2373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:22.288351 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c6091-5b6e-4dca-b31e-751682fd2373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:22.289791 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c6091-5b6e-4dca-b31e-751682fd2373 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:22.300920 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1320/2693] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:34:22.583913 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea1eb1-65d2-4bdc-88bf-708aaf454256 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:22.585412 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-66ea1eb1-65d2-4bdc-88bf-708aaf454256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:22.600587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea1eb1-65d2-4bdc-88bf-708aaf454256 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:22.606171 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14998028-3a97-4144-9715-b28700fe155d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:22.606851 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14998028-3a97-4144-9715-b28700fe155d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:22.607136 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14998028-3a97-4144-9715-b28700fe155d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:22.607411 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14998028-3a97-4144-9715-b28700fe155d admin admin] PATH_INFO: `/v3/projects/2e49eac8c9bf4ba6a7fb19f6c8a4fbdc` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:22.609444 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14998028-3a97-4144-9715-b28700fe155d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e49eac8c9bf4ba6a7fb19f6c8a4fbdc)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:22.612986 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14998028-3a97-4144-9715-b28700fe155d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:22.665796 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-14998028-3a97-4144-9715-b28700fe155d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e49eac8c9bf4ba6a7fb19f6c8a4fbdc', 'request_id': 'req-14998028-3a97-4144-9715-b28700fe155d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:22.673195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-14998028-3a97-4144-9715-b28700fe155d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e49eac8c9bf4ba6a7fb19f6c8a4fbdc', 'request_id': 'req-14998028-3a97-4144-9715-b28700fe155d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:22.681831 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-14998028-3a97-4144-9715-b28700fe155d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e49eac8c9bf4ba6a7fb19f6c8a4fbdc', 'request_id': 'req-14998028-3a97-4144-9715-b28700fe155d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:22.694062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-14998028-3a97-4144-9715-b28700fe155d admin admin] The token cache is being invalidate because project 2e49eac8c9bf4ba6a7fb19f6c8a4fbdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:34:22.694352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-14998028-3a97-4144-9715-b28700fe155d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:22.695022 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-14998028-3a97-4144-9715-b28700fe155d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:22.696704 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1374/2694] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:34:22 2022] DELETE /identity/v3/projects/2e49eac8c9bf4ba6a7fb19f6c8a4fbdc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:34:22.701007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c6091-5b6e-4dca-b31e-751682fd2373 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:22.711825 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c6091-5b6e-4dca-b31e-751682fd2373 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:22.747468 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:22.776880 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a9054-e5c4-40e3-8366-9f297ca5942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:22.778216 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a9054-e5c4-40e3-8366-9f297ca5942d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:22.778673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a9054-e5c4-40e3-8366-9f297ca5942d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:22.778954 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a9054-e5c4-40e3-8366-9f297ca5942d admin admin] PATH_INFO: `/v3/users/5255aa4e15ce4dbe9b3c62d998c9cfed` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:22.780129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a9054-e5c4-40e3-8366-9f297ca5942d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5255aa4e15ce4dbe9b3c62d998c9cfed)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:22.782059 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a9054-e5c4-40e3-8366-9f297ca5942d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:22.831133 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-050a9054-e5c4-40e3-8366-9f297ca5942d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5255aa4e15ce4dbe9b3c62d998c9cfed'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:22.831798 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-050a9054-e5c4-40e3-8366-9f297ca5942d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5255aa4e15ce4dbe9b3c62d998c9cfed'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:22.839044 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-050a9054-e5c4-40e3-8366-9f297ca5942d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5255aa4e15ce4dbe9b3c62d998c9cfed'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:22.851815 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-050a9054-e5c4-40e3-8366-9f297ca5942d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5255aa4e15ce4dbe9b3c62d998c9cfed'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:22.860983 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-050a9054-e5c4-40e3-8366-9f297ca5942d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5255aa4e15ce4dbe9b3c62d998c9cfed'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:22.867243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1321/2695] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:34:22 2022] DELETE /identity/v3/users/5255aa4e15ce4dbe9b3c62d998c9cfed => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:34:23.148926 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14998028-3a97-4144-9715-b28700fe155d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:23.150465 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-14998028-3a97-4144-9715-b28700fe155d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:23.164770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14998028-3a97-4144-9715-b28700fe155d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:23.227761 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c0313-e314-4360-88d9-1ee2e9f290e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:23.228378 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c0313-e314-4360-88d9-1ee2e9f290e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:23.228670 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c0313-e314-4360-88d9-1ee2e9f290e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:23.228952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c0313-e314-4360-88d9-1ee2e9f290e6 admin admin] PATH_INFO: `/v3/projects/6722e98e8af54dabb8df8d5950ebe1cc` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:23.230161 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c0313-e314-4360-88d9-1ee2e9f290e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6722e98e8af54dabb8df8d5950ebe1cc)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:23.232137 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c0313-e314-4360-88d9-1ee2e9f290e6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:23.271600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:23.284131 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5a5c0313-e314-4360-88d9-1ee2e9f290e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6722e98e8af54dabb8df8d5950ebe1cc', 'request_id': 'req-5a5c0313-e314-4360-88d9-1ee2e9f290e6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:23.290399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5a5c0313-e314-4360-88d9-1ee2e9f290e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6722e98e8af54dabb8df8d5950ebe1cc', 'request_id': 'req-5a5c0313-e314-4360-88d9-1ee2e9f290e6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:23.299329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5a5c0313-e314-4360-88d9-1ee2e9f290e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6722e98e8af54dabb8df8d5950ebe1cc', 'request_id': 'req-5a5c0313-e314-4360-88d9-1ee2e9f290e6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:23.310047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5a5c0313-e314-4360-88d9-1ee2e9f290e6 admin admin] The token cache is being invalidate because project 6722e98e8af54dabb8df8d5950ebe1cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:34:23.310362 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5a5c0313-e314-4360-88d9-1ee2e9f290e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:23.310996 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5a5c0313-e314-4360-88d9-1ee2e9f290e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:23.312552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1375/2696] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:34:23 2022] DELETE /identity/v3/projects/6722e98e8af54dabb8df8d5950ebe1cc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:34:23.316492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a9054-e5c4-40e3-8366-9f297ca5942d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:23.317863 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-050a9054-e5c4-40e3-8366-9f297ca5942d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:23.332141 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a9054-e5c4-40e3-8366-9f297ca5942d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:23.390177 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33669-549b-4aef-aba0-0b1ffaa5a8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:23.390817 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33669-549b-4aef-aba0-0b1ffaa5a8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:23.391099 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33669-549b-4aef-aba0-0b1ffaa5a8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:23.391374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33669-549b-4aef-aba0-0b1ffaa5a8c6 admin admin] PATH_INFO: `/v3/users/481f9afc4eaa4b3ca713cd7f2d002eb2` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:23.392560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd33669-549b-4aef-aba0-0b1ffaa5a8c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=481f9afc4eaa4b3ca713cd7f2d002eb2)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:23.394462 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd33669-549b-4aef-aba0-0b1ffaa5a8c6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:23.445199 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ddd33669-549b-4aef-aba0-0b1ffaa5a8c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481f9afc4eaa4b3ca713cd7f2d002eb2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:23.445859 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ddd33669-549b-4aef-aba0-0b1ffaa5a8c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481f9afc4eaa4b3ca713cd7f2d002eb2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:23.450904 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:23.456041 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ddd33669-549b-4aef-aba0-0b1ffaa5a8c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481f9afc4eaa4b3ca713cd7f2d002eb2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:23.469175 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ddd33669-549b-4aef-aba0-0b1ffaa5a8c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481f9afc4eaa4b3ca713cd7f2d002eb2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:23.476514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ddd33669-549b-4aef-aba0-0b1ffaa5a8c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481f9afc4eaa4b3ca713cd7f2d002eb2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:23.482579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1322/2697] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:34:23 2022] DELETE /identity/v3/users/481f9afc4eaa4b3ca713cd7f2d002eb2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:34:23.769881 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c0313-e314-4360-88d9-1ee2e9f290e6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:23.771397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5a5c0313-e314-4360-88d9-1ee2e9f290e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:23.789306 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c0313-e314-4360-88d9-1ee2e9f290e6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:23.853930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a53822-eec0-48f4-b507-0c3d021bc71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:23.854737 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a53822-eec0-48f4-b507-0c3d021bc71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:23.855027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a53822-eec0-48f4-b507-0c3d021bc71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:23.855862 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a53822-eec0-48f4-b507-0c3d021bc71c admin admin] PATH_INFO: `/v3/projects/66f4a1ceded5448d9b321fea6fea0782` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:23.857461 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a53822-eec0-48f4-b507-0c3d021bc71c admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f4a1ceded5448d9b321fea6fea0782)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:23.859446 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a53822-eec0-48f4-b507-0c3d021bc71c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:23.906649 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-50a53822-eec0-48f4-b507-0c3d021bc71c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f4a1ceded5448d9b321fea6fea0782', 'request_id': 'req-50a53822-eec0-48f4-b507-0c3d021bc71c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:23.913129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-50a53822-eec0-48f4-b507-0c3d021bc71c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f4a1ceded5448d9b321fea6fea0782', 'request_id': 'req-50a53822-eec0-48f4-b507-0c3d021bc71c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:23.922758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-50a53822-eec0-48f4-b507-0c3d021bc71c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f4a1ceded5448d9b321fea6fea0782', 'request_id': 'req-50a53822-eec0-48f4-b507-0c3d021bc71c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:23.933391 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-50a53822-eec0-48f4-b507-0c3d021bc71c admin admin] The token cache is being invalidate because project 66f4a1ceded5448d9b321fea6fea0782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:34:23.934229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-50a53822-eec0-48f4-b507-0c3d021bc71c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:23.934930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-50a53822-eec0-48f4-b507-0c3d021bc71c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:34:23.936491 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1376/2698] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:34:23 2022] DELETE /identity/v3/projects/66f4a1ceded5448d9b321fea6fea0782 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:34:23.941678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff23c0a-a195-41a9-9bc2-2537bfb8a8f2 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:23.941961 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff23c0a-a195-41a9-9bc2-2537bfb8a8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:23.942237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff23c0a-a195-41a9-9bc2-2537bfb8a8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:23.962054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7ff23c0a-a195-41a9-9bc2-2537bfb8a8f2 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:34:23.963293 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7ff23c0a-a195-41a9-9bc2-2537bfb8a8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:24.023712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1323/2699] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:34:24.031953 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f60a63-482d-4d03-ab1a-8f03d7213681 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:24.032284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f60a63-482d-4d03-ab1a-8f03d7213681 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:24.032569 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f60a63-482d-4d03-ab1a-8f03d7213681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:24.053401 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-20f60a63-482d-4d03-ab1a-8f03d7213681 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:34:24.054632 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-20f60a63-482d-4d03-ab1a-8f03d7213681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:24.063703 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1377/2700] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:34:24.067982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff23c0a-a195-41a9-9bc2-2537bfb8a8f2 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:24.077974 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff23c0a-a195-41a9-9bc2-2537bfb8a8f2 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:24.083975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fce9f3-0903-4fda-93cd-fc600613a57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:24.084635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fce9f3-0903-4fda-93cd-fc600613a57f admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:24.084918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fce9f3-0903-4fda-93cd-fc600613a57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:24.085195 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fce9f3-0903-4fda-93cd-fc600613a57f admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:24.085975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fce9f3-0903-4fda-93cd-fc600613a57f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:34:24.086205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fce9f3-0903-4fda-93cd-fc600613a57f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:24.087802 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fce9f3-0903-4fda-93cd-fc600613a57f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:24.101230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1324/2701] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:34:24.106294 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f60a63-482d-4d03-ab1a-8f03d7213681 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:24.115872 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f60a63-482d-4d03-ab1a-8f03d7213681 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:24.123499 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4b033-48fd-4146-be64-e3ced31f14b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:24.124126 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4b033-48fd-4146-be64-e3ced31f14b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:24.124451 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4b033-48fd-4146-be64-e3ced31f14b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:24.124733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4b033-48fd-4146-be64-e3ced31f14b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:24.125418 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4b033-48fd-4146-be64-e3ced31f14b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:24.127331 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4b033-48fd-4146-be64-e3ced31f14b0 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:24.156307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1378/2702] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:34:24 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:34:24.160409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fce9f3-0903-4fda-93cd-fc600613a57f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:24.171292 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fce9f3-0903-4fda-93cd-fc600613a57f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:24.229100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6d3aa-b2d6-4a79-b041-08ae74b9d145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:24.229749 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6d3aa-b2d6-4a79-b041-08ae74b9d145 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:24.230029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6d3aa-b2d6-4a79-b041-08ae74b9d145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:24.230342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6d3aa-b2d6-4a79-b041-08ae74b9d145 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:24.231719 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6d3aa-b2d6-4a79-b041-08ae74b9d145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:24.233720 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6d3aa-b2d6-4a79-b041-08ae74b9d145 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:24.255333 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1325/2703] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:34:24 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:34:24.259604 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4b033-48fd-4146-be64-e3ced31f14b0 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:24.272227 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4b033-48fd-4146-be64-e3ced31f14b0 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:24.277024 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f5c64-a490-4d8c-81a4-b3ece2292797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:24.278369 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f5c64-a490-4d8c-81a4-b3ece2292797 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:24.278788 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f5c64-a490-4d8c-81a4-b3ece2292797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:24.279067 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f5c64-a490-4d8c-81a4-b3ece2292797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:24.279755 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f5c64-a490-4d8c-81a4-b3ece2292797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:24.281425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f5c64-a490-4d8c-81a4-b3ece2292797 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:24.291522 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1379/2704] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:34:24.296548 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6d3aa-b2d6-4a79-b041-08ae74b9d145 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:24.306965 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6d3aa-b2d6-4a79-b041-08ae74b9d145 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:24.311644 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d25f86-f3cb-4515-ba96-dae79939481b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:24.312302 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d25f86-f3cb-4515-ba96-dae79939481b admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:24.312592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d25f86-f3cb-4515-ba96-dae79939481b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:24.312866 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d25f86-f3cb-4515-ba96-dae79939481b admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:24.313561 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d25f86-f3cb-4515-ba96-dae79939481b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:24.315148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d25f86-f3cb-4515-ba96-dae79939481b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:24.328723 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1326/2705] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:34:24.335143 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f5c64-a490-4d8c-81a4-b3ece2292797 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:24.348993 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f5c64-a490-4d8c-81a4-b3ece2292797 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:24.353687 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2f507-f322-4865-a1df-c22acc74d483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:24.354353 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2f507-f322-4865-a1df-c22acc74d483 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:24.354638 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2f507-f322-4865-a1df-c22acc74d483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:24.354917 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2f507-f322-4865-a1df-c22acc74d483 admin admin] PATH_INFO: `/v3/projects/88b88fdc2eb648c99e8c7cd822931f50/users/587d5c90086c421c8d01aea33d001bc7/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:24.367735 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:24.373249 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2f507-f322-4865-a1df-c22acc74d483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b88fdc2eb648c99e8c7cd822931f50, user_id=587d5c90086c421c8d01aea33d001bc7, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:24.376430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2f507-f322-4865-a1df-c22acc74d483 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:24.390133 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1380/2706] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:34:24 2022] PUT /identity/v3/projects/88b88fdc2eb648c99e8c7cd822931f50/users/587d5c90086c421c8d01aea33d001bc7/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:34:24.395205 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ae9cc-a6f8-4ff9-983d-b27efb68122a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:24.395487 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ae9cc-a6f8-4ff9-983d-b27efb68122a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:24.395766 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ae9cc-a6f8-4ff9-983d-b27efb68122a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:24.415545 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-732ae9cc-a6f8-4ff9-983d-b27efb68122a None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:34:24.416792 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-732ae9cc-a6f8-4ff9-983d-b27efb68122a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:24.447171 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:24.478769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1327/2707] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:34:24.489341 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2f507-f322-4865-a1df-c22acc74d483 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:24.491069 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-67d2f507-f322-4865-a1df-c22acc74d483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:24.554934 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2f507-f322-4865-a1df-c22acc74d483 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:24.558972 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffee3d9-e78c-45a7-b830-6f3aeb418459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:24.559609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffee3d9-e78c-45a7-b830-6f3aeb418459 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:24.559941 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffee3d9-e78c-45a7-b830-6f3aeb418459 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:24.560351 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffee3d9-e78c-45a7-b830-6f3aeb418459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:24.570841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffee3d9-e78c-45a7-b830-6f3aeb418459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:24.572387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffee3d9-e78c-45a7-b830-6f3aeb418459 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:24.584101 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1381/2708] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:34:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:34:25.297192 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050d450-b548-438c-af11-c5490042fdae None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:25.297476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050d450-b548-438c-af11-c5490042fdae None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:25.297757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050d450-b548-438c-af11-c5490042fdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:25.329913 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-0050d450-b548-438c-af11-c5490042fdae None None] MFA Rules not processed for user `587d5c90086c421c8d01aea33d001bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:34:25.331615 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0050d450-b548-438c-af11-c5490042fdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:25.405262 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1328/2709] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:34:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:34:25.416300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffee3d9-e78c-45a7-b830-6f3aeb418459 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:25.418414 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-fffee3d9-e78c-45a7-b830-6f3aeb418459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:25.477346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffee3d9-e78c-45a7-b830-6f3aeb418459 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:25.481588 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91c852-1710-4da4-a8d7-87e57dee0485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:25.482229 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91c852-1710-4da4-a8d7-87e57dee0485 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:25.482514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91c852-1710-4da4-a8d7-87e57dee0485 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:25.482793 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91c852-1710-4da4-a8d7-87e57dee0485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:25.491497 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91c852-1710-4da4-a8d7-87e57dee0485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:25.492972 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91c852-1710-4da4-a8d7-87e57dee0485 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:25.503115 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1382/2710] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:34:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:34:26.875576 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888e631-5cbd-4232-b4a0-961220ceb895 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:26.876121 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888e631-5cbd-4232-b4a0-961220ceb895 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:26.876121 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888e631-5cbd-4232-b4a0-961220ceb895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:26.897791 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d888e631-5cbd-4232-b4a0-961220ceb895 None None] MFA Rules not processed for user `587d5c90086c421c8d01aea33d001bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:34:26.899029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d888e631-5cbd-4232-b4a0-961220ceb895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:26.906439 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1329/2711] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:34:35.498981 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=56,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:36.892206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=46 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:42.193282 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1b08c-c105-44c0-b9a2-865cbe3fd668 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:42.193832 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1b08c-c105-44c0-b9a2-865cbe3fd668 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:42.193832 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1b08c-c105-44c0-b9a2-865cbe3fd668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:42.215146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-69e1b08c-c105-44c0-b9a2-865cbe3fd668 None None] MFA Rules not processed for user `587d5c90086c421c8d01aea33d001bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:34:42.216838 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-69e1b08c-c105-44c0-b9a2-865cbe3fd668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:42.223812 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1383/2712] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:34:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:34:52.208100 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:59.229864 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7a8d7-3370-4f78-86b4-be6724d43835 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:59.230595 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7a8d7-3370-4f78-86b4-be6724d43835 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:59.230707 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7a8d7-3370-4f78-86b4-be6724d43835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:59.251445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-74c7a8d7-3370-4f78-86b4-be6724d43835 None None] MFA Rules not processed for user `306a5f4d7e0d44bd9a27145bd35a07fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:34:59.252697 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-74c7a8d7-3370-4f78-86b4-be6724d43835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:59.316146 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1330/2713] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Aug 4 10:34:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:34:59.343779 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1b08c-c105-44c0-b9a2-865cbe3fd668 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:34:59.345458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-69e1b08c-c105-44c0-b9a2-865cbe3fd668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:34:59.423930 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1b08c-c105-44c0-b9a2-865cbe3fd668 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:34:59.429263 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7699b22-8a82-4de5-bb85-a0cf5644af69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878797620be54b74a3e8582c78ba78d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:34:59.429841 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7699b22-8a82-4de5-bb85-a0cf5644af69 service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:34:59.430123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7699b22-8a82-4de5-bb85-a0cf5644af69 service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:34:59.430399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7699b22-8a82-4de5-bb85-a0cf5644af69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:34:59.440814 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7699b22-8a82-4de5-bb85-a0cf5644af69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:34:59.442450 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7699b22-8a82-4de5-bb85-a0cf5644af69 service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:34:59.453062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1384/2714] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Aug 4 10:34:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 10:35:09.306756 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=25 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:09.448108 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=32 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:14.310348 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7a8d7-3370-4f78-86b4-be6724d43835 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:14.330571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7a8d7-3370-4f78-86b4-be6724d43835 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:14.336580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aecbbc-e07f-4734-9db9-f8933c9d65bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:14.339845 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aecbbc-e07f-4734-9db9-f8933c9d65bd service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:14.341142 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aecbbc-e07f-4734-9db9-f8933c9d65bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:14.341930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aecbbc-e07f-4734-9db9-f8933c9d65bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:14.345067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c6aecbbc-e07f-4734-9db9-f8933c9d65bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:35:14.457928 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aecbbc-e07f-4734-9db9-f8933c9d65bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:14.459381 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aecbbc-e07f-4734-9db9-f8933c9d65bd service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:14.472293 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1331/2715] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:35:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:35:15.676088 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7699b22-8a82-4de5-bb85-a0cf5644af69 service swift] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:15.677739 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c7699b22-8a82-4de5-bb85-a0cf5644af69 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:35:15.690806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7699b22-8a82-4de5-bb85-a0cf5644af69 service swift] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:15.694431 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3538b1-4d44-45ed-a434-588f58bbb88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:15.695042 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3538b1-4d44-45ed-a434-588f58bbb88f service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:15.695322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3538b1-4d44-45ed-a434-588f58bbb88f service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:15.695594 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3538b1-4d44-45ed-a434-588f58bbb88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:15.697420 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8b3538b1-4d44-45ed-a434-588f58bbb88f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:35:15.711271 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3538b1-4d44-45ed-a434-588f58bbb88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:15.712747 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3538b1-4d44-45ed-a434-588f58bbb88f service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:15.724041 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1385/2716] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:35:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:35:16.006139 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434ba51-4ebb-4aab-a55f-58d1c499014b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:16.006652 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434ba51-4ebb-4aab-a55f-58d1c499014b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:16.006824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434ba51-4ebb-4aab-a55f-58d1c499014b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:16.028064 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-6434ba51-4ebb-4aab-a55f-58d1c499014b None None] MFA Rules not processed for user `306a5f4d7e0d44bd9a27145bd35a07fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:35:16.029328 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6434ba51-4ebb-4aab-a55f-58d1c499014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:35:16.036691 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1332/2717] 10.222.0.48 () {58 vars in 967 bytes} [Thu Aug 4 10:35:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:35:16.050377 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3538b1-4d44-45ed-a434-588f58bbb88f service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:16.062712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3538b1-4d44-45ed-a434-588f58bbb88f service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:16.067908 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c0fce-b905-4b81-9ccc-3fe7c4eae56a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878797620be54b74a3e8582c78ba78d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:16.068966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c0fce-b905-4b81-9ccc-3fe7c4eae56a service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:16.069254 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c0fce-b905-4b81-9ccc-3fe7c4eae56a service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:16.069535 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c0fce-b905-4b81-9ccc-3fe7c4eae56a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:16.079103 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c0fce-b905-4b81-9ccc-3fe7c4eae56a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:16.080739 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c0fce-b905-4b81-9ccc-3fe7c4eae56a service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:16.089477 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1386/2718] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Aug 4 10:35:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 10:35:18.172848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434ba51-4ebb-4aab-a55f-58d1c499014b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:18.188032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434ba51-4ebb-4aab-a55f-58d1c499014b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:18.196997 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d22e1d-51af-4e6a-83d3-de078d2f098b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:18.197665 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d22e1d-51af-4e6a-83d3-de078d2f098b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:18.198155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d22e1d-51af-4e6a-83d3-de078d2f098b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:18.199292 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d22e1d-51af-4e6a-83d3-de078d2f098b admin admin] PATH_INFO: `/v3/users/587d5c90086c421c8d01aea33d001bc7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:18.201102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d22e1d-51af-4e6a-83d3-de078d2f098b admin admin] RBAC: Authorizing `identity:delete_user(user_id=587d5c90086c421c8d01aea33d001bc7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:18.204083 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d22e1d-51af-4e6a-83d3-de078d2f098b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:18.260611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f6d22e1d-51af-4e6a-83d3-de078d2f098b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '587d5c90086c421c8d01aea33d001bc7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:35:18.261697 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f6d22e1d-51af-4e6a-83d3-de078d2f098b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '587d5c90086c421c8d01aea33d001bc7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:35:18.268956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f6d22e1d-51af-4e6a-83d3-de078d2f098b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '587d5c90086c421c8d01aea33d001bc7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:35:18.284114 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f6d22e1d-51af-4e6a-83d3-de078d2f098b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '587d5c90086c421c8d01aea33d001bc7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:35:18.296284 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f6d22e1d-51af-4e6a-83d3-de078d2f098b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '587d5c90086c421c8d01aea33d001bc7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:35:18.303540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1333/2719] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:35:18 2022] DELETE /identity/v3/users/587d5c90086c421c8d01aea33d001bc7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:35:18.685824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c0fce-b905-4b81-9ccc-3fe7c4eae56a service swift] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:18.697650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c0fce-b905-4b81-9ccc-3fe7c4eae56a service swift] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:18.772052 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240aa2b-b017-4f3d-af3a-8a3fe4abe5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:18.772742 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240aa2b-b017-4f3d-af3a-8a3fe4abe5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:18.773029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240aa2b-b017-4f3d-af3a-8a3fe4abe5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:18.773309 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240aa2b-b017-4f3d-af3a-8a3fe4abe5ff admin admin] PATH_INFO: `/v3/projects/88b88fdc2eb648c99e8c7cd822931f50` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:18.774725 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240aa2b-b017-4f3d-af3a-8a3fe4abe5ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b88fdc2eb648c99e8c7cd822931f50)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:18.777342 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240aa2b-b017-4f3d-af3a-8a3fe4abe5ff admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:18.827758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a240aa2b-b017-4f3d-af3a-8a3fe4abe5ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b88fdc2eb648c99e8c7cd822931f50', 'request_id': 'req-a240aa2b-b017-4f3d-af3a-8a3fe4abe5ff'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:35:18.834587 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a240aa2b-b017-4f3d-af3a-8a3fe4abe5ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b88fdc2eb648c99e8c7cd822931f50', 'request_id': 'req-a240aa2b-b017-4f3d-af3a-8a3fe4abe5ff'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:35:18.843790 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a240aa2b-b017-4f3d-af3a-8a3fe4abe5ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b88fdc2eb648c99e8c7cd822931f50', 'request_id': 'req-a240aa2b-b017-4f3d-af3a-8a3fe4abe5ff'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:35:18.855996 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a240aa2b-b017-4f3d-af3a-8a3fe4abe5ff admin admin] The token cache is being invalidate because project 88b88fdc2eb648c99e8c7cd822931f50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:35:18.856352 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a240aa2b-b017-4f3d-af3a-8a3fe4abe5ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:35:18.856982 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a240aa2b-b017-4f3d-af3a-8a3fe4abe5ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:35:18.862943 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1387/2720] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:35:18 2022] DELETE /identity/v3/projects/88b88fdc2eb648c99e8c7cd822931f50 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:35:18.864581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7034a-1775-45e0-b858-747a63eb8dbc None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:18.864900 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7034a-1775-45e0-b858-747a63eb8dbc None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:18.865175 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7034a-1775-45e0-b858-747a63eb8dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:18.889686 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-26f7034a-1775-45e0-b858-747a63eb8dbc None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:35:18.891116 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-26f7034a-1775-45e0-b858-747a63eb8dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:35:18.944512 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:18.970765 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1334/2721] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:35:18.978942 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31b4b8-7269-47ee-92b6-2cdd5e9dd8a0 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:18.979107 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31b4b8-7269-47ee-92b6-2cdd5e9dd8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:18.980062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31b4b8-7269-47ee-92b6-2cdd5e9dd8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:19.000692 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-dd31b4b8-7269-47ee-92b6-2cdd5e9dd8a0 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:35:19.001919 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-dd31b4b8-7269-47ee-92b6-2cdd5e9dd8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:35:19.010163 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1388/2722] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:35:19.015163 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7034a-1775-45e0-b858-747a63eb8dbc None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:19.025855 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7034a-1775-45e0-b858-747a63eb8dbc None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:19.031564 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adfe71-df33-4bfc-8bdb-c6c3103fc3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:19.032225 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adfe71-df33-4bfc-8bdb-c6c3103fc3bf admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:19.032535 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adfe71-df33-4bfc-8bdb-c6c3103fc3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:19.032808 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adfe71-df33-4bfc-8bdb-c6c3103fc3bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:19.033509 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adfe71-df33-4bfc-8bdb-c6c3103fc3bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:35:19.033812 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adfe71-df33-4bfc-8bdb-c6c3103fc3bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:19.035402 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adfe71-df33-4bfc-8bdb-c6c3103fc3bf admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:19.048774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1335/2723] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:35:19.053129 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31b4b8-7269-47ee-92b6-2cdd5e9dd8a0 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:19.063937 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31b4b8-7269-47ee-92b6-2cdd5e9dd8a0 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:19.069844 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d3997-d86b-4c71-8751-063105e97032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:19.070510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d3997-d86b-4c71-8751-063105e97032 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:19.070800 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d3997-d86b-4c71-8751-063105e97032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:19.071087 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d3997-d86b-4c71-8751-063105e97032 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:19.071762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d3997-d86b-4c71-8751-063105e97032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:19.074742 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d3997-d86b-4c71-8751-063105e97032 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:19.119761 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1389/2724] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:35:19 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:35:19.121417 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adfe71-df33-4bfc-8bdb-c6c3103fc3bf admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:19.131481 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adfe71-df33-4bfc-8bdb-c6c3103fc3bf admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:19.195833 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8e81e-abab-4af7-821a-00b01722eb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:19.196472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8e81e-abab-4af7-821a-00b01722eb9b admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:19.196881 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8e81e-abab-4af7-821a-00b01722eb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:19.197159 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8e81e-abab-4af7-821a-00b01722eb9b admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:19.197946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8e81e-abab-4af7-821a-00b01722eb9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:19.203593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8e81e-abab-4af7-821a-00b01722eb9b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:19.224234 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1336/2725] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:35:19 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:35:19.227810 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d3997-d86b-4c71-8751-063105e97032 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:19.246081 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d3997-d86b-4c71-8751-063105e97032 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:19.251442 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40111cab-d02a-4a6e-8982-8bf594a68301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:19.252058 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40111cab-d02a-4a6e-8982-8bf594a68301 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:19.252463 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40111cab-d02a-4a6e-8982-8bf594a68301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:19.253527 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40111cab-d02a-4a6e-8982-8bf594a68301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:19.255168 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40111cab-d02a-4a6e-8982-8bf594a68301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:19.257572 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40111cab-d02a-4a6e-8982-8bf594a68301 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:19.281971 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1390/2726] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:35:19.286428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8e81e-abab-4af7-821a-00b01722eb9b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:19.299838 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8e81e-abab-4af7-821a-00b01722eb9b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:19.305275 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28a586-3057-448f-a311-d02b52c92837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:19.305916 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28a586-3057-448f-a311-d02b52c92837 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:19.306198 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28a586-3057-448f-a311-d02b52c92837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:19.306471 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28a586-3057-448f-a311-d02b52c92837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:19.307176 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28a586-3057-448f-a311-d02b52c92837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:19.309525 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28a586-3057-448f-a311-d02b52c92837 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:19.323835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1337/2727] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:35:19.328300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40111cab-d02a-4a6e-8982-8bf594a68301 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:19.339839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40111cab-d02a-4a6e-8982-8bf594a68301 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:19.345309 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed6ac3-fe8a-4e90-9362-bed9a3c64f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:19.346683 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed6ac3-fe8a-4e90-9362-bed9a3c64f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:19.346888 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed6ac3-fe8a-4e90-9362-bed9a3c64f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:19.347917 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed6ac3-fe8a-4e90-9362-bed9a3c64f1c admin admin] PATH_INFO: `/v3/projects/db10c436709f45b28a3e8a0257931fa7/users/69ba82b77bf64397b612f58618dcaa45/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:19.363055 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:19.368872 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed6ac3-fe8a-4e90-9362-bed9a3c64f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db10c436709f45b28a3e8a0257931fa7, user_id=69ba82b77bf64397b612f58618dcaa45, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:19.374059 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed6ac3-fe8a-4e90-9362-bed9a3c64f1c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:19.390388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1391/2728] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:35:19 2022] PUT /identity/v3/projects/db10c436709f45b28a3e8a0257931fa7/users/69ba82b77bf64397b612f58618dcaa45/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:35:19.395345 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95567cb5-bb21-46cd-8d0c-7706affb89e1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:19.395635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95567cb5-bb21-46cd-8d0c-7706affb89e1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:19.395909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95567cb5-bb21-46cd-8d0c-7706affb89e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:19.419983 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-95567cb5-bb21-46cd-8d0c-7706affb89e1 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:35:19.421681 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-95567cb5-bb21-46cd-8d0c-7706affb89e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:35:19.501010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1338/2729] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:35:19.506857 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed6ac3-fe8a-4e90-9362-bed9a3c64f1c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:19.508825 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-29ed6ac3-fe8a-4e90-9362-bed9a3c64f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:35:19.580534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed6ac3-fe8a-4e90-9362-bed9a3c64f1c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:19.585712 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9ec31-e6fc-4d5a-87ba-804bb68beb53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:19.586478 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9ec31-e6fc-4d5a-87ba-804bb68beb53 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:19.586823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9ec31-e6fc-4d5a-87ba-804bb68beb53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:19.587177 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9ec31-e6fc-4d5a-87ba-804bb68beb53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:19.601441 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9ec31-e6fc-4d5a-87ba-804bb68beb53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:19.602909 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9ec31-e6fc-4d5a-87ba-804bb68beb53 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:19.614650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1392/2730] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:35:20.943990 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e100d7-3a21-4391-b2fa-4554210aa266 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:20.944901 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e100d7-3a21-4391-b2fa-4554210aa266 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:20.945184 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e100d7-3a21-4391-b2fa-4554210aa266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:20.968113 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-50e100d7-3a21-4391-b2fa-4554210aa266 None None] MFA Rules not processed for user `83efb092913842088cc1418123db4359`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:35:20.969394 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-50e100d7-3a21-4391-b2fa-4554210aa266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:35:21.040128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1339/2731] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:35:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:35:25.133539 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6308a-f7b3-4699-b2a7-ed74acea3a41 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:25.134091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6308a-f7b3-4699-b2a7-ed74acea3a41 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:25.134268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6308a-f7b3-4699-b2a7-ed74acea3a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:25.179637 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c2e6308a-f7b3-4699-b2a7-ed74acea3a41 None None] MFA Rules not processed for user `69ba82b77bf64397b612f58618dcaa45`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:35:25.181417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c2e6308a-f7b3-4699-b2a7-ed74acea3a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:35:25.286845 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1393/2732] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:35:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:35:25.291867 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e100d7-3a21-4391-b2fa-4554210aa266 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:25.298057 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:25.304739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e100d7-3a21-4391-b2fa-4554210aa266 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:25.310097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1eca20-ca8b-4a0d-8757-4260f2929b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:25.310843 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eca20-ca8b-4a0d-8757-4260f2929b13 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:25.311354 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eca20-ca8b-4a0d-8757-4260f2929b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:25.311698 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eca20-ca8b-4a0d-8757-4260f2929b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:25.312649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1eca20-ca8b-4a0d-8757-4260f2929b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:25.314775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1eca20-ca8b-4a0d-8757-4260f2929b13 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:25.347055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1340/2733] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:35:25 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:35:25.351297 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6308a-f7b3-4699-b2a7-ed74acea3a41 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:25.364259 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6308a-f7b3-4699-b2a7-ed74acea3a41 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:25.435252 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486202d8-f142-4069-bd7b-8b3ea24b60c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:25.435907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486202d8-f142-4069-bd7b-8b3ea24b60c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:25.436296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486202d8-f142-4069-bd7b-8b3ea24b60c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:25.436646 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486202d8-f142-4069-bd7b-8b3ea24b60c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:25.437443 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486202d8-f142-4069-bd7b-8b3ea24b60c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:25.439747 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486202d8-f142-4069-bd7b-8b3ea24b60c4 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:25.473905 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1394/2734] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:35:25 2022] POST /identity/v3/users => generated 298 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:35:25.477549 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1eca20-ca8b-4a0d-8757-4260f2929b13 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:25.489935 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1eca20-ca8b-4a0d-8757-4260f2929b13 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:25.495856 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515d149-7749-43cd-95a4-085c53cb4ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:25.496693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515d149-7749-43cd-95a4-085c53cb4ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:25.496975 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515d149-7749-43cd-95a4-085c53cb4ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:25.497252 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515d149-7749-43cd-95a4-085c53cb4ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:25.497998 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515d149-7749-43cd-95a4-085c53cb4ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:25.499639 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515d149-7749-43cd-95a4-085c53cb4ddf admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:25.513342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1341/2735] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:35:25.517619 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486202d8-f142-4069-bd7b-8b3ea24b60c4 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:25.529211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486202d8-f142-4069-bd7b-8b3ea24b60c4 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:25.535600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca017f-b7d8-4373-9cf7-05c3fd7510d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:25.536356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca017f-b7d8-4373-9cf7-05c3fd7510d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:25.536645 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca017f-b7d8-4373-9cf7-05c3fd7510d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:25.537356 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca017f-b7d8-4373-9cf7-05c3fd7510d0 admin admin] PATH_INFO: `/v3/projects/e9969d8483d3463fa95f3aaa180aa591/users/d7a54d740c5649e0a21ac0c6d35364a7/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:25.552804 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:25.557395 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca017f-b7d8-4373-9cf7-05c3fd7510d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9969d8483d3463fa95f3aaa180aa591, user_id=d7a54d740c5649e0a21ac0c6d35364a7, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:25.560831 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca017f-b7d8-4373-9cf7-05c3fd7510d0 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:25.582531 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1395/2736] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:35:25 2022] PUT /identity/v3/projects/e9969d8483d3463fa95f3aaa180aa591/users/d7a54d740c5649e0a21ac0c6d35364a7/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:35:25.586879 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515d149-7749-43cd-95a4-085c53cb4ddf admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:25.597952 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515d149-7749-43cd-95a4-085c53cb4ddf admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:25.692618 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a97c1-4d5c-44a5-9aed-d8b0a89138e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:25.693258 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a97c1-4d5c-44a5-9aed-d8b0a89138e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:25.693545 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a97c1-4d5c-44a5-9aed-d8b0a89138e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:25.693826 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a97c1-4d5c-44a5-9aed-d8b0a89138e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:25.694536 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a97c1-4d5c-44a5-9aed-d8b0a89138e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:25.696406 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a97c1-4d5c-44a5-9aed-d8b0a89138e8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:25.713782 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1342/2737] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:35:25.719751 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca017f-b7d8-4373-9cf7-05c3fd7510d0 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:25.736303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca017f-b7d8-4373-9cf7-05c3fd7510d0 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:25.745363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184d5cf-8b18-43e1-87c2-8c32e6f28a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:25.746379 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184d5cf-8b18-43e1-87c2-8c32e6f28a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:25.746778 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184d5cf-8b18-43e1-87c2-8c32e6f28a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:25.747445 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184d5cf-8b18-43e1-87c2-8c32e6f28a96 admin admin] PATH_INFO: `/v3/projects/e9969d8483d3463fa95f3aaa180aa591/users/d7a54d740c5649e0a21ac0c6d35364a7/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:25.750349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184d5cf-8b18-43e1-87c2-8c32e6f28a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9969d8483d3463fa95f3aaa180aa591, user_id=d7a54d740c5649e0a21ac0c6d35364a7, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:25.753111 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184d5cf-8b18-43e1-87c2-8c32e6f28a96 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:25.782662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1396/2738] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:35:25 2022] PUT /identity/v3/projects/e9969d8483d3463fa95f3aaa180aa591/users/d7a54d740c5649e0a21ac0c6d35364a7/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:35:31.509243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d153d-8663-4f91-9b2f-fe72d26c3258 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:31.510466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d153d-8663-4f91-9b2f-fe72d26c3258 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:31.511214 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d153d-8663-4f91-9b2f-fe72d26c3258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:31.550128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-466d153d-8663-4f91-9b2f-fe72d26c3258 None None] MFA Rules not processed for user `d7a54d740c5649e0a21ac0c6d35364a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:35:31.551814 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-466d153d-8663-4f91-9b2f-fe72d26c3258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:35:31.651532 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1343/2739] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:35:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:35:31.665674 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184d5cf-8b18-43e1-87c2-8c32e6f28a96 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:31.667984 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f184d5cf-8b18-43e1-87c2-8c32e6f28a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:35:31.744154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184d5cf-8b18-43e1-87c2-8c32e6f28a96 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:31.749357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a31514-2570-488e-a6d9-a85bced2f468 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc15e64c987488f812d1cdd0c82c7ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:31.750146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a31514-2570-488e-a6d9-a85bced2f468 service glance] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:31.751061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a31514-2570-488e-a6d9-a85bced2f468 service glance] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:31.751406 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a31514-2570-488e-a6d9-a85bced2f468 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:31.821248 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a31514-2570-488e-a6d9-a85bced2f468 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:31.822887 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a31514-2570-488e-a6d9-a85bced2f468 service glance] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:31.835031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1397/2740] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:35:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:35:31.972693 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c84b7-e44d-46c4-8913-180fc51231d5 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:31.973092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c84b7-e44d-46c4-8913-180fc51231d5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:31.973447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c84b7-e44d-46c4-8913-180fc51231d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:31.993799 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-cb6c84b7-e44d-46c4-8913-180fc51231d5 None None] MFA Rules not processed for user `306a5f4d7e0d44bd9a27145bd35a07fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:35:31.995067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cb6c84b7-e44d-46c4-8913-180fc51231d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:35:32.047738 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:32.060805 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1344/2741] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Aug 4 10:35:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:35:32.074408 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a31514-2570-488e-a6d9-a85bced2f468 service glance] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:32.075998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f9a31514-2570-488e-a6d9-a85bced2f468 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:35:32.148785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a31514-2570-488e-a6d9-a85bced2f468 service glance] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:32.154091 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3bbd3-6c1d-4a62-a4b3-00608ddca30f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878797620be54b74a3e8582c78ba78d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:32.154719 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3bbd3-6c1d-4a62-a4b3-00608ddca30f service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:32.154996 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3bbd3-6c1d-4a62-a4b3-00608ddca30f service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:32.155373 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3bbd3-6c1d-4a62-a4b3-00608ddca30f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:32.163762 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3bbd3-6c1d-4a62-a4b3-00608ddca30f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:32.165372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3bbd3-6c1d-4a62-a4b3-00608ddca30f service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:32.175151 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1398/2742] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Aug 4 10:35:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 10:35:42.037388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2e873-0de6-4434-a274-70f26f5c1bc7 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:42.038032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2e873-0de6-4434-a274-70f26f5c1bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:42.038032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2e873-0de6-4434-a274-70f26f5c1bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:42.061273 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-8ec2e873-0de6-4434-a274-70f26f5c1bc7 None None] MFA Rules not processed for user `69ba82b77bf64397b612f58618dcaa45`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:35:42.062894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8ec2e873-0de6-4434-a274-70f26f5c1bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:35:42.070711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1345/2743] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:35:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:35:42.171654 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:44.207676 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e417bd-4aaf-407d-b179-67490c83f264 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:44.209043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e417bd-4aaf-407d-b179-67490c83f264 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:44.209043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e417bd-4aaf-407d-b179-67490c83f264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:44.264194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c9e417bd-4aaf-407d-b179-67490c83f264 None None] MFA Rules not processed for user `306a5f4d7e0d44bd9a27145bd35a07fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:35:44.266716 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c9e417bd-4aaf-407d-b179-67490c83f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:35:44.286651 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1399/2744] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Aug 4 10:35:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:35:44.300448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2e873-0de6-4434-a274-70f26f5c1bc7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:35:44.324214 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2e873-0de6-4434-a274-70f26f5c1bc7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:35:44.333162 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee4010-e3e4-48b6-9a2c-5ab6783420c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878797620be54b74a3e8582c78ba78d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:35:44.334006 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee4010-e3e4-48b6-9a2c-5ab6783420c8 service swift] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:35:44.334295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee4010-e3e4-48b6-9a2c-5ab6783420c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:35:44.334574 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee4010-e3e4-48b6-9a2c-5ab6783420c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:35:44.344816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee4010-e3e4-48b6-9a2c-5ab6783420c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:35:44.346384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee4010-e3e4-48b6-9a2c-5ab6783420c8 service swift] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:35:44.356030 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1346/2745] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Aug 4 10:35:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 10:35:54.282829 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=18 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:54.352129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=15 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:11.540856 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e417bd-4aaf-407d-b179-67490c83f264 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:36:11.611956 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e417bd-4aaf-407d-b179-67490c83f264 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:36:11.615750 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844df0b-52f9-4db2-bbb8-76230ac023b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:36:11.616413 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844df0b-52f9-4db2-bbb8-76230ac023b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:36:11.616708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844df0b-52f9-4db2-bbb8-76230ac023b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:36:11.617004 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844df0b-52f9-4db2-bbb8-76230ac023b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:36:11.627597 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844df0b-52f9-4db2-bbb8-76230ac023b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:36:11.629135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844df0b-52f9-4db2-bbb8-76230ac023b4 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:36:11.639974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1400/2746] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:36:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:36:13.395569 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee4010-e3e4-48b6-9a2c-5ab6783420c8 service swift] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:36:13.397579 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-afee4010-e3e4-48b6-9a2c-5ab6783420c8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:36:13.414773 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee4010-e3e4-48b6-9a2c-5ab6783420c8 service swift] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:36:13.421438 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccec024-3999-4898-824f-83ddd706fddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:36:13.422701 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccec024-3999-4898-824f-83ddd706fddd service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:36:13.423190 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccec024-3999-4898-824f-83ddd706fddd service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:36:13.423941 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccec024-3999-4898-824f-83ddd706fddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:36:13.428607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0ccec024-3999-4898-824f-83ddd706fddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:36:13.451229 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccec024-3999-4898-824f-83ddd706fddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:36:13.454316 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccec024-3999-4898-824f-83ddd706fddd service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:36:13.470766 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1347/2747] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:36:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:36:21.635511 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=26 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:23.462785 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=6 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:51.150667 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844df0b-52f9-4db2-bbb8-76230ac023b4 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:36:51.152124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e844df0b-52f9-4db2-bbb8-76230ac023b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:36:51.225818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844df0b-52f9-4db2-bbb8-76230ac023b4 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:36:51.231334 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84510e9a-7eba-424e-8ca6-7077d207db88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:36:51.231999 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84510e9a-7eba-424e-8ca6-7077d207db88 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:36:51.232315 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84510e9a-7eba-424e-8ca6-7077d207db88 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:36:51.232601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84510e9a-7eba-424e-8ca6-7077d207db88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:36:51.234384 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-84510e9a-7eba-424e-8ca6-7077d207db88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:36:51.293226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84510e9a-7eba-424e-8ca6-7077d207db88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:36:51.295166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84510e9a-7eba-424e-8ca6-7077d207db88 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:36:51.304399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1401/2748] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:36:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:37:01.300105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=56 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:37:08.496256 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccec024-3999-4898-824f-83ddd706fddd service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:37:08.498003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0ccec024-3999-4898-824f-83ddd706fddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:37:08.515300 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccec024-3999-4898-824f-83ddd706fddd service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:37:08.521080 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c9ad4-5f26-462d-97c9-13dd701a4175 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:37:08.521711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c9ad4-5f26-462d-97c9-13dd701a4175 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:37:08.521998 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c9ad4-5f26-462d-97c9-13dd701a4175 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:37:08.522280 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c9ad4-5f26-462d-97c9-13dd701a4175 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:37:08.524102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cc8c9ad4-5f26-462d-97c9-13dd701a4175 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:37:08.545258 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c9ad4-5f26-462d-97c9-13dd701a4175 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:37:08.548321 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c9ad4-5f26-462d-97c9-13dd701a4175 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:37:08.567912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1348/2749] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:37:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:37:12.508244 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0cd36-96a0-435e-a092-06b5e79c5997 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:37:12.508754 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0cd36-96a0-435e-a092-06b5e79c5997 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:37:12.509010 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0cd36-96a0-435e-a092-06b5e79c5997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:37:12.530156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-bdb0cd36-96a0-435e-a092-06b5e79c5997 None None] MFA Rules not processed for user `306a5f4d7e0d44bd9a27145bd35a07fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:37:12.531364 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-bdb0cd36-96a0-435e-a092-06b5e79c5997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:37:12.538696 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1402/2750] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Aug 4 10:37:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:37:12.584954 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c9ad4-5f26-462d-97c9-13dd701a4175 service nova] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:37:12.596809 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c9ad4-5f26-462d-97c9-13dd701a4175 service nova] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:37:12.603243 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440d285-fe30-4d22-96bb-a354a45805e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878797620be54b74a3e8582c78ba78d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:37:12.603870 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440d285-fe30-4d22-96bb-a354a45805e7 service swift] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:37:12.604148 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440d285-fe30-4d22-96bb-a354a45805e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:37:12.604448 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440d285-fe30-4d22-96bb-a354a45805e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:37:12.613950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440d285-fe30-4d22-96bb-a354a45805e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:37:12.615509 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440d285-fe30-4d22-96bb-a354a45805e7 service swift] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:37:12.625496 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1349/2751] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Aug 4 10:37:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 10:37:22.525371 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:37:22.621445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=12 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:37:29.405387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3e5f5-9ae0-4c84-8cda-a9b26cb62e5a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:37:29.406012 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3e5f5-9ae0-4c84-8cda-a9b26cb62e5a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:37:29.406012 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3e5f5-9ae0-4c84-8cda-a9b26cb62e5a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:37:29.407277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1403/2752] 10.222.0.48 () {54 vars in 921 bytes} [Thu Aug 4 10:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 10:37:29.412445 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589115a-a3d4-4bc2-9784-ae986a874791 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:37:29.412950 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589115a-a3d4-4bc2-9784-ae986a874791 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:37:29.413052 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589115a-a3d4-4bc2-9784-ae986a874791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:37:29.450961 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-5589115a-a3d4-4bc2-9784-ae986a874791 None None] MFA Rules not processed for user `592539924feb44ad8ea520d8539b6608`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:37:29.452203 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5589115a-a3d4-4bc2-9784-ae986a874791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:37:29.461895 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1350/2753] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Aug 4 10:37:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:37:29.474140 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3e5f5-9ae0-4c84-8cda-a9b26cb62e5a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:37:29.496852 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3e5f5-9ae0-4c84-8cda-a9b26cb62e5a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:37:29.500896 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aeed94-a267-48c0-8b63-072acfbbdca2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc15e64c987488f812d1cdd0c82c7ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:37:29.501516 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeed94-a267-48c0-8b63-072acfbbdca2 service glance] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:37:29.501797 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeed94-a267-48c0-8b63-072acfbbdca2 service glance] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:37:29.502069 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeed94-a267-48c0-8b63-072acfbbdca2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:37:29.513613 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aeed94-a267-48c0-8b63-072acfbbdca2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:37:29.515061 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aeed94-a267-48c0-8b63-072acfbbdca2 service glance] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:37:29.526436 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1404/2754] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:37:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:37:29.596780 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589115a-a3d4-4bc2-9784-ae986a874791 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:37:29.607571 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589115a-a3d4-4bc2-9784-ae986a874791 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:37:29.611348 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2ef2e-a4e8-46e2-baca-c7b58f21352c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:37:29.611960 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2ef2e-a4e8-46e2-baca-c7b58f21352c service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:37:29.612266 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2ef2e-a4e8-46e2-baca-c7b58f21352c service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:37:29.612546 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2ef2e-a4e8-46e2-baca-c7b58f21352c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:37:29.614319 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d4a2ef2e-a4e8-46e2-baca-c7b58f21352c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:37:29.624718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2ef2e-a4e8-46e2-baca-c7b58f21352c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:37:29.626163 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2ef2e-a4e8-46e2-baca-c7b58f21352c service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:37:29.635075 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1351/2755] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:37:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:37:29.709609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aeed94-a267-48c0-8b63-072acfbbdca2 service glance] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:37:29.719808 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aeed94-a267-48c0-8b63-072acfbbdca2 service glance] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:37:29.723462 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b673128-2bc7-4508-b11a-9730a1bd0b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:37:29.724102 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b673128-2bc7-4508-b11a-9730a1bd0b1b service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:37:29.724428 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b673128-2bc7-4508-b11a-9730a1bd0b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:37:29.724709 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b673128-2bc7-4508-b11a-9730a1bd0b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:37:29.726544 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5b673128-2bc7-4508-b11a-9730a1bd0b1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:37:29.742095 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b673128-2bc7-4508-b11a-9730a1bd0b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:37:29.743559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b673128-2bc7-4508-b11a-9730a1bd0b1b service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:37:29.754769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1405/2756] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:37:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:37:29.815601 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2ef2e-a4e8-46e2-baca-c7b58f21352c service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:37:29.817029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d4a2ef2e-a4e8-46e2-baca-c7b58f21352c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:37:29.889414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2ef2e-a4e8-46e2-baca-c7b58f21352c service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:37:29.894452 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274da2c4-79f1-4d74-8b28-9cf001c967f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0005b0c9582e430e9cb85704a4505bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:37:29.895065 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274da2c4-79f1-4d74-8b28-9cf001c967f9 service placement] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:37:29.895348 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274da2c4-79f1-4d74-8b28-9cf001c967f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:37:29.895628 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274da2c4-79f1-4d74-8b28-9cf001c967f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:37:29.897406 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-274da2c4-79f1-4d74-8b28-9cf001c967f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:37:29.910714 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274da2c4-79f1-4d74-8b28-9cf001c967f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:37:29.912342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274da2c4-79f1-4d74-8b28-9cf001c967f9 service placement] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:37:29.922539 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1352/2757] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:37:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:37:31.543690 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59210e24-f3bd-45cb-88b6-5bc5dc966504 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:37:31.544277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59210e24-f3bd-45cb-88b6-5bc5dc966504 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:37:31.544277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59210e24-f3bd-45cb-88b6-5bc5dc966504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:37:31.563950 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-59210e24-f3bd-45cb-88b6-5bc5dc966504 None None] MFA Rules not processed for user `306a5f4d7e0d44bd9a27145bd35a07fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:37:31.565260 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-59210e24-f3bd-45cb-88b6-5bc5dc966504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:37:31.572803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1406/2758] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Aug 4 10:37:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:37:31.585622 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274da2c4-79f1-4d74-8b28-9cf001c967f9 service placement] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:37:31.596978 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274da2c4-79f1-4d74-8b28-9cf001c967f9 service placement] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:37:31.602000 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec83ff4-54ab-438d-9fc0-b564dbf2a0ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878797620be54b74a3e8582c78ba78d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:37:31.602615 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec83ff4-54ab-438d-9fc0-b564dbf2a0ec service swift] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:37:31.602901 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec83ff4-54ab-438d-9fc0-b564dbf2a0ec service swift] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:37:31.603804 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec83ff4-54ab-438d-9fc0-b564dbf2a0ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:37:31.611958 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec83ff4-54ab-438d-9fc0-b564dbf2a0ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:37:31.613599 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec83ff4-54ab-438d-9fc0-b564dbf2a0ec service swift] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:37:31.622384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1353/2759] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Aug 4 10:37:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 10:37:41.558793 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=19 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:37:41.618374 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=53 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:37:50.428610 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadeaff-4649-4891-8305-1e5e540b9b04 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:37:50.429112 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadeaff-4649-4891-8305-1e5e540b9b04 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:37:50.429207 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadeaff-4649-4891-8305-1e5e540b9b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:37:50.448976 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7dadeaff-4649-4891-8305-1e5e540b9b04 None None] MFA Rules not processed for user `306a5f4d7e0d44bd9a27145bd35a07fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:37:50.450174 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7dadeaff-4649-4891-8305-1e5e540b9b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:37:50.457716 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1407/2760] 10.222.0.48 () {58 vars in 967 bytes} [Thu Aug 4 10:37:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:37:50.470715 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec83ff4-54ab-438d-9fc0-b564dbf2a0ec service swift] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:37:50.481370 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec83ff4-54ab-438d-9fc0-b564dbf2a0ec service swift] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:37:50.487344 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32e60c-9ced-4990-b3f5-19f8103035b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878797620be54b74a3e8582c78ba78d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:37:50.487967 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32e60c-9ced-4990-b3f5-19f8103035b6 service swift] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:37:50.488284 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32e60c-9ced-4990-b3f5-19f8103035b6 service swift] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:37:50.488565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32e60c-9ced-4990-b3f5-19f8103035b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:37:50.496831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32e60c-9ced-4990-b3f5-19f8103035b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:37:50.498399 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32e60c-9ced-4990-b3f5-19f8103035b6 service swift] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:37:50.506616 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1354/2761] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Aug 4 10:37:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 10:38:00.443225 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:38:00.503288 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=6 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:39:03.439625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadeaff-4649-4891-8305-1e5e540b9b04 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:03.466395 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadeaff-4649-4891-8305-1e5e540b9b04 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:03.478327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98d8e5-4a47-4f42-ace4-d2e781dd17f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:03.479688 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98d8e5-4a47-4f42-ace4-d2e781dd17f2 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:03.480047 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98d8e5-4a47-4f42-ace4-d2e781dd17f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:03.480471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98d8e5-4a47-4f42-ace4-d2e781dd17f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:03.482781 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-db98d8e5-4a47-4f42-ace4-d2e781dd17f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:03.505180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98d8e5-4a47-4f42-ace4-d2e781dd17f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:03.507300 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98d8e5-4a47-4f42-ace4-d2e781dd17f2 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:03.526560 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1408/2762] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:39:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:39:03.657769 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32e60c-9ced-4990-b3f5-19f8103035b6 service swift] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:03.660244 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1e32e60c-9ced-4990-b3f5-19f8103035b6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:03.678742 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32e60c-9ced-4990-b3f5-19f8103035b6 service swift] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:03.685643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96a8cb-09af-449b-91f8-77fb4aaca343 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0005b0c9582e430e9cb85704a4505bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:03.686333 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96a8cb-09af-449b-91f8-77fb4aaca343 service placement] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:03.686748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96a8cb-09af-449b-91f8-77fb4aaca343 service placement] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:03.687073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96a8cb-09af-449b-91f8-77fb4aaca343 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:03.689501 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6a96a8cb-09af-449b-91f8-77fb4aaca343 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:03.704073 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96a8cb-09af-449b-91f8-77fb4aaca343 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:03.706686 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96a8cb-09af-449b-91f8-77fb4aaca343 service placement] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:03.719672 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1355/2763] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:39:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:39:06.290921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98d8e5-4a47-4f42-ace4-d2e781dd17f2 service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:06.304799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98d8e5-4a47-4f42-ace4-d2e781dd17f2 service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:06.312593 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef1cde-1fd7-4371-bd09-7e7047024c09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:06.313410 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef1cde-1fd7-4371-bd09-7e7047024c09 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:06.313785 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef1cde-1fd7-4371-bd09-7e7047024c09 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:06.314131 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef1cde-1fd7-4371-bd09-7e7047024c09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:06.319363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-47ef1cde-1fd7-4371-bd09-7e7047024c09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:06.353194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef1cde-1fd7-4371-bd09-7e7047024c09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:06.355478 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef1cde-1fd7-4371-bd09-7e7047024c09 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:06.372319 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1409/2764] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:39:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:39:07.756137 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96a8cb-09af-449b-91f8-77fb4aaca343 service placement] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:07.788058 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96a8cb-09af-449b-91f8-77fb4aaca343 service placement] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:07.796156 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d80578-a3e9-418e-a708-4f63fc7a8c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:07.797608 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d80578-a3e9-418e-a708-4f63fc7a8c11 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:07.799730 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d80578-a3e9-418e-a708-4f63fc7a8c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:07.802415 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d80578-a3e9-418e-a708-4f63fc7a8c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:07.811220 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e7d80578-a3e9-418e-a708-4f63fc7a8c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:07.906329 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d80578-a3e9-418e-a708-4f63fc7a8c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:07.907777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d80578-a3e9-418e-a708-4f63fc7a8c11 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:07.918702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1356/2765] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:39:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:39:11.813205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef1cde-1fd7-4371-bd09-7e7047024c09 service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:11.827133 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef1cde-1fd7-4371-bd09-7e7047024c09 service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:11.834467 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033e14f-171b-4e23-b266-dc3a796787ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0005b0c9582e430e9cb85704a4505bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:11.834960 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033e14f-171b-4e23-b266-dc3a796787ad service placement] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:11.835244 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033e14f-171b-4e23-b266-dc3a796787ad service placement] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:11.835526 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033e14f-171b-4e23-b266-dc3a796787ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:11.837814 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1033e14f-171b-4e23-b266-dc3a796787ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:11.855118 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033e14f-171b-4e23-b266-dc3a796787ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:11.857257 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033e14f-171b-4e23-b266-dc3a796787ad service placement] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:11.873231 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d80578-a3e9-418e-a708-4f63fc7a8c11 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:11.882913 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e7d80578-a3e9-418e-a708-4f63fc7a8c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:11.885012 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1410/2766] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:39:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:39:11.902066 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d80578-a3e9-418e-a708-4f63fc7a8c11 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:11.907520 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7df21d-373f-400b-9de9-b7b15d8eaed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:11.908224 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7df21d-373f-400b-9de9-b7b15d8eaed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:11.909009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7df21d-373f-400b-9de9-b7b15d8eaed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:11.909289 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7df21d-373f-400b-9de9-b7b15d8eaed0 admin admin] PATH_INFO: `/v3/users/83efb092913842088cc1418123db4359` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:11.910774 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7df21d-373f-400b-9de9-b7b15d8eaed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83efb092913842088cc1418123db4359)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:11.912894 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7df21d-373f-400b-9de9-b7b15d8eaed0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:11.963678 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3d7df21d-373f-400b-9de9-b7b15d8eaed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83efb092913842088cc1418123db4359'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:11.964310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3d7df21d-373f-400b-9de9-b7b15d8eaed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83efb092913842088cc1418123db4359'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:11.972536 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3d7df21d-373f-400b-9de9-b7b15d8eaed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83efb092913842088cc1418123db4359'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:11.985206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3d7df21d-373f-400b-9de9-b7b15d8eaed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83efb092913842088cc1418123db4359'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:11.994322 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3d7df21d-373f-400b-9de9-b7b15d8eaed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83efb092913842088cc1418123db4359'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:12.001105 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1357/2767] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:39:11 2022] DELETE /identity/v3/users/83efb092913842088cc1418123db4359 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:39:12.398757 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033e14f-171b-4e23-b266-dc3a796787ad service placement] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:12.417105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033e14f-171b-4e23-b266-dc3a796787ad service placement] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:12.483240 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b369a-6e2b-48bc-86e6-2108d5756dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:12.483895 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b369a-6e2b-48bc-86e6-2108d5756dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:12.484186 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b369a-6e2b-48bc-86e6-2108d5756dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:12.484475 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b369a-6e2b-48bc-86e6-2108d5756dff admin admin] PATH_INFO: `/v3/projects/6303ae034173448e844a01c9f61484b4` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:12.485643 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b369a-6e2b-48bc-86e6-2108d5756dff admin admin] RBAC: Authorizing `identity:delete_project(project_id=6303ae034173448e844a01c9f61484b4)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:12.487965 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b369a-6e2b-48bc-86e6-2108d5756dff admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:12.535827 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a76b369a-6e2b-48bc-86e6-2108d5756dff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6303ae034173448e844a01c9f61484b4', 'request_id': 'req-a76b369a-6e2b-48bc-86e6-2108d5756dff'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:12.542751 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a76b369a-6e2b-48bc-86e6-2108d5756dff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6303ae034173448e844a01c9f61484b4', 'request_id': 'req-a76b369a-6e2b-48bc-86e6-2108d5756dff'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:12.552549 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a76b369a-6e2b-48bc-86e6-2108d5756dff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6303ae034173448e844a01c9f61484b4', 'request_id': 'req-a76b369a-6e2b-48bc-86e6-2108d5756dff'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:12.564148 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a76b369a-6e2b-48bc-86e6-2108d5756dff admin admin] The token cache is being invalidate because project 6303ae034173448e844a01c9f61484b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:39:12.564470 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a76b369a-6e2b-48bc-86e6-2108d5756dff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:12.565659 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a76b369a-6e2b-48bc-86e6-2108d5756dff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:12.567206 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1411/2768] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:39:12 2022] DELETE /identity/v3/projects/6303ae034173448e844a01c9f61484b4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:39:12.572237 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b18232-14a4-4a59-b84f-1b32e72b97d5 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:12.572552 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b18232-14a4-4a59-b84f-1b32e72b97d5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:12.572835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b18232-14a4-4a59-b84f-1b32e72b97d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:12.594453 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b8b18232-14a4-4a59-b84f-1b32e72b97d5 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:39:12.595582 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b8b18232-14a4-4a59-b84f-1b32e72b97d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:12.645168 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:39:12.660230 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1358/2769] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:39:12.668290 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f73ff-a5ad-491f-aff2-6b03b417482b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:12.668585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f73ff-a5ad-491f-aff2-6b03b417482b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:12.668866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f73ff-a5ad-491f-aff2-6b03b417482b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:12.689011 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-941f73ff-a5ad-491f-aff2-6b03b417482b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:39:12.691001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-941f73ff-a5ad-491f-aff2-6b03b417482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:12.699063 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1412/2770] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:39:12.703544 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b18232-14a4-4a59-b84f-1b32e72b97d5 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:12.714580 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b18232-14a4-4a59-b84f-1b32e72b97d5 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:12.719157 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5be66a-d47f-4e15-a0e8-fd28406613db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:12.719777 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5be66a-d47f-4e15-a0e8-fd28406613db admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:12.720061 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5be66a-d47f-4e15-a0e8-fd28406613db admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:12.720379 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5be66a-d47f-4e15-a0e8-fd28406613db admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:12.721132 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5be66a-d47f-4e15-a0e8-fd28406613db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:39:12.721388 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5be66a-d47f-4e15-a0e8-fd28406613db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:12.722993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5be66a-d47f-4e15-a0e8-fd28406613db admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:12.734682 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1359/2771] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:39:12.739367 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f73ff-a5ad-491f-aff2-6b03b417482b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:12.748980 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f73ff-a5ad-491f-aff2-6b03b417482b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:12.754902 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cefdd3-6a63-49cf-bef5-f97f7d32cafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:12.755519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cefdd3-6a63-49cf-bef5-f97f7d32cafd admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:12.755802 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cefdd3-6a63-49cf-bef5-f97f7d32cafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:12.756083 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cefdd3-6a63-49cf-bef5-f97f7d32cafd admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:12.756775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cefdd3-6a63-49cf-bef5-f97f7d32cafd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:12.758684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cefdd3-6a63-49cf-bef5-f97f7d32cafd admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:12.786632 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1413/2772] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:39:12 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:39:12.790634 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5be66a-d47f-4e15-a0e8-fd28406613db admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:12.801315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5be66a-d47f-4e15-a0e8-fd28406613db admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:12.880981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e4374-4196-457e-9b43-88046da0a383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:12.881652 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e4374-4196-457e-9b43-88046da0a383 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:12.881814 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e4374-4196-457e-9b43-88046da0a383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:12.882094 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e4374-4196-457e-9b43-88046da0a383 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:12.882775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e4374-4196-457e-9b43-88046da0a383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:12.884835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e4374-4196-457e-9b43-88046da0a383 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:12.921071 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1360/2773] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:39:12 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:39:12.925598 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cefdd3-6a63-49cf-bef5-f97f7d32cafd admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:12.938516 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cefdd3-6a63-49cf-bef5-f97f7d32cafd admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:12.945867 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725733d-f6f0-41c8-a08c-e7692748b0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:12.946876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725733d-f6f0-41c8-a08c-e7692748b0bd admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:12.947227 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725733d-f6f0-41c8-a08c-e7692748b0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:12.947481 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725733d-f6f0-41c8-a08c-e7692748b0bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:12.948219 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725733d-f6f0-41c8-a08c-e7692748b0bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:12.949853 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725733d-f6f0-41c8-a08c-e7692748b0bd admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:12.964708 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1414/2774] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:39:12.965921 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e4374-4196-457e-9b43-88046da0a383 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:12.978778 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e4374-4196-457e-9b43-88046da0a383 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:12.989957 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849dd22-0868-44e9-a12c-c413b0cd58ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:12.990629 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849dd22-0868-44e9-a12c-c413b0cd58ca admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:12.990944 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849dd22-0868-44e9-a12c-c413b0cd58ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:12.991225 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849dd22-0868-44e9-a12c-c413b0cd58ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:12.991962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849dd22-0868-44e9-a12c-c413b0cd58ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:12.993597 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849dd22-0868-44e9-a12c-c413b0cd58ca admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:13.006558 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1361/2775] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:39:13.010686 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725733d-f6f0-41c8-a08c-e7692748b0bd admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:13.021397 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725733d-f6f0-41c8-a08c-e7692748b0bd admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:13.026284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246466b5-16f9-4632-b298-30d9bbd8ffec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:13.026961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246466b5-16f9-4632-b298-30d9bbd8ffec admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:13.027246 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246466b5-16f9-4632-b298-30d9bbd8ffec admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:13.027524 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246466b5-16f9-4632-b298-30d9bbd8ffec admin admin] PATH_INFO: `/v3/projects/8c763ec10fae414180aabe24e532d53d/users/66b0dbe44b554290afd0fb976f421bc7/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:13.037197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:39:13.045307 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246466b5-16f9-4632-b298-30d9bbd8ffec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c763ec10fae414180aabe24e532d53d, user_id=66b0dbe44b554290afd0fb976f421bc7, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:13.049815 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246466b5-16f9-4632-b298-30d9bbd8ffec admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:13.065713 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1415/2776] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:39:13 2022] PUT /identity/v3/projects/8c763ec10fae414180aabe24e532d53d/users/66b0dbe44b554290afd0fb976f421bc7/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:39:13.070743 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f7935-7324-4f70-a597-ca169d91d1e2 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:13.071039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f7935-7324-4f70-a597-ca169d91d1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:13.071322 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f7935-7324-4f70-a597-ca169d91d1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:13.090793 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-cf2f7935-7324-4f70-a597-ca169d91d1e2 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:39:13.092020 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cf2f7935-7324-4f70-a597-ca169d91d1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:13.154436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1362/2777] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:39:13.163764 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246466b5-16f9-4632-b298-30d9bbd8ffec admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:13.165671 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-246466b5-16f9-4632-b298-30d9bbd8ffec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:13.226792 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246466b5-16f9-4632-b298-30d9bbd8ffec admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:13.230694 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e1724-4c9b-489a-b99c-979f8a1b70f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:13.231612 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e1724-4c9b-489a-b99c-979f8a1b70f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:13.231905 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e1724-4c9b-489a-b99c-979f8a1b70f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:13.232210 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e1724-4c9b-489a-b99c-979f8a1b70f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:13.246219 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e1724-4c9b-489a-b99c-979f8a1b70f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:13.249457 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e1724-4c9b-489a-b99c-979f8a1b70f6 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:13.261152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1416/2778] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:39:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:39:15.270750 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fc154-e122-47cd-bf7f-45856166e881 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:15.271695 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fc154-e122-47cd-bf7f-45856166e881 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:15.272146 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fc154-e122-47cd-bf7f-45856166e881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:15.295842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-2d5fc154-e122-47cd-bf7f-45856166e881 None None] MFA Rules not processed for user `306a5f4d7e0d44bd9a27145bd35a07fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:39:15.297504 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2d5fc154-e122-47cd-bf7f-45856166e881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:15.365359 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1363/2779] 10.222.0.48 () {58 vars in 967 bytes} [Thu Aug 4 10:39:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:39:15.420766 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e1724-4c9b-489a-b99c-979f8a1b70f6 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:15.422387 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-466e1724-4c9b-489a-b99c-979f8a1b70f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:15.561646 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e1724-4c9b-489a-b99c-979f8a1b70f6 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:15.568438 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548857a-be1e-464c-9771-242ba69141ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '878797620be54b74a3e8582c78ba78d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:15.569097 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548857a-be1e-464c-9771-242ba69141ef service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:15.569383 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548857a-be1e-464c-9771-242ba69141ef service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:15.569661 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548857a-be1e-464c-9771-242ba69141ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:15.581655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548857a-be1e-464c-9771-242ba69141ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:15.583304 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548857a-be1e-464c-9771-242ba69141ef service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:15.593399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1417/2780] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Aug 4 10:39:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 10:39:17.722277 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff237db-6ba6-4e37-a522-cd6a68741c24 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:17.722840 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff237db-6ba6-4e37-a522-cd6a68741c24 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:17.722840 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff237db-6ba6-4e37-a522-cd6a68741c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:17.735125 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:39:17.781647 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9ff237db-6ba6-4e37-a522-cd6a68741c24 None None] MFA Rules not processed for user `66b0dbe44b554290afd0fb976f421bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:39:17.783196 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9ff237db-6ba6-4e37-a522-cd6a68741c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:17.897863 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1364/2781] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:39:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:39:17.918940 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548857a-be1e-464c-9771-242ba69141ef service swift] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:17.920683 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7548857a-be1e-464c-9771-242ba69141ef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:18.043567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548857a-be1e-464c-9771-242ba69141ef service swift] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:18.058833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8e439-b0de-4541-be4d-bb09d8ddcd79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:18.061515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8e439-b0de-4541-be4d-bb09d8ddcd79 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:18.062160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8e439-b0de-4541-be4d-bb09d8ddcd79 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:18.062160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8e439-b0de-4541-be4d-bb09d8ddcd79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:18.069468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:39:18.076090 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8e439-b0de-4541-be4d-bb09d8ddcd79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:18.079043 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8e439-b0de-4541-be4d-bb09d8ddcd79 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:18.108855 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1418/2782] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:39:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:39:20.238680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74677e67-6a3b-46f8-91a6-c9a6d5e426e0 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:20.240051 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74677e67-6a3b-46f8-91a6-c9a6d5e426e0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:20.240584 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74677e67-6a3b-46f8-91a6-c9a6d5e426e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:20.278481 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-74677e67-6a3b-46f8-91a6-c9a6d5e426e0 None None] MFA Rules not processed for user `66b0dbe44b554290afd0fb976f421bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:39:20.285101 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-74677e67-6a3b-46f8-91a6-c9a6d5e426e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:20.318201 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1365/2783] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:39:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:39:20.877021 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8e439-b0de-4541-be4d-bb09d8ddcd79 service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:20.887284 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8e439-b0de-4541-be4d-bb09d8ddcd79 service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:20.891681 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a04d2-6ad8-4c61-8585-aad123e7518c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:20.892458 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a04d2-6ad8-4c61-8585-aad123e7518c service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:20.892892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a04d2-6ad8-4c61-8585-aad123e7518c service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:20.893261 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a04d2-6ad8-4c61-8585-aad123e7518c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:20.895327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-238a04d2-6ad8-4c61-8585-aad123e7518c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:20.907153 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a04d2-6ad8-4c61-8585-aad123e7518c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:20.909991 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a04d2-6ad8-4c61-8585-aad123e7518c service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:20.919664 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1419/2784] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:39:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:39:24.541536 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74677e67-6a3b-46f8-91a6-c9a6d5e426e0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:24.543303 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-74677e67-6a3b-46f8-91a6-c9a6d5e426e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:24.625123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a04d2-6ad8-4c61-8585-aad123e7518c service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:24.626514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-238a04d2-6ad8-4c61-8585-aad123e7518c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:24.661496 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a04d2-6ad8-4c61-8585-aad123e7518c service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:24.669773 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b90e2-2fe5-4272-993f-345477e4e443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:24.671099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b90e2-2fe5-4272-993f-345477e4e443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:24.671559 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b90e2-2fe5-4272-993f-345477e4e443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:24.672000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b90e2-2fe5-4272-993f-345477e4e443 admin admin] PATH_INFO: `/v3/users/69ba82b77bf64397b612f58618dcaa45` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:24.673690 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b90e2-2fe5-4272-993f-345477e4e443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ba82b77bf64397b612f58618dcaa45)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:24.675999 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b90e2-2fe5-4272-993f-345477e4e443 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:24.676820 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74677e67-6a3b-46f8-91a6-c9a6d5e426e0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:24.684548 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2948fb2-f5a3-4d4f-92f8-cc44eaae67fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0005b0c9582e430e9cb85704a4505bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:24.685010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2948fb2-f5a3-4d4f-92f8-cc44eaae67fb service placement] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:24.685393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2948fb2-f5a3-4d4f-92f8-cc44eaae67fb service placement] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:24.685668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2948fb2-f5a3-4d4f-92f8-cc44eaae67fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:24.687922 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d2948fb2-f5a3-4d4f-92f8-cc44eaae67fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:24.702376 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2948fb2-f5a3-4d4f-92f8-cc44eaae67fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:24.704004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2948fb2-f5a3-4d4f-92f8-cc44eaae67fb service placement] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:24.717368 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1366/2785] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:39:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:39:24.745528 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-910b90e2-2fe5-4272-993f-345477e4e443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ba82b77bf64397b612f58618dcaa45'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:24.746871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-910b90e2-2fe5-4272-993f-345477e4e443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ba82b77bf64397b612f58618dcaa45'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:24.758326 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-910b90e2-2fe5-4272-993f-345477e4e443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ba82b77bf64397b612f58618dcaa45'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:24.759147 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-910b90e2-2fe5-4272-993f-345477e4e443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ba82b77bf64397b612f58618dcaa45'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:24.779470 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-910b90e2-2fe5-4272-993f-345477e4e443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ba82b77bf64397b612f58618dcaa45'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:24.796222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1420/2786] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:39:24 2022] DELETE /identity/v3/users/69ba82b77bf64397b612f58618dcaa45 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:39:25.155476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2948fb2-f5a3-4d4f-92f8-cc44eaae67fb service placement] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:25.168794 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2948fb2-f5a3-4d4f-92f8-cc44eaae67fb service placement] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:25.244361 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb94942-1e4e-4c47-8d1e-836373c61665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:25.245026 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb94942-1e4e-4c47-8d1e-836373c61665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:25.245308 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb94942-1e4e-4c47-8d1e-836373c61665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:25.245585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb94942-1e4e-4c47-8d1e-836373c61665 admin admin] PATH_INFO: `/v3/projects/db10c436709f45b28a3e8a0257931fa7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:25.246794 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb94942-1e4e-4c47-8d1e-836373c61665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db10c436709f45b28a3e8a0257931fa7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:25.248787 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb94942-1e4e-4c47-8d1e-836373c61665 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:25.272592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:39:25.303502 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7eb94942-1e4e-4c47-8d1e-836373c61665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db10c436709f45b28a3e8a0257931fa7', 'request_id': 'req-7eb94942-1e4e-4c47-8d1e-836373c61665'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:25.310673 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7eb94942-1e4e-4c47-8d1e-836373c61665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db10c436709f45b28a3e8a0257931fa7', 'request_id': 'req-7eb94942-1e4e-4c47-8d1e-836373c61665'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:25.320663 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7eb94942-1e4e-4c47-8d1e-836373c61665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db10c436709f45b28a3e8a0257931fa7', 'request_id': 'req-7eb94942-1e4e-4c47-8d1e-836373c61665'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:25.333377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7eb94942-1e4e-4c47-8d1e-836373c61665 admin admin] The token cache is being invalidate because project db10c436709f45b28a3e8a0257931fa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:39:25.333671 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7eb94942-1e4e-4c47-8d1e-836373c61665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:25.334369 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7eb94942-1e4e-4c47-8d1e-836373c61665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:25.336203 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1367/2787] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:39:25 2022] DELETE /identity/v3/projects/db10c436709f45b28a3e8a0257931fa7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:39:25.340469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b90e2-2fe5-4272-993f-345477e4e443 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:25.341953 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-910b90e2-2fe5-4272-993f-345477e4e443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:25.356471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b90e2-2fe5-4272-993f-345477e4e443 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:25.423851 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5befc84-c13a-487d-81b9-8474a77f5cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:25.424998 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5befc84-c13a-487d-81b9-8474a77f5cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:25.425289 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5befc84-c13a-487d-81b9-8474a77f5cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:25.425550 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5befc84-c13a-487d-81b9-8474a77f5cba admin admin] PATH_INFO: `/v3/users/d7a54d740c5649e0a21ac0c6d35364a7` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:25.426824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5befc84-c13a-487d-81b9-8474a77f5cba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a54d740c5649e0a21ac0c6d35364a7)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:25.428837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5befc84-c13a-487d-81b9-8474a77f5cba admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:25.485919 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b5befc84-c13a-487d-81b9-8474a77f5cba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a54d740c5649e0a21ac0c6d35364a7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:25.487334 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b5befc84-c13a-487d-81b9-8474a77f5cba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a54d740c5649e0a21ac0c6d35364a7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:25.493452 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:39:25.495711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b5befc84-c13a-487d-81b9-8474a77f5cba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a54d740c5649e0a21ac0c6d35364a7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:25.496476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b5befc84-c13a-487d-81b9-8474a77f5cba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a54d740c5649e0a21ac0c6d35364a7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:25.512494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b5befc84-c13a-487d-81b9-8474a77f5cba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a54d740c5649e0a21ac0c6d35364a7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:25.526074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1421/2788] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:39:25 2022] DELETE /identity/v3/users/d7a54d740c5649e0a21ac0c6d35364a7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:39:25.714682 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb94942-1e4e-4c47-8d1e-836373c61665 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:39:25.716946 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7eb94942-1e4e-4c47-8d1e-836373c61665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:39:25.730864 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb94942-1e4e-4c47-8d1e-836373c61665 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:39:25.810056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe60842-6ff9-400e-9010-120011fa8b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:39:25.811007 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe60842-6ff9-400e-9010-120011fa8b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:39:25.811488 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe60842-6ff9-400e-9010-120011fa8b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:39:25.811732 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe60842-6ff9-400e-9010-120011fa8b9a admin admin] PATH_INFO: `/v3/projects/e9969d8483d3463fa95f3aaa180aa591` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:39:25.812984 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe60842-6ff9-400e-9010-120011fa8b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9969d8483d3463fa95f3aaa180aa591)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:39:25.814996 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe60842-6ff9-400e-9010-120011fa8b9a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:39:25.870476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-efe60842-6ff9-400e-9010-120011fa8b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9969d8483d3463fa95f3aaa180aa591', 'request_id': 'req-efe60842-6ff9-400e-9010-120011fa8b9a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:25.879297 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-efe60842-6ff9-400e-9010-120011fa8b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9969d8483d3463fa95f3aaa180aa591', 'request_id': 'req-efe60842-6ff9-400e-9010-120011fa8b9a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:25.887705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-efe60842-6ff9-400e-9010-120011fa8b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9969d8483d3463fa95f3aaa180aa591', 'request_id': 'req-efe60842-6ff9-400e-9010-120011fa8b9a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:25.899070 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-efe60842-6ff9-400e-9010-120011fa8b9a admin admin] The token cache is being invalidate because project e9969d8483d3463fa95f3aaa180aa591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:39:25.899358 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-efe60842-6ff9-400e-9010-120011fa8b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:25.900029 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-efe60842-6ff9-400e-9010-120011fa8b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:39:25.901933 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1368/2789] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:39:25 2022] DELETE /identity/v3/projects/e9969d8483d3463fa95f3aaa180aa591 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:39:35.522315 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=9,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:39:35.895677 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=67,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:40:52.247297 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5befc84-c13a-487d-81b9-8474a77f5cba admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:40:52.248838 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b5befc84-c13a-487d-81b9-8474a77f5cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:40:52.317638 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5befc84-c13a-487d-81b9-8474a77f5cba admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:40:52.374320 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4779862-567a-491f-a328-b6a08b925a08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:40:52.375499 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4779862-567a-491f-a328-b6a08b925a08 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:40:52.375781 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4779862-567a-491f-a328-b6a08b925a08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:40:52.376055 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4779862-567a-491f-a328-b6a08b925a08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:40:52.378287 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a4779862-567a-491f-a328-b6a08b925a08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:40:52.477404 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4779862-567a-491f-a328-b6a08b925a08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:40:52.478887 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4779862-567a-491f-a328-b6a08b925a08 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:40:52.491983 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1422/2790] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:40:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:40:56.607857 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655df228-902d-4096-a2e3-9593ed51e4f0 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:40:56.608575 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655df228-902d-4096-a2e3-9593ed51e4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:40:56.608575 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655df228-902d-4096-a2e3-9593ed51e4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:40:56.631519 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-655df228-902d-4096-a2e3-9593ed51e4f0 None None] MFA Rules not processed for user `66b0dbe44b554290afd0fb976f421bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:40:56.632852 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-655df228-902d-4096-a2e3-9593ed51e4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:40:56.706016 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1369/2791] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:40:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:40:57.066788 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4779862-567a-491f-a328-b6a08b925a08 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:40:57.069001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a4779862-567a-491f-a328-b6a08b925a08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:40:57.141127 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4779862-567a-491f-a328-b6a08b925a08 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:40:57.145835 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e598f-5101-49ba-918d-71514248d3ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:40:57.146583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e598f-5101-49ba-918d-71514248d3ea service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:40:57.146870 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e598f-5101-49ba-918d-71514248d3ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:40:57.147150 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e598f-5101-49ba-918d-71514248d3ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:40:57.149432 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-317e598f-5101-49ba-918d-71514248d3ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:40:57.161818 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e598f-5101-49ba-918d-71514248d3ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:40:57.163314 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e598f-5101-49ba-918d-71514248d3ea service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:40:57.168460 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:40:57.175657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1423/2792] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:40:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:40:57.626114 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655df228-902d-4096-a2e3-9593ed51e4f0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:40:57.628861 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-655df228-902d-4096-a2e3-9593ed51e4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:40:57.645554 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655df228-902d-4096-a2e3-9593ed51e4f0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:40:57.650809 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10956b9a-42fa-4341-975f-d6c6a4f3ad20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:40:57.651591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10956b9a-42fa-4341-975f-d6c6a4f3ad20 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:40:57.651920 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10956b9a-42fa-4341-975f-d6c6a4f3ad20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:40:57.652637 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10956b9a-42fa-4341-975f-d6c6a4f3ad20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:40:57.655054 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-10956b9a-42fa-4341-975f-d6c6a4f3ad20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:40:57.675003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10956b9a-42fa-4341-975f-d6c6a4f3ad20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:40:57.676471 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10956b9a-42fa-4341-975f-d6c6a4f3ad20 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:40:57.690478 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1370/2793] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:40:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:41:07.683293 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=31 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:41:12.170373 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e598f-5101-49ba-918d-71514248d3ea service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:41:12.181514 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e598f-5101-49ba-918d-71514248d3ea service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:41:12.186134 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d78521-a86b-426b-b820-74a9f0487c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:41:12.187643 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d78521-a86b-426b-b820-74a9f0487c35 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:41:12.188607 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d78521-a86b-426b-b820-74a9f0487c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:41:12.188793 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d78521-a86b-426b-b820-74a9f0487c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:41:12.191398 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-29d78521-a86b-426b-b820-74a9f0487c35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:41:12.205650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d78521-a86b-426b-b820-74a9f0487c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:41:12.207600 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d78521-a86b-426b-b820-74a9f0487c35 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:41:12.218603 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1424/2794] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:41:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:41:22.213605 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=6 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:42:41.941070 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564c473-8006-43bb-89f6-5034a3b17a4d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:42:41.941860 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564c473-8006-43bb-89f6-5034a3b17a4d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:42:41.941860 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564c473-8006-43bb-89f6-5034a3b17a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:42:41.963112 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-6564c473-8006-43bb-89f6-5034a3b17a4d None None] MFA Rules not processed for user `66b0dbe44b554290afd0fb976f421bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:42:41.965072 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6564c473-8006-43bb-89f6-5034a3b17a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:42:41.973540 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1371/2795] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:42:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:42:42.714987 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d78521-a86b-426b-b820-74a9f0487c35 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:42:42.717210 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-29d78521-a86b-426b-b820-74a9f0487c35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:42:42.807543 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d78521-a86b-426b-b820-74a9f0487c35 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:42:42.813483 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8df2f3-00da-46a0-a590-e0af423810e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0005b0c9582e430e9cb85704a4505bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:42:42.814225 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8df2f3-00da-46a0-a590-e0af423810e4 service placement] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:42:42.814730 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8df2f3-00da-46a0-a590-e0af423810e4 service placement] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:42:42.815120 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8df2f3-00da-46a0-a590-e0af423810e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:42:42.817480 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3b8df2f3-00da-46a0-a590-e0af423810e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:42:42.830840 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8df2f3-00da-46a0-a590-e0af423810e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:42:42.832508 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8df2f3-00da-46a0-a590-e0af423810e4 service placement] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:42:42.849747 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1425/2796] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:42:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:42:51.957961 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:42:52.195562 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564c473-8006-43bb-89f6-5034a3b17a4d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:42:52.199161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6564c473-8006-43bb-89f6-5034a3b17a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:42:52.233924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564c473-8006-43bb-89f6-5034a3b17a4d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:42:52.247459 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81cfcf-ffd5-4203-ab55-b66d16e49208 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:42:52.249622 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81cfcf-ffd5-4203-ab55-b66d16e49208 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:42:52.250127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81cfcf-ffd5-4203-ab55-b66d16e49208 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:42:52.251271 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81cfcf-ffd5-4203-ab55-b66d16e49208 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:42:52.254720 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1f81cfcf-ffd5-4203-ab55-b66d16e49208 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:42:52.282413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81cfcf-ffd5-4203-ab55-b66d16e49208 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:42:52.285533 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81cfcf-ffd5-4203-ab55-b66d16e49208 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:42:52.308129 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1372/2797] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:42:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:42:52.840394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=32 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:43:02.300150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=6 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:44:18.519120 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8df2f3-00da-46a0-a590-e0af423810e4 service placement] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:44:18.606185 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8df2f3-00da-46a0-a590-e0af423810e4 service placement] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:44:18.613573 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27b3ec-07bd-409a-b761-f944acada366 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:44:18.614399 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27b3ec-07bd-409a-b761-f944acada366 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:44:18.614813 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27b3ec-07bd-409a-b761-f944acada366 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:44:18.615203 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27b3ec-07bd-409a-b761-f944acada366 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:44:18.617852 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ee27b3ec-07bd-409a-b761-f944acada366 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:44:18.647744 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27b3ec-07bd-409a-b761-f944acada366 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:44:18.649685 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27b3ec-07bd-409a-b761-f944acada366 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:44:18.661439 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1426/2798] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:44:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:44:20.407677 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81cfcf-ffd5-4203-ab55-b66d16e49208 service nova] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:44:20.560093 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81cfcf-ffd5-4203-ab55-b66d16e49208 service nova] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:44:20.566901 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad2d9a-5a98-438f-b8a1-892e731f771f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '592539924feb44ad8ea520d8539b6608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:44:20.567567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad2d9a-5a98-438f-b8a1-892e731f771f service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:44:20.567854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad2d9a-5a98-438f-b8a1-892e731f771f service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:44:20.568135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad2d9a-5a98-438f-b8a1-892e731f771f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:44:20.570247 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b9ad2d9a-5a98-438f-b8a1-892e731f771f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:44:20.601972 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad2d9a-5a98-438f-b8a1-892e731f771f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:44:20.604928 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad2d9a-5a98-438f-b8a1-892e731f771f service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:44:20.621702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1373/2799] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:44:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:44:20.662204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27b3ec-07bd-409a-b761-f944acada366 service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:44:20.665156 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ee27b3ec-07bd-409a-b761-f944acada366 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:44:20.713252 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27b3ec-07bd-409a-b761-f944acada366 service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:44:20.722934 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313273c-526f-47c4-93ca-808bbcf40637 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0005b0c9582e430e9cb85704a4505bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:44:20.723601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313273c-526f-47c4-93ca-808bbcf40637 service placement] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:44:20.724090 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313273c-526f-47c4-93ca-808bbcf40637 service placement] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:44:20.724625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313273c-526f-47c4-93ca-808bbcf40637 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:44:20.728062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3313273c-526f-47c4-93ca-808bbcf40637 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:44:20.749407 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313273c-526f-47c4-93ca-808bbcf40637 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:44:20.751215 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313273c-526f-47c4-93ca-808bbcf40637 service placement] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:44:20.767077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1427/2800] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:44:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:44:24.703458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecdc94-fc82-474a-8768-d644b70eb0af None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:44:24.704038 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecdc94-fc82-474a-8768-d644b70eb0af None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:44:24.704360 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecdc94-fc82-474a-8768-d644b70eb0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:44:24.736157 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b6ecdc94-fc82-474a-8768-d644b70eb0af None None] MFA Rules not processed for user `66b0dbe44b554290afd0fb976f421bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:44:24.737770 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b6ecdc94-fc82-474a-8768-d644b70eb0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:44:24.746712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1374/2801] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:44:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:44:25.126361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313273c-526f-47c4-93ca-808bbcf40637 service placement] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:44:25.149512 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313273c-526f-47c4-93ca-808bbcf40637 service placement] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:44:25.154522 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5466e-5f19-453e-980d-96272706012d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:44:25.155169 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5466e-5f19-453e-980d-96272706012d service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:44:25.155452 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5466e-5f19-453e-980d-96272706012d service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:44:25.155742 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5466e-5f19-453e-980d-96272706012d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:44:25.157676 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-46f5466e-5f19-453e-980d-96272706012d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:44:25.183880 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5466e-5f19-453e-980d-96272706012d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:44:25.185125 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5466e-5f19-453e-980d-96272706012d service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:44:25.194997 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1428/2802] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:44:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:44:34.728389 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=38 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:44:35.190418 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=64 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:45:55.540810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecdc94-fc82-474a-8768-d644b70eb0af None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:45:55.543207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b6ecdc94-fc82-474a-8768-d644b70eb0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:45:55.605804 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecdc94-fc82-474a-8768-d644b70eb0af None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:45:55.611999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffcf33-1980-40ca-8393-02e226dd81f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:45:55.613144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffcf33-1980-40ca-8393-02e226dd81f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:45:55.613650 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffcf33-1980-40ca-8393-02e226dd81f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:45:55.614141 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffcf33-1980-40ca-8393-02e226dd81f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:45:55.633569 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffcf33-1980-40ca-8393-02e226dd81f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:45:55.635962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffcf33-1980-40ca-8393-02e226dd81f8 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:45:55.649509 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1375/2803] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:45:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:45:58.390646 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5466e-5f19-453e-980d-96272706012d service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:45:58.408703 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5466e-5f19-453e-980d-96272706012d service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:45:58.414767 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020c5b5-251d-4741-8298-f39060661988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:45:58.415591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020c5b5-251d-4741-8298-f39060661988 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:45:58.415972 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020c5b5-251d-4741-8298-f39060661988 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:45:58.416494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020c5b5-251d-4741-8298-f39060661988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:45:58.436202 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020c5b5-251d-4741-8298-f39060661988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:45:58.438820 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020c5b5-251d-4741-8298-f39060661988 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:45:58.458864 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1429/2804] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:45:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:46:05.643476 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=15 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:08.450821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=6 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:09.582209 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffcf33-1980-40ca-8393-02e226dd81f8 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:09.601178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffcf33-1980-40ca-8393-02e226dd81f8 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:09.608080 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a370408-911d-46d8-afe8-eca60499c840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:09.609211 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a370408-911d-46d8-afe8-eca60499c840 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:09.609667 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a370408-911d-46d8-afe8-eca60499c840 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:09.610110 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a370408-911d-46d8-afe8-eca60499c840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:09.613214 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8a370408-911d-46d8-afe8-eca60499c840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:09.750609 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a370408-911d-46d8-afe8-eca60499c840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:09.752617 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a370408-911d-46d8-afe8-eca60499c840 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:09.784556 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1376/2805] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:46:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:46:13.779534 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020c5b5-251d-4741-8298-f39060661988 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:13.794177 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020c5b5-251d-4741-8298-f39060661988 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:13.802749 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6ab28-69e8-498b-bf49-9152767279cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0005b0c9582e430e9cb85704a4505bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:13.802749 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6ab28-69e8-498b-bf49-9152767279cb service placement] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:13.802749 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6ab28-69e8-498b-bf49-9152767279cb service placement] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:13.802749 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6ab28-69e8-498b-bf49-9152767279cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:13.804525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-dfc6ab28-69e8-498b-bf49-9152767279cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:13.821050 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6ab28-69e8-498b-bf49-9152767279cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:13.823748 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6ab28-69e8-498b-bf49-9152767279cb service placement] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:13.836248 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1430/2806] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:46:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:46:13.858987 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a370408-911d-46d8-afe8-eca60499c840 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:13.860810 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8a370408-911d-46d8-afe8-eca60499c840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:13.879165 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a370408-911d-46d8-afe8-eca60499c840 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:13.888681 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08708dfa-438b-4eb7-a135-caf9b1148c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:13.889670 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08708dfa-438b-4eb7-a135-caf9b1148c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:13.889962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08708dfa-438b-4eb7-a135-caf9b1148c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:13.890242 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08708dfa-438b-4eb7-a135-caf9b1148c2e admin admin] PATH_INFO: `/v3/users/66b0dbe44b554290afd0fb976f421bc7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:13.891635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08708dfa-438b-4eb7-a135-caf9b1148c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b0dbe44b554290afd0fb976f421bc7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:13.894752 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08708dfa-438b-4eb7-a135-caf9b1148c2e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:13.958055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-08708dfa-438b-4eb7-a135-caf9b1148c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b0dbe44b554290afd0fb976f421bc7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:13.958699 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-08708dfa-438b-4eb7-a135-caf9b1148c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b0dbe44b554290afd0fb976f421bc7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:13.969409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-08708dfa-438b-4eb7-a135-caf9b1148c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b0dbe44b554290afd0fb976f421bc7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:13.991543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-08708dfa-438b-4eb7-a135-caf9b1148c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b0dbe44b554290afd0fb976f421bc7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:14.004070 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-08708dfa-438b-4eb7-a135-caf9b1148c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b0dbe44b554290afd0fb976f421bc7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:14.015055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1377/2807] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:46:13 2022] DELETE /identity/v3/users/66b0dbe44b554290afd0fb976f421bc7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:46:14.256013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6ab28-69e8-498b-bf49-9152767279cb service placement] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:14.276532 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6ab28-69e8-498b-bf49-9152767279cb service placement] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:14.374687 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c788874-254f-4e19-8238-2235380055fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:14.375498 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c788874-254f-4e19-8238-2235380055fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:14.375886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c788874-254f-4e19-8238-2235380055fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:14.376327 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c788874-254f-4e19-8238-2235380055fe admin admin] PATH_INFO: `/v3/projects/8c763ec10fae414180aabe24e532d53d` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:14.378011 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c788874-254f-4e19-8238-2235380055fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c763ec10fae414180aabe24e532d53d)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:14.380340 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c788874-254f-4e19-8238-2235380055fe admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:14.433236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5c788874-254f-4e19-8238-2235380055fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c763ec10fae414180aabe24e532d53d', 'request_id': 'req-5c788874-254f-4e19-8238-2235380055fe'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:14.439615 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5c788874-254f-4e19-8238-2235380055fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c763ec10fae414180aabe24e532d53d', 'request_id': 'req-5c788874-254f-4e19-8238-2235380055fe'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:14.448011 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5c788874-254f-4e19-8238-2235380055fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c763ec10fae414180aabe24e532d53d', 'request_id': 'req-5c788874-254f-4e19-8238-2235380055fe'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:14.462533 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5c788874-254f-4e19-8238-2235380055fe admin admin] The token cache is being invalidate because project 8c763ec10fae414180aabe24e532d53d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:46:14.462826 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5c788874-254f-4e19-8238-2235380055fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:14.463493 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5c788874-254f-4e19-8238-2235380055fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:14.465113 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1431/2808] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:46:14 2022] DELETE /identity/v3/projects/8c763ec10fae414180aabe24e532d53d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:14.470962 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0469332-0679-47e4-a499-f6062caeaf0d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:14.471250 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0469332-0679-47e4-a499-f6062caeaf0d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:14.471531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0469332-0679-47e4-a499-f6062caeaf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:14.536565 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:14.544238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-f0469332-0679-47e4-a499-f6062caeaf0d None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:14.545981 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f0469332-0679-47e4-a499-f6062caeaf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:14.617176 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1378/2809] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:14.628487 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c4e7e-15fd-4095-b8ed-bde047c8aea8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:14.628909 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c4e7e-15fd-4095-b8ed-bde047c8aea8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:14.629298 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c4e7e-15fd-4095-b8ed-bde047c8aea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:14.651997 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f66c4e7e-15fd-4095-b8ed-bde047c8aea8 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:14.653303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f66c4e7e-15fd-4095-b8ed-bde047c8aea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:14.662124 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1432/2810] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:14.668435 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0469332-0679-47e4-a499-f6062caeaf0d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:14.685454 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0469332-0679-47e4-a499-f6062caeaf0d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:14.692079 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd690695-34f9-4b40-be1e-06009b3bde12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:14.693194 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd690695-34f9-4b40-be1e-06009b3bde12 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:14.693703 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd690695-34f9-4b40-be1e-06009b3bde12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:14.694215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd690695-34f9-4b40-be1e-06009b3bde12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:14.695555 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd690695-34f9-4b40-be1e-06009b3bde12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:46:14.696120 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd690695-34f9-4b40-be1e-06009b3bde12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:14.699202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd690695-34f9-4b40-be1e-06009b3bde12 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:14.719428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1379/2811] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:46:14.723968 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c4e7e-15fd-4095-b8ed-bde047c8aea8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:14.735079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c4e7e-15fd-4095-b8ed-bde047c8aea8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:14.742849 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788fd3d-f0db-433e-b080-fe738cbeb8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:14.743669 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788fd3d-f0db-433e-b080-fe738cbeb8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:14.744197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788fd3d-f0db-433e-b080-fe738cbeb8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:14.744740 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788fd3d-f0db-433e-b080-fe738cbeb8f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:14.746037 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788fd3d-f0db-433e-b080-fe738cbeb8f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:14.749907 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788fd3d-f0db-433e-b080-fe738cbeb8f9 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:14.809788 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1433/2812] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:46:14 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:14.814072 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd690695-34f9-4b40-be1e-06009b3bde12 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:14.825564 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd690695-34f9-4b40-be1e-06009b3bde12 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:14.893988 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42966cd1-42bf-49cf-bfad-df6291307921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:14.895082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42966cd1-42bf-49cf-bfad-df6291307921 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:14.895293 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42966cd1-42bf-49cf-bfad-df6291307921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:14.895460 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42966cd1-42bf-49cf-bfad-df6291307921 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:14.896085 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42966cd1-42bf-49cf-bfad-df6291307921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:14.898127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42966cd1-42bf-49cf-bfad-df6291307921 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:14.929287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1380/2813] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:46:14 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:46:14.934677 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788fd3d-f0db-433e-b080-fe738cbeb8f9 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:14.945893 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788fd3d-f0db-433e-b080-fe738cbeb8f9 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:14.952381 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64292a6-cb0d-4101-8043-513efd17c5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:14.953394 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64292a6-cb0d-4101-8043-513efd17c5ba admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:14.953808 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64292a6-cb0d-4101-8043-513efd17c5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:14.954199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64292a6-cb0d-4101-8043-513efd17c5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:14.955089 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64292a6-cb0d-4101-8043-513efd17c5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:14.956942 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64292a6-cb0d-4101-8043-513efd17c5ba admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:14.970669 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1434/2814] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:14.975593 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42966cd1-42bf-49cf-bfad-df6291307921 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:14.987341 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42966cd1-42bf-49cf-bfad-df6291307921 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:14.993167 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219bf06-181f-4fa6-a05d-6cab4dcee5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:14.994043 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219bf06-181f-4fa6-a05d-6cab4dcee5bb admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:14.994431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219bf06-181f-4fa6-a05d-6cab4dcee5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:14.994807 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219bf06-181f-4fa6-a05d-6cab4dcee5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:14.995647 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219bf06-181f-4fa6-a05d-6cab4dcee5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:14.997592 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219bf06-181f-4fa6-a05d-6cab4dcee5bb admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:15.011035 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1381/2815] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:15.015519 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64292a6-cb0d-4101-8043-513efd17c5ba admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:15.027269 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64292a6-cb0d-4101-8043-513efd17c5ba admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:15.032391 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4edd6-d4a1-4d86-8370-16c17254afb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:15.033105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4edd6-d4a1-4d86-8370-16c17254afb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:15.033390 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4edd6-d4a1-4d86-8370-16c17254afb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:15.033673 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4edd6-d4a1-4d86-8370-16c17254afb0 admin admin] PATH_INFO: `/v3/projects/1068865f96114dc2b8591f0e74c73821/users/aec36a98477643038224e55b63649e6f/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:15.050848 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4edd6-d4a1-4d86-8370-16c17254afb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1068865f96114dc2b8591f0e74c73821, user_id=aec36a98477643038224e55b63649e6f, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:15.053912 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4edd6-d4a1-4d86-8370-16c17254afb0 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:15.070023 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1435/2816] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:46:15 2022] PUT /identity/v3/projects/1068865f96114dc2b8591f0e74c73821/users/aec36a98477643038224e55b63649e6f/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:15.088085 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b3940-4d9d-4734-b60b-a08a97761609 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:15.088969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b3940-4d9d-4734-b60b-a08a97761609 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:15.089255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b3940-4d9d-4734-b60b-a08a97761609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:15.120729 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-187b3940-4d9d-4734-b60b-a08a97761609 None None] MFA Rules not processed for user `aec36a98477643038224e55b63649e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:15.122001 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-187b3940-4d9d-4734-b60b-a08a97761609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:15.226202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1382/2817] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:15.232861 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4edd6-d4a1-4d86-8370-16c17254afb0 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:15.239146 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:15.308605 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4edd6-d4a1-4d86-8370-16c17254afb0 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:15.314180 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49143bfc-1b74-4ffe-adaa-3c86ebb2d211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:15.314972 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49143bfc-1b74-4ffe-adaa-3c86ebb2d211 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:15.315611 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49143bfc-1b74-4ffe-adaa-3c86ebb2d211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:15.316098 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49143bfc-1b74-4ffe-adaa-3c86ebb2d211 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:15.316952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49143bfc-1b74-4ffe-adaa-3c86ebb2d211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:15.319276 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49143bfc-1b74-4ffe-adaa-3c86ebb2d211 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:15.353928 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1436/2818] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:46:15 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:15.358796 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b3940-4d9d-4734-b60b-a08a97761609 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:15.365290 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:15.375045 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b3940-4d9d-4734-b60b-a08a97761609 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:15.446036 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571953f-69ed-41dc-8e90-31a043266aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:15.447631 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571953f-69ed-41dc-8e90-31a043266aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:15.448072 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571953f-69ed-41dc-8e90-31a043266aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:15.448601 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571953f-69ed-41dc-8e90-31a043266aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:15.449912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571953f-69ed-41dc-8e90-31a043266aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:15.453868 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571953f-69ed-41dc-8e90-31a043266aa5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:15.489948 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1383/2819] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:46:15 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:15.495038 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49143bfc-1b74-4ffe-adaa-3c86ebb2d211 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:15.507424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49143bfc-1b74-4ffe-adaa-3c86ebb2d211 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:15.513274 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269ca99-ccd4-49c7-b2d6-e1e8c4a93dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:15.514080 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269ca99-ccd4-49c7-b2d6-e1e8c4a93dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:15.515338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269ca99-ccd4-49c7-b2d6-e1e8c4a93dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:15.515338 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269ca99-ccd4-49c7-b2d6-e1e8c4a93dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:15.515653 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269ca99-ccd4-49c7-b2d6-e1e8c4a93dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:15.517479 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269ca99-ccd4-49c7-b2d6-e1e8c4a93dcb admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:15.530967 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1437/2820] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:46:15.537584 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571953f-69ed-41dc-8e90-31a043266aa5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:15.549056 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571953f-69ed-41dc-8e90-31a043266aa5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:15.554754 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174e6c8-7500-4349-a372-c74dbd14b9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:15.555457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174e6c8-7500-4349-a372-c74dbd14b9ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:15.556315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174e6c8-7500-4349-a372-c74dbd14b9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:15.556599 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174e6c8-7500-4349-a372-c74dbd14b9ca admin admin] PATH_INFO: `/v3/projects/05eedd777eda4237bbb834664f74b085/users/fdb4e90ba0a7493fb04085bae438d67d/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:15.575409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174e6c8-7500-4349-a372-c74dbd14b9ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=05eedd777eda4237bbb834664f74b085, user_id=fdb4e90ba0a7493fb04085bae438d67d, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:15.578472 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174e6c8-7500-4349-a372-c74dbd14b9ca admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:15.595255 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1384/2821] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:46:15 2022] PUT /identity/v3/projects/05eedd777eda4237bbb834664f74b085/users/fdb4e90ba0a7493fb04085bae438d67d/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:15.600080 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269ca99-ccd4-49c7-b2d6-e1e8c4a93dcb admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:15.614040 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269ca99-ccd4-49c7-b2d6-e1e8c4a93dcb admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:15.683953 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dba66a-6a4e-447e-a1d0-91bb91cae041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:15.684641 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dba66a-6a4e-447e-a1d0-91bb91cae041 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:15.684923 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dba66a-6a4e-447e-a1d0-91bb91cae041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:15.685199 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dba66a-6a4e-447e-a1d0-91bb91cae041 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:15.685921 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dba66a-6a4e-447e-a1d0-91bb91cae041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:15.687583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dba66a-6a4e-447e-a1d0-91bb91cae041 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:15.699325 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1438/2822] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:15.704145 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174e6c8-7500-4349-a372-c74dbd14b9ca admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:15.715967 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174e6c8-7500-4349-a372-c74dbd14b9ca admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:15.721781 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf2f91-8a0e-4a9c-9fd4-b5ddbf00f55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:15.722473 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf2f91-8a0e-4a9c-9fd4-b5ddbf00f55c admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:15.722758 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf2f91-8a0e-4a9c-9fd4-b5ddbf00f55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:15.723039 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf2f91-8a0e-4a9c-9fd4-b5ddbf00f55c admin admin] PATH_INFO: `/v3/projects/05eedd777eda4237bbb834664f74b085/users/fdb4e90ba0a7493fb04085bae438d67d/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:15.725203 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf2f91-8a0e-4a9c-9fd4-b5ddbf00f55c admin admin] RBAC: Authorizing `identity:create_grant(project_id=05eedd777eda4237bbb834664f74b085, user_id=fdb4e90ba0a7493fb04085bae438d67d, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:15.728543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf2f91-8a0e-4a9c-9fd4-b5ddbf00f55c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:15.744741 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1385/2823] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:46:15 2022] PUT /identity/v3/projects/05eedd777eda4237bbb834664f74b085/users/fdb4e90ba0a7493fb04085bae438d67d/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:15.758885 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26137a-d0b2-40c9-bc0c-c854c5756073 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:15.759295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26137a-d0b2-40c9-bc0c-c854c5756073 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:15.759795 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26137a-d0b2-40c9-bc0c-c854c5756073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:15.793517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-bf26137a-d0b2-40c9-bc0c-c854c5756073 None None] MFA Rules not processed for user `fdb4e90ba0a7493fb04085bae438d67d`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:15.794777 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-bf26137a-d0b2-40c9-bc0c-c854c5756073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:15.877197 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:15.887588 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1439/2824] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:46:15.897068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf2f91-8a0e-4a9c-9fd4-b5ddbf00f55c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:15.899055 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d8bf2f91-8a0e-4a9c-9fd4-b5ddbf00f55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:15.977053 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf2f91-8a0e-4a9c-9fd4-b5ddbf00f55c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:15.983635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb1c19-04c6-4963-9333-8e68eca493a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:15.984744 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb1c19-04c6-4963-9333-8e68eca493a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:15.985229 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb1c19-04c6-4963-9333-8e68eca493a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:15.985707 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb1c19-04c6-4963-9333-8e68eca493a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:15.996760 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb1c19-04c6-4963-9333-8e68eca493a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:15.998151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb1c19-04c6-4963-9333-8e68eca493a8 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:16.011987 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1386/2825] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:46:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:46:16.475657 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26137a-d0b2-40c9-bc0c-c854c5756073 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:16.551318 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26137a-d0b2-40c9-bc0c-c854c5756073 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:16.556376 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab9baa-48f7-414f-ac8a-01bf8d765023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:16.557052 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab9baa-48f7-414f-ac8a-01bf8d765023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:16.557337 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab9baa-48f7-414f-ac8a-01bf8d765023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:16.557615 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab9baa-48f7-414f-ac8a-01bf8d765023 admin admin] PATH_INFO: `/v3/users/aec36a98477643038224e55b63649e6f` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:16.558851 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab9baa-48f7-414f-ac8a-01bf8d765023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aec36a98477643038224e55b63649e6f)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:16.560858 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab9baa-48f7-414f-ac8a-01bf8d765023 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:16.617363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-11ab9baa-48f7-414f-ac8a-01bf8d765023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aec36a98477643038224e55b63649e6f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:16.619096 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-11ab9baa-48f7-414f-ac8a-01bf8d765023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aec36a98477643038224e55b63649e6f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:16.627941 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-11ab9baa-48f7-414f-ac8a-01bf8d765023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aec36a98477643038224e55b63649e6f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:16.628747 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-11ab9baa-48f7-414f-ac8a-01bf8d765023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aec36a98477643038224e55b63649e6f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:16.642042 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-11ab9baa-48f7-414f-ac8a-01bf8d765023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aec36a98477643038224e55b63649e6f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:16.659092 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1440/2826] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:46:16 2022] DELETE /identity/v3/users/aec36a98477643038224e55b63649e6f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:16.663971 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500a4cb-e75a-4481-9889-555a2a5b760e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:16.664295 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500a4cb-e75a-4481-9889-555a2a5b760e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:16.664590 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500a4cb-e75a-4481-9889-555a2a5b760e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:16.687250 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a500a4cb-e75a-4481-9889-555a2a5b760e None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:16.688544 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a500a4cb-e75a-4481-9889-555a2a5b760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:16.751144 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:16.763669 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1387/2827] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:46:16.775401 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab9baa-48f7-414f-ac8a-01bf8d765023 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:16.776920 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-11ab9baa-48f7-414f-ac8a-01bf8d765023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:16.844756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab9baa-48f7-414f-ac8a-01bf8d765023 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:16.848819 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0daeca9-884c-447c-95e4-03cf31632f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:16.849471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0daeca9-884c-447c-95e4-03cf31632f49 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:16.849760 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0daeca9-884c-447c-95e4-03cf31632f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:16.850033 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0daeca9-884c-447c-95e4-03cf31632f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:16.860959 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0daeca9-884c-447c-95e4-03cf31632f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:16.862447 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0daeca9-884c-447c-95e4-03cf31632f49 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:16.874026 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1441/2828] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:46:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:46:17.231859 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500a4cb-e75a-4481-9889-555a2a5b760e None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:17.233926 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a500a4cb-e75a-4481-9889-555a2a5b760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:17.251958 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500a4cb-e75a-4481-9889-555a2a5b760e None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:17.258109 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d86b5-3017-4fd6-8aff-4809886447e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:17.259525 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d86b5-3017-4fd6-8aff-4809886447e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:17.260001 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d86b5-3017-4fd6-8aff-4809886447e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:17.260426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d86b5-3017-4fd6-8aff-4809886447e2 admin admin] PATH_INFO: `/v3/projects/1068865f96114dc2b8591f0e74c73821` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:17.263037 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d86b5-3017-4fd6-8aff-4809886447e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1068865f96114dc2b8591f0e74c73821)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:17.267972 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d86b5-3017-4fd6-8aff-4809886447e2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:17.339469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9d3d86b5-3017-4fd6-8aff-4809886447e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1068865f96114dc2b8591f0e74c73821', 'request_id': 'req-9d3d86b5-3017-4fd6-8aff-4809886447e2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:17.347719 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9d3d86b5-3017-4fd6-8aff-4809886447e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1068865f96114dc2b8591f0e74c73821', 'request_id': 'req-9d3d86b5-3017-4fd6-8aff-4809886447e2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:17.356912 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9d3d86b5-3017-4fd6-8aff-4809886447e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1068865f96114dc2b8591f0e74c73821', 'request_id': 'req-9d3d86b5-3017-4fd6-8aff-4809886447e2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:17.371115 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9d3d86b5-3017-4fd6-8aff-4809886447e2 admin admin] The token cache is being invalidate because project 1068865f96114dc2b8591f0e74c73821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:46:17.371429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9d3d86b5-3017-4fd6-8aff-4809886447e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:17.372095 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9d3d86b5-3017-4fd6-8aff-4809886447e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:17.373680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1388/2829] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:46:17 2022] DELETE /identity/v3/projects/1068865f96114dc2b8591f0e74c73821 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:46:17.378297 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0daeca9-884c-447c-95e4-03cf31632f49 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:17.390000 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0daeca9-884c-447c-95e4-03cf31632f49 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:17.413062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:17.474583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a3213-c8c5-4ac7-8d91-aaa37c21a282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:17.475542 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a3213-c8c5-4ac7-8d91-aaa37c21a282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:17.476032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a3213-c8c5-4ac7-8d91-aaa37c21a282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:17.476541 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a3213-c8c5-4ac7-8d91-aaa37c21a282 admin admin] PATH_INFO: `/v3/users/fdb4e90ba0a7493fb04085bae438d67d` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:17.479149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a3213-c8c5-4ac7-8d91-aaa37c21a282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb4e90ba0a7493fb04085bae438d67d)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:17.482262 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a3213-c8c5-4ac7-8d91-aaa37c21a282 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:17.550030 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0d3a3213-c8c5-4ac7-8d91-aaa37c21a282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb4e90ba0a7493fb04085bae438d67d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:17.550852 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0d3a3213-c8c5-4ac7-8d91-aaa37c21a282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb4e90ba0a7493fb04085bae438d67d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:17.565424 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0d3a3213-c8c5-4ac7-8d91-aaa37c21a282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb4e90ba0a7493fb04085bae438d67d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:17.566743 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0d3a3213-c8c5-4ac7-8d91-aaa37c21a282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb4e90ba0a7493fb04085bae438d67d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:17.586031 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0d3a3213-c8c5-4ac7-8d91-aaa37c21a282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb4e90ba0a7493fb04085bae438d67d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:17.606571 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1442/2830] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:46:17 2022] DELETE /identity/v3/users/fdb4e90ba0a7493fb04085bae438d67d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:17.961662 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d86b5-3017-4fd6-8aff-4809886447e2 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:17.966187 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9d3d86b5-3017-4fd6-8aff-4809886447e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:17.988281 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d86b5-3017-4fd6-8aff-4809886447e2 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:18.090051 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee65c3-57e5-4737-8b89-4c26f3067dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:18.091185 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee65c3-57e5-4737-8b89-4c26f3067dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:18.091704 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee65c3-57e5-4737-8b89-4c26f3067dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:18.092267 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee65c3-57e5-4737-8b89-4c26f3067dd1 admin admin] PATH_INFO: `/v3/projects/05eedd777eda4237bbb834664f74b085` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:18.094799 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee65c3-57e5-4737-8b89-4c26f3067dd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05eedd777eda4237bbb834664f74b085)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:18.098684 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee65c3-57e5-4737-8b89-4c26f3067dd1 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:18.187096 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-94ee65c3-57e5-4737-8b89-4c26f3067dd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05eedd777eda4237bbb834664f74b085', 'request_id': 'req-94ee65c3-57e5-4737-8b89-4c26f3067dd1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:18.200091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-94ee65c3-57e5-4737-8b89-4c26f3067dd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05eedd777eda4237bbb834664f74b085', 'request_id': 'req-94ee65c3-57e5-4737-8b89-4c26f3067dd1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:18.212757 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-94ee65c3-57e5-4737-8b89-4c26f3067dd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05eedd777eda4237bbb834664f74b085', 'request_id': 'req-94ee65c3-57e5-4737-8b89-4c26f3067dd1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:18.226514 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-94ee65c3-57e5-4737-8b89-4c26f3067dd1 admin admin] The token cache is being invalidate because project 05eedd777eda4237bbb834664f74b085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:46:18.226802 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-94ee65c3-57e5-4737-8b89-4c26f3067dd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:18.227598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-94ee65c3-57e5-4737-8b89-4c26f3067dd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:18.229607 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1389/2831] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:46:17 2022] DELETE /identity/v3/projects/05eedd777eda4237bbb834664f74b085 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:18.234636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687dd6b-4481-40d2-8d99-f31b9b4dde35 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:18.234954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687dd6b-4481-40d2-8d99-f31b9b4dde35 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:18.235211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687dd6b-4481-40d2-8d99-f31b9b4dde35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:18.261236 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-0687dd6b-4481-40d2-8d99-f31b9b4dde35 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:18.262496 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0687dd6b-4481-40d2-8d99-f31b9b4dde35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:18.334181 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1443/2832] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:18.343811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b413d-e950-4f83-9e15-b02622e5a7c0 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:18.344500 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b413d-e950-4f83-9e15-b02622e5a7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:18.344854 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b413d-e950-4f83-9e15-b02622e5a7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:18.379529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4c4b413d-e950-4f83-9e15-b02622e5a7c0 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:18.381708 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4c4b413d-e950-4f83-9e15-b02622e5a7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:18.397582 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1390/2833] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:18.403064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687dd6b-4481-40d2-8d99-f31b9b4dde35 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:18.413817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687dd6b-4481-40d2-8d99-f31b9b4dde35 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:18.419367 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4db8a-29ca-4785-8024-34df5508d266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:18.420017 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4db8a-29ca-4785-8024-34df5508d266 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:18.420331 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4db8a-29ca-4785-8024-34df5508d266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:18.420647 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4db8a-29ca-4785-8024-34df5508d266 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:18.421313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4db8a-29ca-4785-8024-34df5508d266 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:46:18.421622 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4db8a-29ca-4785-8024-34df5508d266 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:18.423303 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4db8a-29ca-4785-8024-34df5508d266 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:18.437967 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1444/2834] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 10:46:18.445047 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b413d-e950-4f83-9e15-b02622e5a7c0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:18.455928 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:18.464787 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b413d-e950-4f83-9e15-b02622e5a7c0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:18.473009 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb9fab-780a-4a20-a43b-2dc7319fa731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:18.474306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb9fab-780a-4a20-a43b-2dc7319fa731 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:18.474752 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb9fab-780a-4a20-a43b-2dc7319fa731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:18.475468 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb9fab-780a-4a20-a43b-2dc7319fa731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:18.476355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb9fab-780a-4a20-a43b-2dc7319fa731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:18.479206 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb9fab-780a-4a20-a43b-2dc7319fa731 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:18.518703 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1391/2835] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:46:18 2022] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:18.523431 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4db8a-29ca-4785-8024-34df5508d266 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:18.540582 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4db8a-29ca-4785-8024-34df5508d266 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:18.576557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:18.621377 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a62f4-58e9-491d-a099-1f72789036af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:18.622316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a62f4-58e9-491d-a099-1f72789036af admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:18.622732 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a62f4-58e9-491d-a099-1f72789036af admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:18.623145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a62f4-58e9-491d-a099-1f72789036af admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:18.624245 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a62f4-58e9-491d-a099-1f72789036af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:18.628102 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a62f4-58e9-491d-a099-1f72789036af admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:18.655529 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1445/2836] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:46:18 2022] POST /identity/v3/users => generated 284 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 10:46:18.660605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb9fab-780a-4a20-a43b-2dc7319fa731 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:18.673455 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb9fab-780a-4a20-a43b-2dc7319fa731 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:18.678506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bff50-b6c2-420b-9319-458669331621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:18.679161 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bff50-b6c2-420b-9319-458669331621 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:18.679442 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bff50-b6c2-420b-9319-458669331621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:18.679717 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bff50-b6c2-420b-9319-458669331621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:18.680560 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bff50-b6c2-420b-9319-458669331621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:18.682748 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bff50-b6c2-420b-9319-458669331621 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:18.694562 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1392/2837] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:18.700659 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a62f4-58e9-491d-a099-1f72789036af admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:18.711879 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a62f4-58e9-491d-a099-1f72789036af admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:18.717248 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb58930-6814-48cb-b50a-a14b015e9ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:18.717758 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58930-6814-48cb-b50a-a14b015e9ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:18.718315 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58930-6814-48cb-b50a-a14b015e9ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:18.718592 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58930-6814-48cb-b50a-a14b015e9ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:18.719317 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb58930-6814-48cb-b50a-a14b015e9ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:18.721044 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb58930-6814-48cb-b50a-a14b015e9ca5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:18.733985 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1446/2838] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:18.738816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bff50-b6c2-420b-9319-458669331621 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:18.751079 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bff50-b6c2-420b-9319-458669331621 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:18.756124 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71596e-5092-48bd-b363-20ff19d1d982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:18.756849 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71596e-5092-48bd-b363-20ff19d1d982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:18.757138 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71596e-5092-48bd-b363-20ff19d1d982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:18.757418 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71596e-5092-48bd-b363-20ff19d1d982 admin admin] PATH_INFO: `/v3/projects/de0e2ed7fb6a4cfcb61f7873193ebca7/users/999c75056a20406da5cf0ec3f886ba37/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:18.774302 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71596e-5092-48bd-b363-20ff19d1d982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0e2ed7fb6a4cfcb61f7873193ebca7, user_id=999c75056a20406da5cf0ec3f886ba37, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:18.777311 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71596e-5092-48bd-b363-20ff19d1d982 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:18.793089 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1393/2839] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:46:18 2022] PUT /identity/v3/projects/de0e2ed7fb6a4cfcb61f7873193ebca7/users/999c75056a20406da5cf0ec3f886ba37/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:18.804782 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327963f-2c50-4a3c-8c26-da653e52d314 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:18.805224 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327963f-2c50-4a3c-8c26-da653e52d314 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:18.806404 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327963f-2c50-4a3c-8c26-da653e52d314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:18.856889 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e327963f-2c50-4a3c-8c26-da653e52d314 None None] MFA Rules not processed for user `999c75056a20406da5cf0ec3f886ba37`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:18.858966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e327963f-2c50-4a3c-8c26-da653e52d314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:18.961417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1447/2840] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:18.969700 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71596e-5092-48bd-b363-20ff19d1d982 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:19.057360 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71596e-5092-48bd-b363-20ff19d1d982 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:19.065834 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29466754-6b0c-40d0-80ed-77f1edec037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:19.066964 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29466754-6b0c-40d0-80ed-77f1edec037f admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:19.067483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29466754-6b0c-40d0-80ed-77f1edec037f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:19.067999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29466754-6b0c-40d0-80ed-77f1edec037f admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:19.069322 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29466754-6b0c-40d0-80ed-77f1edec037f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:19.073203 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29466754-6b0c-40d0-80ed-77f1edec037f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:19.116015 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1394/2841] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:46:18 2022] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:19.121480 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327963f-2c50-4a3c-8c26-da653e52d314 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:19.133494 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327963f-2c50-4a3c-8c26-da653e52d314 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:19.204221 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a8b69-0f8d-4d0b-9a9d-eefd3b110bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:19.205152 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a8b69-0f8d-4d0b-9a9d-eefd3b110bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:19.205535 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a8b69-0f8d-4d0b-9a9d-eefd3b110bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:19.205952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a8b69-0f8d-4d0b-9a9d-eefd3b110bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:19.207158 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a8b69-0f8d-4d0b-9a9d-eefd3b110bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:19.210135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a8b69-0f8d-4d0b-9a9d-eefd3b110bc5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:19.237649 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1448/2842] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:46:19 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:19.241971 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29466754-6b0c-40d0-80ed-77f1edec037f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:19.253403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29466754-6b0c-40d0-80ed-77f1edec037f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:19.258443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822498ed-757e-4eb4-b325-1ab5fe81383f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:19.259178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822498ed-757e-4eb4-b325-1ab5fe81383f admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:19.259483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822498ed-757e-4eb4-b325-1ab5fe81383f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:19.259923 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822498ed-757e-4eb4-b325-1ab5fe81383f admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:19.260677 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822498ed-757e-4eb4-b325-1ab5fe81383f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:19.262452 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822498ed-757e-4eb4-b325-1ab5fe81383f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:19.275625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1395/2843] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:19.280370 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a8b69-0f8d-4d0b-9a9d-eefd3b110bc5 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:19.292161 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a8b69-0f8d-4d0b-9a9d-eefd3b110bc5 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:19.297502 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69843e8-e952-42c6-926b-153c564f3895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:19.298208 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69843e8-e952-42c6-926b-153c564f3895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:19.298491 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69843e8-e952-42c6-926b-153c564f3895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:19.298769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69843e8-e952-42c6-926b-153c564f3895 admin admin] PATH_INFO: `/v3/projects/1917eaa3ec864af8aad2135cefbaf7e0/users/eb45186d5aaa441abb39b64c70da6cbb/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:19.316626 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69843e8-e952-42c6-926b-153c564f3895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1917eaa3ec864af8aad2135cefbaf7e0, user_id=eb45186d5aaa441abb39b64c70da6cbb, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:19.319430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69843e8-e952-42c6-926b-153c564f3895 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:19.336315 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1449/2844] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:46:19 2022] PUT /identity/v3/projects/1917eaa3ec864af8aad2135cefbaf7e0/users/eb45186d5aaa441abb39b64c70da6cbb/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:19.341162 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822498ed-757e-4eb4-b325-1ab5fe81383f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:19.352331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822498ed-757e-4eb4-b325-1ab5fe81383f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:19.423983 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b397655-3891-4c93-9289-5d17c5b7b3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:19.424702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b397655-3891-4c93-9289-5d17c5b7b3ca admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:19.424987 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b397655-3891-4c93-9289-5d17c5b7b3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:19.425269 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b397655-3891-4c93-9289-5d17c5b7b3ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:19.426036 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b397655-3891-4c93-9289-5d17c5b7b3ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:19.427695 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b397655-3891-4c93-9289-5d17c5b7b3ca admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:19.439463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1396/2845] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:19.444147 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69843e8-e952-42c6-926b-153c564f3895 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:19.450655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:19.458941 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69843e8-e952-42c6-926b-153c564f3895 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:19.465478 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e41d9-38ef-4067-8e99-f784a86f9c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:19.466373 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e41d9-38ef-4067-8e99-f784a86f9c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:19.466729 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e41d9-38ef-4067-8e99-f784a86f9c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:19.467051 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e41d9-38ef-4067-8e99-f784a86f9c2f admin admin] PATH_INFO: `/v3/projects/1917eaa3ec864af8aad2135cefbaf7e0/users/eb45186d5aaa441abb39b64c70da6cbb/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:19.469525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e41d9-38ef-4067-8e99-f784a86f9c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1917eaa3ec864af8aad2135cefbaf7e0, user_id=eb45186d5aaa441abb39b64c70da6cbb, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:19.472382 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e41d9-38ef-4067-8e99-f784a86f9c2f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:19.485649 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1450/2846] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:46:19 2022] PUT /identity/v3/projects/1917eaa3ec864af8aad2135cefbaf7e0/users/eb45186d5aaa441abb39b64c70da6cbb/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:19.499134 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5ebfa-f1cd-45a2-b3d4-e2bbb0cbad24 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:19.499387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5ebfa-f1cd-45a2-b3d4-e2bbb0cbad24 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:19.499696 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5ebfa-f1cd-45a2-b3d4-e2bbb0cbad24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:19.532921 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-04c5ebfa-f1cd-45a2-b3d4-e2bbb0cbad24 None None] MFA Rules not processed for user `eb45186d5aaa441abb39b64c70da6cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:19.534481 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-04c5ebfa-f1cd-45a2-b3d4-e2bbb0cbad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:19.541138 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:19.622824 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1397/2847] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:19.635204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e41d9-38ef-4067-8e99-f784a86f9c2f admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:19.637036 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-841e41d9-38ef-4067-8e99-f784a86f9c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:19.704071 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e41d9-38ef-4067-8e99-f784a86f9c2f admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:19.708302 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df211c-cd86-47a8-96c0-8b94f4471720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:19.708946 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df211c-cd86-47a8-96c0-8b94f4471720 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:19.709226 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df211c-cd86-47a8-96c0-8b94f4471720 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:19.709501 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df211c-cd86-47a8-96c0-8b94f4471720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:19.720965 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df211c-cd86-47a8-96c0-8b94f4471720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:19.722714 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df211c-cd86-47a8-96c0-8b94f4471720 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:19.733936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1451/2848] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:46:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:46:19.839316 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5ebfa-f1cd-45a2-b3d4-e2bbb0cbad24 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:19.851958 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5ebfa-f1cd-45a2-b3d4-e2bbb0cbad24 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:19.855803 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bc7bf-a1eb-4627-b56a-037e535163e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:19.856484 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bc7bf-a1eb-4627-b56a-037e535163e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:19.856771 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bc7bf-a1eb-4627-b56a-037e535163e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:19.857067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bc7bf-a1eb-4627-b56a-037e535163e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:19.924931 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bc7bf-a1eb-4627-b56a-037e535163e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:19.926417 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bc7bf-a1eb-4627-b56a-037e535163e7 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:19.937641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1398/2849] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:46:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:46:25.157851 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df211c-cd86-47a8-96c0-8b94f4471720 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:25.256426 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df211c-cd86-47a8-96c0-8b94f4471720 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:25.262227 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fa4b4-af73-4aad-ba2e-b12d218bce23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:25.262910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fa4b4-af73-4aad-ba2e-b12d218bce23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:25.263196 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fa4b4-af73-4aad-ba2e-b12d218bce23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:25.263470 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fa4b4-af73-4aad-ba2e-b12d218bce23 admin admin] PATH_INFO: `/v3/users/999c75056a20406da5cf0ec3f886ba37` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:25.264786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fa4b4-af73-4aad-ba2e-b12d218bce23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=999c75056a20406da5cf0ec3f886ba37)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:25.266770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fa4b4-af73-4aad-ba2e-b12d218bce23 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:25.325179 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-660fa4b4-af73-4aad-ba2e-b12d218bce23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999c75056a20406da5cf0ec3f886ba37'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:25.325877 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-660fa4b4-af73-4aad-ba2e-b12d218bce23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999c75056a20406da5cf0ec3f886ba37'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:25.333871 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-660fa4b4-af73-4aad-ba2e-b12d218bce23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999c75056a20406da5cf0ec3f886ba37'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:25.334763 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-660fa4b4-af73-4aad-ba2e-b12d218bce23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999c75056a20406da5cf0ec3f886ba37'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:25.350286 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-660fa4b4-af73-4aad-ba2e-b12d218bce23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999c75056a20406da5cf0ec3f886ba37'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:25.366886 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1452/2850] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:46:25 2022] DELETE /identity/v3/users/999c75056a20406da5cf0ec3f886ba37 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:25.372598 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cddd1f-1b0a-4414-91be-29fbf0f8f05a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:25.373235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cddd1f-1b0a-4414-91be-29fbf0f8f05a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:25.373235 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cddd1f-1b0a-4414-91be-29fbf0f8f05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:25.396925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a8cddd1f-1b0a-4414-91be-29fbf0f8f05a None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:25.398176 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a8cddd1f-1b0a-4414-91be-29fbf0f8f05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:25.469000 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1399/2851] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:25.481348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fa4b4-af73-4aad-ba2e-b12d218bce23 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:25.482865 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-660fa4b4-af73-4aad-ba2e-b12d218bce23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:25.499746 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:25.583667 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fa4b4-af73-4aad-ba2e-b12d218bce23 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:25.590517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27775a-3075-4314-9420-f27403c59268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:25.591624 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27775a-3075-4314-9420-f27403c59268 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:25.592330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27775a-3075-4314-9420-f27403c59268 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:25.592832 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27775a-3075-4314-9420-f27403c59268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:25.611811 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27775a-3075-4314-9420-f27403c59268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:25.614707 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27775a-3075-4314-9420-f27403c59268 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:25.631468 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1453/2852] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:46:25.993438 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cddd1f-1b0a-4414-91be-29fbf0f8f05a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:25.995835 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a8cddd1f-1b0a-4414-91be-29fbf0f8f05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:26.016244 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cddd1f-1b0a-4414-91be-29fbf0f8f05a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:26.021973 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74643048-2e06-493a-bacc-b5625a6bc4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:26.022702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74643048-2e06-493a-bacc-b5625a6bc4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:26.023115 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74643048-2e06-493a-bacc-b5625a6bc4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:26.023522 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74643048-2e06-493a-bacc-b5625a6bc4a0 admin admin] PATH_INFO: `/v3/projects/de0e2ed7fb6a4cfcb61f7873193ebca7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:26.025799 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74643048-2e06-493a-bacc-b5625a6bc4a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de0e2ed7fb6a4cfcb61f7873193ebca7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:26.029067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74643048-2e06-493a-bacc-b5625a6bc4a0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:26.080482 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:26.092016 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-74643048-2e06-493a-bacc-b5625a6bc4a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de0e2ed7fb6a4cfcb61f7873193ebca7', 'request_id': 'req-74643048-2e06-493a-bacc-b5625a6bc4a0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:26.100464 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-74643048-2e06-493a-bacc-b5625a6bc4a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de0e2ed7fb6a4cfcb61f7873193ebca7', 'request_id': 'req-74643048-2e06-493a-bacc-b5625a6bc4a0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:26.111611 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-74643048-2e06-493a-bacc-b5625a6bc4a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de0e2ed7fb6a4cfcb61f7873193ebca7', 'request_id': 'req-74643048-2e06-493a-bacc-b5625a6bc4a0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:26.132302 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-74643048-2e06-493a-bacc-b5625a6bc4a0 admin admin] The token cache is being invalidate because project de0e2ed7fb6a4cfcb61f7873193ebca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:46:26.132832 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-74643048-2e06-493a-bacc-b5625a6bc4a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:26.133966 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-74643048-2e06-493a-bacc-b5625a6bc4a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:26.136735 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1400/2853] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:46:25 2022] DELETE /identity/v3/projects/de0e2ed7fb6a4cfcb61f7873193ebca7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:26.144348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27775a-3075-4314-9420-f27403c59268 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:26.162806 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27775a-3075-4314-9420-f27403c59268 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:26.264430 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dab1c9-b11f-4116-b65e-c60e1a337f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:26.265099 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dab1c9-b11f-4116-b65e-c60e1a337f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:26.265492 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dab1c9-b11f-4116-b65e-c60e1a337f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:26.265920 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dab1c9-b11f-4116-b65e-c60e1a337f00 admin admin] PATH_INFO: `/v3/users/eb45186d5aaa441abb39b64c70da6cbb` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:26.267477 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dab1c9-b11f-4116-b65e-c60e1a337f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb45186d5aaa441abb39b64c70da6cbb)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:26.270484 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dab1c9-b11f-4116-b65e-c60e1a337f00 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:26.331636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-74dab1c9-b11f-4116-b65e-c60e1a337f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb45186d5aaa441abb39b64c70da6cbb'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:26.332527 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-74dab1c9-b11f-4116-b65e-c60e1a337f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb45186d5aaa441abb39b64c70da6cbb'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:26.340711 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-74dab1c9-b11f-4116-b65e-c60e1a337f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb45186d5aaa441abb39b64c70da6cbb'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:26.341515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-74dab1c9-b11f-4116-b65e-c60e1a337f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb45186d5aaa441abb39b64c70da6cbb'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:26.356843 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-74dab1c9-b11f-4116-b65e-c60e1a337f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb45186d5aaa441abb39b64c70da6cbb'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:26.373346 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1454/2854] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:46:26 2022] DELETE /identity/v3/users/eb45186d5aaa441abb39b64c70da6cbb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:26.736100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74643048-2e06-493a-bacc-b5625a6bc4a0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:26.738704 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-74643048-2e06-493a-bacc-b5625a6bc4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:26.758393 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74643048-2e06-493a-bacc-b5625a6bc4a0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:26.835115 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa032fe-ef19-4a59-97d2-de35e22c8977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:26.835858 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa032fe-ef19-4a59-97d2-de35e22c8977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:26.836141 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa032fe-ef19-4a59-97d2-de35e22c8977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:26.836457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa032fe-ef19-4a59-97d2-de35e22c8977 admin admin] PATH_INFO: `/v3/projects/1917eaa3ec864af8aad2135cefbaf7e0` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:26.838851 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa032fe-ef19-4a59-97d2-de35e22c8977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1917eaa3ec864af8aad2135cefbaf7e0)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:26.840831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa032fe-ef19-4a59-97d2-de35e22c8977 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:26.901222 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5aa032fe-ef19-4a59-97d2-de35e22c8977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1917eaa3ec864af8aad2135cefbaf7e0', 'request_id': 'req-5aa032fe-ef19-4a59-97d2-de35e22c8977'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:26.908395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5aa032fe-ef19-4a59-97d2-de35e22c8977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1917eaa3ec864af8aad2135cefbaf7e0', 'request_id': 'req-5aa032fe-ef19-4a59-97d2-de35e22c8977'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:26.918173 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5aa032fe-ef19-4a59-97d2-de35e22c8977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1917eaa3ec864af8aad2135cefbaf7e0', 'request_id': 'req-5aa032fe-ef19-4a59-97d2-de35e22c8977'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:26.931182 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5aa032fe-ef19-4a59-97d2-de35e22c8977 admin admin] The token cache is being invalidate because project 1917eaa3ec864af8aad2135cefbaf7e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:46:26.931506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5aa032fe-ef19-4a59-97d2-de35e22c8977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:26.932480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5aa032fe-ef19-4a59-97d2-de35e22c8977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:26.934147 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1401/2855] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:46:26 2022] DELETE /identity/v3/projects/1917eaa3ec864af8aad2135cefbaf7e0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:26.939532 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406bdcd-942f-481f-8736-7a575454f605 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:26.939821 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406bdcd-942f-481f-8736-7a575454f605 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:26.940079 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406bdcd-942f-481f-8736-7a575454f605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:26.963838 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7406bdcd-942f-481f-8736-7a575454f605 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:26.965154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7406bdcd-942f-481f-8736-7a575454f605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:27.001194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:27.039549 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1455/2856] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:27.048653 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d25ff6-dbab-4760-9a3d-8e6ac9a350dd None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:27.048967 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d25ff6-dbab-4760-9a3d-8e6ac9a350dd None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:27.049247 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d25ff6-dbab-4760-9a3d-8e6ac9a350dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:27.072331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-11d25ff6-dbab-4760-9a3d-8e6ac9a350dd None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:27.074352 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-11d25ff6-dbab-4760-9a3d-8e6ac9a350dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:27.082660 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1402/2857] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:27.087874 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406bdcd-942f-481f-8736-7a575454f605 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:27.099077 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406bdcd-942f-481f-8736-7a575454f605 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:27.104425 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd4ab5-613d-4f27-8fdb-7c6bad4d5e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:27.105086 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd4ab5-613d-4f27-8fdb-7c6bad4d5e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:27.105370 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd4ab5-613d-4f27-8fdb-7c6bad4d5e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:27.105649 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd4ab5-613d-4f27-8fdb-7c6bad4d5e7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:27.106363 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd4ab5-613d-4f27-8fdb-7c6bad4d5e7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:46:27.106688 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd4ab5-613d-4f27-8fdb-7c6bad4d5e7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:27.108349 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd4ab5-613d-4f27-8fdb-7c6bad4d5e7c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:27.121484 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1456/2858] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:46:27.126263 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d25ff6-dbab-4760-9a3d-8e6ac9a350dd None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:27.137207 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d25ff6-dbab-4760-9a3d-8e6ac9a350dd None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:27.142149 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba91522-1080-4048-a462-2bdff21c7bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:27.142786 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba91522-1080-4048-a462-2bdff21c7bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:27.143067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba91522-1080-4048-a462-2bdff21c7bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:27.143344 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba91522-1080-4048-a462-2bdff21c7bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:27.144032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba91522-1080-4048-a462-2bdff21c7bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:27.146014 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba91522-1080-4048-a462-2bdff21c7bc9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:27.185811 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1403/2859] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:46:27 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:27.192393 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd4ab5-613d-4f27-8fdb-7c6bad4d5e7c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:27.212333 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd4ab5-613d-4f27-8fdb-7c6bad4d5e7c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:27.320835 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922acaa8-3f92-4075-a87f-555c8696cf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:27.322028 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922acaa8-3f92-4075-a87f-555c8696cf27 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:27.322311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922acaa8-3f92-4075-a87f-555c8696cf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:27.322583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922acaa8-3f92-4075-a87f-555c8696cf27 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:27.323267 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922acaa8-3f92-4075-a87f-555c8696cf27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:27.325306 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922acaa8-3f92-4075-a87f-555c8696cf27 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:27.350636 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1457/2860] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:46:27 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:27.355625 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba91522-1080-4048-a462-2bdff21c7bc9 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:27.367166 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba91522-1080-4048-a462-2bdff21c7bc9 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:27.374210 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e0288-2402-4a97-bedb-631066abe050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:27.375041 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e0288-2402-4a97-bedb-631066abe050 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:27.375454 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e0288-2402-4a97-bedb-631066abe050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:27.375816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e0288-2402-4a97-bedb-631066abe050 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:27.376712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e0288-2402-4a97-bedb-631066abe050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:27.378428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e0288-2402-4a97-bedb-631066abe050 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:27.391848 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1404/2861] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:27.396837 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922acaa8-3f92-4075-a87f-555c8696cf27 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:27.408465 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922acaa8-3f92-4075-a87f-555c8696cf27 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:27.413622 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ef8fa-473f-4920-8e2c-d162f51a3dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:27.414277 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef8fa-473f-4920-8e2c-d162f51a3dbe admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:27.414569 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef8fa-473f-4920-8e2c-d162f51a3dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:27.414887 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ef8fa-473f-4920-8e2c-d162f51a3dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:27.415612 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ef8fa-473f-4920-8e2c-d162f51a3dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:27.417322 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ef8fa-473f-4920-8e2c-d162f51a3dbe admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:27.429865 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1458/2862] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:27.434827 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e0288-2402-4a97-bedb-631066abe050 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:27.445600 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e0288-2402-4a97-bedb-631066abe050 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:27.451373 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a641aa4-2c3a-4a0f-b562-a67844d2f6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:27.452093 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a641aa4-2c3a-4a0f-b562-a67844d2f6b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:27.452419 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a641aa4-2c3a-4a0f-b562-a67844d2f6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:27.452701 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a641aa4-2c3a-4a0f-b562-a67844d2f6b7 admin admin] PATH_INFO: `/v3/projects/044ccd62e0104e3989b5c97ae310ac3a/users/25d19ee969ab4f17a162282acb3ac4c4/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:27.467251 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:27.471513 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a641aa4-2c3a-4a0f-b562-a67844d2f6b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=044ccd62e0104e3989b5c97ae310ac3a, user_id=25d19ee969ab4f17a162282acb3ac4c4, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:27.474581 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a641aa4-2c3a-4a0f-b562-a67844d2f6b7 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:27.491355 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1405/2863] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:46:27 2022] PUT /identity/v3/projects/044ccd62e0104e3989b5c97ae310ac3a/users/25d19ee969ab4f17a162282acb3ac4c4/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:46:27.504103 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53cb61-0284-4c4a-a300-b114b4f63971 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:27.504448 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53cb61-0284-4c4a-a300-b114b4f63971 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:27.504694 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53cb61-0284-4c4a-a300-b114b4f63971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:27.536803 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-af53cb61-0284-4c4a-a300-b114b4f63971 None None] MFA Rules not processed for user `25d19ee969ab4f17a162282acb3ac4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:27.538535 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-af53cb61-0284-4c4a-a300-b114b4f63971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:27.642966 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1459/2864] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:27.644878 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a641aa4-2c3a-4a0f-b562-a67844d2f6b7 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:27.722504 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a641aa4-2c3a-4a0f-b562-a67844d2f6b7 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:27.727852 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62fcb1-8dff-4aa3-a36a-41631add68aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:27.728789 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62fcb1-8dff-4aa3-a36a-41631add68aa admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:27.728980 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62fcb1-8dff-4aa3-a36a-41631add68aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:27.729158 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62fcb1-8dff-4aa3-a36a-41631add68aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:27.729818 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62fcb1-8dff-4aa3-a36a-41631add68aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:27.731768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62fcb1-8dff-4aa3-a36a-41631add68aa admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:27.763536 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1406/2865] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:46:27 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:27.767846 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53cb61-0284-4c4a-a300-b114b4f63971 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:27.779722 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53cb61-0284-4c4a-a300-b114b4f63971 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:27.811601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:27.848812 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac741b46-2f99-442b-8ebc-8af9902351a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:27.849465 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac741b46-2f99-442b-8ebc-8af9902351a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:27.849744 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac741b46-2f99-442b-8ebc-8af9902351a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:27.850015 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac741b46-2f99-442b-8ebc-8af9902351a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:27.850690 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac741b46-2f99-442b-8ebc-8af9902351a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:27.853476 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac741b46-2f99-442b-8ebc-8af9902351a6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:27.879489 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1460/2866] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:46:27 2022] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:27.884616 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62fcb1-8dff-4aa3-a36a-41631add68aa admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:27.896544 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62fcb1-8dff-4aa3-a36a-41631add68aa admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:27.902719 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce3090-ead6-4a2f-b7ba-322cd4cbbf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:27.903365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce3090-ead6-4a2f-b7ba-322cd4cbbf60 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:27.903650 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce3090-ead6-4a2f-b7ba-322cd4cbbf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:27.903925 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce3090-ead6-4a2f-b7ba-322cd4cbbf60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:27.904687 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce3090-ead6-4a2f-b7ba-322cd4cbbf60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:27.906312 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce3090-ead6-4a2f-b7ba-322cd4cbbf60 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:27.920807 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1407/2867] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:27.925361 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac741b46-2f99-442b-8ebc-8af9902351a6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:27.938117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac741b46-2f99-442b-8ebc-8af9902351a6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:27.943193 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d8efc-4857-46bd-8a9a-cbb804308357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:27.943899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d8efc-4857-46bd-8a9a-cbb804308357 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:27.944213 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d8efc-4857-46bd-8a9a-cbb804308357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:27.944566 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d8efc-4857-46bd-8a9a-cbb804308357 admin admin] PATH_INFO: `/v3/projects/2514275d58644e02a08bb0fd5084392e/users/d041a08a7b1e409dbd958bc01bdad6a4/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:27.964574 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d8efc-4857-46bd-8a9a-cbb804308357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2514275d58644e02a08bb0fd5084392e, user_id=d041a08a7b1e409dbd958bc01bdad6a4, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:27.967438 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d8efc-4857-46bd-8a9a-cbb804308357 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:27.991915 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1461/2868] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:46:27 2022] PUT /identity/v3/projects/2514275d58644e02a08bb0fd5084392e/users/d041a08a7b1e409dbd958bc01bdad6a4/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:27.997768 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce3090-ead6-4a2f-b7ba-322cd4cbbf60 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:28.011114 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce3090-ead6-4a2f-b7ba-322cd4cbbf60 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:28.093892 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a5ce8-7135-4d2b-835c-b13ea07811c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:28.094921 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a5ce8-7135-4d2b-835c-b13ea07811c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:28.095403 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a5ce8-7135-4d2b-835c-b13ea07811c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:28.095886 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a5ce8-7135-4d2b-835c-b13ea07811c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:28.097178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a5ce8-7135-4d2b-835c-b13ea07811c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:28.100306 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a5ce8-7135-4d2b-835c-b13ea07811c0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:28.121529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1408/2869] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:28.125933 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d8efc-4857-46bd-8a9a-cbb804308357 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:28.138036 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d8efc-4857-46bd-8a9a-cbb804308357 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:28.143237 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5f54a-b267-4a1c-a37f-6a2beedc7e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:28.143952 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5f54a-b267-4a1c-a37f-6a2beedc7e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:28.144279 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5f54a-b267-4a1c-a37f-6a2beedc7e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:28.144562 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5f54a-b267-4a1c-a37f-6a2beedc7e09 admin admin] PATH_INFO: `/v3/projects/2514275d58644e02a08bb0fd5084392e/users/d041a08a7b1e409dbd958bc01bdad6a4/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:28.146748 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5f54a-b267-4a1c-a37f-6a2beedc7e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2514275d58644e02a08bb0fd5084392e, user_id=d041a08a7b1e409dbd958bc01bdad6a4, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:28.150474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5f54a-b267-4a1c-a37f-6a2beedc7e09 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:28.163052 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1462/2870] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:46:28 2022] PUT /identity/v3/projects/2514275d58644e02a08bb0fd5084392e/users/d041a08a7b1e409dbd958bc01bdad6a4/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:28.177365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef4554-78d3-4b24-8274-e876d1080898 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:28.177979 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef4554-78d3-4b24-8274-e876d1080898 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:28.178591 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef4554-78d3-4b24-8274-e876d1080898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:28.227098 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a0ef4554-78d3-4b24-8274-e876d1080898 None None] MFA Rules not processed for user `d041a08a7b1e409dbd958bc01bdad6a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:28.230017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a0ef4554-78d3-4b24-8274-e876d1080898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:28.315053 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:28.341003 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1409/2871] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:28.354123 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5f54a-b267-4a1c-a37f-6a2beedc7e09 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:28.355923 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-34c5f54a-b267-4a1c-a37f-6a2beedc7e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:28.426194 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5f54a-b267-4a1c-a37f-6a2beedc7e09 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:28.430186 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9cb2f-70d0-4c0b-a89d-9297406247ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:28.431157 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9cb2f-70d0-4c0b-a89d-9297406247ce service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:28.431438 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9cb2f-70d0-4c0b-a89d-9297406247ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:28.431717 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9cb2f-70d0-4c0b-a89d-9297406247ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:28.442422 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9cb2f-70d0-4c0b-a89d-9297406247ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:28.443897 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9cb2f-70d0-4c0b-a89d-9297406247ce service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:28.456585 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1463/2872] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:46:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:46:28.559078 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef4554-78d3-4b24-8274-e876d1080898 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:28.577371 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef4554-78d3-4b24-8274-e876d1080898 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:28.583531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add279c-0584-49cd-8ec3-6845fc7e5a98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:28.584640 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add279c-0584-49cd-8ec3-6845fc7e5a98 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:28.585123 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add279c-0584-49cd-8ec3-6845fc7e5a98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:28.585610 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add279c-0584-49cd-8ec3-6845fc7e5a98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:28.674063 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add279c-0584-49cd-8ec3-6845fc7e5a98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:28.675622 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add279c-0584-49cd-8ec3-6845fc7e5a98 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:28.687871 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1410/2873] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:46:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:46:29.008515 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9cb2f-70d0-4c0b-a89d-9297406247ce service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:29.083737 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9cb2f-70d0-4c0b-a89d-9297406247ce service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:29.088669 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cdb6e-0504-4d46-b844-80163ee3782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:29.089357 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cdb6e-0504-4d46-b844-80163ee3782b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:29.089641 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cdb6e-0504-4d46-b844-80163ee3782b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:29.089920 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cdb6e-0504-4d46-b844-80163ee3782b admin admin] PATH_INFO: `/v3/users/25d19ee969ab4f17a162282acb3ac4c4` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:29.091230 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cdb6e-0504-4d46-b844-80163ee3782b admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d19ee969ab4f17a162282acb3ac4c4)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:29.093835 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cdb6e-0504-4d46-b844-80163ee3782b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:29.128442 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:29.154577 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-323cdb6e-0504-4d46-b844-80163ee3782b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d19ee969ab4f17a162282acb3ac4c4'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:29.155409 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-323cdb6e-0504-4d46-b844-80163ee3782b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d19ee969ab4f17a162282acb3ac4c4'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:29.163924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-323cdb6e-0504-4d46-b844-80163ee3782b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d19ee969ab4f17a162282acb3ac4c4'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:29.165391 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-323cdb6e-0504-4d46-b844-80163ee3782b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d19ee969ab4f17a162282acb3ac4c4'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:29.183588 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-323cdb6e-0504-4d46-b844-80163ee3782b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d19ee969ab4f17a162282acb3ac4c4'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:29.198942 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1464/2874] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:46:29 2022] DELETE /identity/v3/users/25d19ee969ab4f17a162282acb3ac4c4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:29.203802 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af47542-37f6-4812-a693-af73aa956205 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:29.204490 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af47542-37f6-4812-a693-af73aa956205 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:29.204490 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af47542-37f6-4812-a693-af73aa956205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:29.225386 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-0af47542-37f6-4812-a693-af73aa956205 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:29.226648 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0af47542-37f6-4812-a693-af73aa956205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:29.308742 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1411/2875] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:29.319656 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cdb6e-0504-4d46-b844-80163ee3782b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:29.321288 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-323cdb6e-0504-4d46-b844-80163ee3782b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:29.390533 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cdb6e-0504-4d46-b844-80163ee3782b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:29.394512 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7652bac-97e2-4435-97dd-317abb2f0eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:29.395166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7652bac-97e2-4435-97dd-317abb2f0eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:29.395449 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7652bac-97e2-4435-97dd-317abb2f0eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:29.395728 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7652bac-97e2-4435-97dd-317abb2f0eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:29.407072 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7652bac-97e2-4435-97dd-317abb2f0eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:29.408867 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7652bac-97e2-4435-97dd-317abb2f0eb0 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:29.421200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1465/2876] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:46:29.768635 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af47542-37f6-4812-a693-af73aa956205 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:29.770346 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0af47542-37f6-4812-a693-af73aa956205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:29.789338 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af47542-37f6-4812-a693-af73aa956205 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:29.796202 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a70cf-f1b6-42f7-aa0f-578e79837b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:29.797947 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a70cf-f1b6-42f7-aa0f-578e79837b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:29.798336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a70cf-f1b6-42f7-aa0f-578e79837b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:29.798901 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a70cf-f1b6-42f7-aa0f-578e79837b16 admin admin] PATH_INFO: `/v3/projects/044ccd62e0104e3989b5c97ae310ac3a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:29.800567 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a70cf-f1b6-42f7-aa0f-578e79837b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=044ccd62e0104e3989b5c97ae310ac3a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:29.803155 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a70cf-f1b6-42f7-aa0f-578e79837b16 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:29.861209 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0b8a70cf-f1b6-42f7-aa0f-578e79837b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044ccd62e0104e3989b5c97ae310ac3a', 'request_id': 'req-0b8a70cf-f1b6-42f7-aa0f-578e79837b16'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:29.868892 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0b8a70cf-f1b6-42f7-aa0f-578e79837b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044ccd62e0104e3989b5c97ae310ac3a', 'request_id': 'req-0b8a70cf-f1b6-42f7-aa0f-578e79837b16'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:29.879012 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0b8a70cf-f1b6-42f7-aa0f-578e79837b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044ccd62e0104e3989b5c97ae310ac3a', 'request_id': 'req-0b8a70cf-f1b6-42f7-aa0f-578e79837b16'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:29.893017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0b8a70cf-f1b6-42f7-aa0f-578e79837b16 admin admin] The token cache is being invalidate because project 044ccd62e0104e3989b5c97ae310ac3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:46:29.893467 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0b8a70cf-f1b6-42f7-aa0f-578e79837b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:29.894365 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0b8a70cf-f1b6-42f7-aa0f-578e79837b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:29.896091 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1412/2877] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:46:29 2022] DELETE /identity/v3/projects/044ccd62e0104e3989b5c97ae310ac3a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:46:29.901945 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7652bac-97e2-4435-97dd-317abb2f0eb0 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:29.912724 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7652bac-97e2-4435-97dd-317abb2f0eb0 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:29.987183 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b53ed-6c5a-4e6e-b064-4f7183251a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:29.987863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b53ed-6c5a-4e6e-b064-4f7183251a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:29.988270 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b53ed-6c5a-4e6e-b064-4f7183251a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:29.988496 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b53ed-6c5a-4e6e-b064-4f7183251a1f admin admin] PATH_INFO: `/v3/users/d041a08a7b1e409dbd958bc01bdad6a4` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:29.990013 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b53ed-6c5a-4e6e-b064-4f7183251a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d041a08a7b1e409dbd958bc01bdad6a4)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:29.992200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b53ed-6c5a-4e6e-b064-4f7183251a1f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:30.051329 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e80b53ed-6c5a-4e6e-b064-4f7183251a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd041a08a7b1e409dbd958bc01bdad6a4'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:30.052034 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e80b53ed-6c5a-4e6e-b064-4f7183251a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd041a08a7b1e409dbd958bc01bdad6a4'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:30.053604 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:30.065751 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e80b53ed-6c5a-4e6e-b064-4f7183251a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd041a08a7b1e409dbd958bc01bdad6a4'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:30.066591 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e80b53ed-6c5a-4e6e-b064-4f7183251a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd041a08a7b1e409dbd958bc01bdad6a4'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:30.082372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e80b53ed-6c5a-4e6e-b064-4f7183251a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd041a08a7b1e409dbd958bc01bdad6a4'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:30.097867 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1466/2878] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:46:29 2022] DELETE /identity/v3/users/d041a08a7b1e409dbd958bc01bdad6a4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:30.427440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a70cf-f1b6-42f7-aa0f-578e79837b16 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:30.429841 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0b8a70cf-f1b6-42f7-aa0f-578e79837b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:30.449018 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a70cf-f1b6-42f7-aa0f-578e79837b16 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:30.454430 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:30.515969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335322f-31ee-489a-af31-93d37d636563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:30.516547 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335322f-31ee-489a-af31-93d37d636563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:30.516831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335322f-31ee-489a-af31-93d37d636563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:30.517111 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335322f-31ee-489a-af31-93d37d636563 admin admin] PATH_INFO: `/v3/projects/2514275d58644e02a08bb0fd5084392e` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:30.518324 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335322f-31ee-489a-af31-93d37d636563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2514275d58644e02a08bb0fd5084392e)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:30.520271 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335322f-31ee-489a-af31-93d37d636563 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:30.585559 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1335322f-31ee-489a-af31-93d37d636563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2514275d58644e02a08bb0fd5084392e', 'request_id': 'req-1335322f-31ee-489a-af31-93d37d636563'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:30.599705 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1335322f-31ee-489a-af31-93d37d636563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2514275d58644e02a08bb0fd5084392e', 'request_id': 'req-1335322f-31ee-489a-af31-93d37d636563'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:30.612733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1335322f-31ee-489a-af31-93d37d636563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2514275d58644e02a08bb0fd5084392e', 'request_id': 'req-1335322f-31ee-489a-af31-93d37d636563'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:30.632457 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1335322f-31ee-489a-af31-93d37d636563 admin admin] The token cache is being invalidate because project 2514275d58644e02a08bb0fd5084392e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:46:30.632993 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1335322f-31ee-489a-af31-93d37d636563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:30.634643 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1335322f-31ee-489a-af31-93d37d636563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:30.637432 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1413/2879] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:46:30 2022] DELETE /identity/v3/projects/2514275d58644e02a08bb0fd5084392e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:30.642601 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbd3fe-e64d-447d-a5d5-e422a2e16203 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:30.643127 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbd3fe-e64d-447d-a5d5-e422a2e16203 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:30.643254 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbd3fe-e64d-447d-a5d5-e422a2e16203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:30.665347 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-efcbd3fe-e64d-447d-a5d5-e422a2e16203 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:30.666583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-efcbd3fe-e64d-447d-a5d5-e422a2e16203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:30.743191 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1467/2880] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:46:30.751100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154e7cc-63f8-4f91-876d-41dcc9c2ea53 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:30.751364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154e7cc-63f8-4f91-876d-41dcc9c2ea53 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:30.751649 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154e7cc-63f8-4f91-876d-41dcc9c2ea53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:30.781135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a154e7cc-63f8-4f91-876d-41dcc9c2ea53 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:30.783159 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a154e7cc-63f8-4f91-876d-41dcc9c2ea53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:30.794124 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1414/2881] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:46:30.798700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbd3fe-e64d-447d-a5d5-e422a2e16203 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:30.809285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbd3fe-e64d-447d-a5d5-e422a2e16203 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:30.814340 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bed179-b008-4358-a94e-24ff4ead3ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:30.815064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bed179-b008-4358-a94e-24ff4ead3ffb admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:30.815347 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bed179-b008-4358-a94e-24ff4ead3ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:30.815625 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bed179-b008-4358-a94e-24ff4ead3ffb admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:30.816374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bed179-b008-4358-a94e-24ff4ead3ffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:46:30.816685 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bed179-b008-4358-a94e-24ff4ead3ffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:30.818330 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bed179-b008-4358-a94e-24ff4ead3ffb admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:30.832281 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1468/2882] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:46:30.838515 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154e7cc-63f8-4f91-876d-41dcc9c2ea53 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:30.849828 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154e7cc-63f8-4f91-876d-41dcc9c2ea53 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:30.855480 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03b2fb-341c-4393-a66c-57bb3e2241db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:30.856215 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03b2fb-341c-4393-a66c-57bb3e2241db admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:30.856584 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03b2fb-341c-4393-a66c-57bb3e2241db admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:30.856907 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03b2fb-341c-4393-a66c-57bb3e2241db admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:30.857683 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03b2fb-341c-4393-a66c-57bb3e2241db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:30.859746 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03b2fb-341c-4393-a66c-57bb3e2241db admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:30.895135 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1415/2883] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:46:30 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:30.896391 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bed179-b008-4358-a94e-24ff4ead3ffb admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:30.908062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bed179-b008-4358-a94e-24ff4ead3ffb admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:30.974982 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddbd8d-7ca8-4873-ae87-a6a07e0b6143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:30.975771 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddbd8d-7ca8-4873-ae87-a6a07e0b6143 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:30.976104 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddbd8d-7ca8-4873-ae87-a6a07e0b6143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:30.976456 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddbd8d-7ca8-4873-ae87-a6a07e0b6143 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:30.977414 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddbd8d-7ca8-4873-ae87-a6a07e0b6143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:30.979469 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddbd8d-7ca8-4873-ae87-a6a07e0b6143 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:31.004195 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1469/2884] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:46:30 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:31.009632 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03b2fb-341c-4393-a66c-57bb3e2241db admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:31.020885 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03b2fb-341c-4393-a66c-57bb3e2241db admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:31.026648 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05bdc8-1c48-4a53-b4be-039e8157414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:31.028110 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05bdc8-1c48-4a53-b4be-039e8157414c admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:31.028532 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05bdc8-1c48-4a53-b4be-039e8157414c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:31.028949 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05bdc8-1c48-4a53-b4be-039e8157414c admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:31.030110 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05bdc8-1c48-4a53-b4be-039e8157414c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:31.032646 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05bdc8-1c48-4a53-b4be-039e8157414c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:31.045253 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1416/2885] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:31.051009 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddbd8d-7ca8-4873-ae87-a6a07e0b6143 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:31.068157 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddbd8d-7ca8-4873-ae87-a6a07e0b6143 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:31.076460 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28343bef-f3ed-4e90-8827-0c1261c4f7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:31.077173 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28343bef-f3ed-4e90-8827-0c1261c4f7af admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:31.077539 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28343bef-f3ed-4e90-8827-0c1261c4f7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:31.077862 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28343bef-f3ed-4e90-8827-0c1261c4f7af admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:31.078701 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28343bef-f3ed-4e90-8827-0c1261c4f7af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:31.080639 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28343bef-f3ed-4e90-8827-0c1261c4f7af admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:31.094027 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1470/2886] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:31.098477 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05bdc8-1c48-4a53-b4be-039e8157414c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:31.111279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05bdc8-1c48-4a53-b4be-039e8157414c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:31.117428 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9546e0e-bda4-4992-92f8-d715c9464904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:31.118784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9546e0e-bda4-4992-92f8-d715c9464904 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:31.119102 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9546e0e-bda4-4992-92f8-d715c9464904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:31.119384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9546e0e-bda4-4992-92f8-d715c9464904 admin admin] PATH_INFO: `/v3/projects/fb4e2bbf757d4bf39b0925f66931c1e1/users/90965d9d22df45eebe0341fa2c8fd75b/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:31.137432 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9546e0e-bda4-4992-92f8-d715c9464904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb4e2bbf757d4bf39b0925f66931c1e1, user_id=90965d9d22df45eebe0341fa2c8fd75b, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:31.140298 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9546e0e-bda4-4992-92f8-d715c9464904 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:31.156858 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1417/2887] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:46:31 2022] PUT /identity/v3/projects/fb4e2bbf757d4bf39b0925f66931c1e1/users/90965d9d22df45eebe0341fa2c8fd75b/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:31.168975 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448751c-8473-419b-b073-98b920908949 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:31.169257 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448751c-8473-419b-b073-98b920908949 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:31.169529 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448751c-8473-419b-b073-98b920908949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:31.203243 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-9448751c-8473-419b-b073-98b920908949 None None] MFA Rules not processed for user `90965d9d22df45eebe0341fa2c8fd75b`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:31.204620 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9448751c-8473-419b-b073-98b920908949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:31.226402 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:31.287632 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1471/2888] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:46:31.293361 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9546e0e-bda4-4992-92f8-d715c9464904 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:31.346585 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:31.376433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9546e0e-bda4-4992-92f8-d715c9464904 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:31.382443 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06decebc-3dd9-4ece-83ee-c191aa887f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:31.383261 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06decebc-3dd9-4ece-83ee-c191aa887f82 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:31.383429 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06decebc-3dd9-4ece-83ee-c191aa887f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:31.383976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06decebc-3dd9-4ece-83ee-c191aa887f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:31.384706 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06decebc-3dd9-4ece-83ee-c191aa887f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:31.386668 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06decebc-3dd9-4ece-83ee-c191aa887f82 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:31.418930 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1418/2889] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:46:31 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:31.422703 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448751c-8473-419b-b073-98b920908949 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:31.435057 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448751c-8473-419b-b073-98b920908949 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:31.505082 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31fbc7-91e6-409a-9057-0d359cf8da3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:31.505733 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31fbc7-91e6-409a-9057-0d359cf8da3a admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:31.506015 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31fbc7-91e6-409a-9057-0d359cf8da3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:31.506295 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31fbc7-91e6-409a-9057-0d359cf8da3a admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:31.507014 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31fbc7-91e6-409a-9057-0d359cf8da3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:31.509205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31fbc7-91e6-409a-9057-0d359cf8da3a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:31.544671 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1472/2890] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:46:31 2022] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:31.545236 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06decebc-3dd9-4ece-83ee-c191aa887f82 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:31.557273 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06decebc-3dd9-4ece-83ee-c191aa887f82 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:31.565319 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3693f-e2db-4f6a-b654-5713ef1aa314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:31.566452 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3693f-e2db-4f6a-b654-5713ef1aa314 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:31.566997 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3693f-e2db-4f6a-b654-5713ef1aa314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:31.567521 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3693f-e2db-4f6a-b654-5713ef1aa314 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:31.568904 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3693f-e2db-4f6a-b654-5713ef1aa314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:31.572108 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3693f-e2db-4f6a-b654-5713ef1aa314 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:31.601816 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1419/2891] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:31.603651 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31fbc7-91e6-409a-9057-0d359cf8da3a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:31.620970 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31fbc7-91e6-409a-9057-0d359cf8da3a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:31.627910 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9e906-68fa-4283-bc30-3bc53a4708aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:31.628720 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9e906-68fa-4283-bc30-3bc53a4708aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:31.629036 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9e906-68fa-4283-bc30-3bc53a4708aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:31.629313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9e906-68fa-4283-bc30-3bc53a4708aa admin admin] PATH_INFO: `/v3/projects/631b87299eb149229c4d71da98b06808/users/b7d3f2e7e0b449728c7689c1d936ee6b/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:31.651510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9e906-68fa-4283-bc30-3bc53a4708aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=631b87299eb149229c4d71da98b06808, user_id=b7d3f2e7e0b449728c7689c1d936ee6b, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:31.656609 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9e906-68fa-4283-bc30-3bc53a4708aa admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:31.674926 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1473/2892] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:46:31 2022] PUT /identity/v3/projects/631b87299eb149229c4d71da98b06808/users/b7d3f2e7e0b449728c7689c1d936ee6b/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:31.680265 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3693f-e2db-4f6a-b654-5713ef1aa314 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:31.692440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3693f-e2db-4f6a-b654-5713ef1aa314 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:31.774550 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a6368-6f16-434a-8ba9-8c81b6af49a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:31.775858 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a6368-6f16-434a-8ba9-8c81b6af49a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:31.776387 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a6368-6f16-434a-8ba9-8c81b6af49a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:31.776847 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a6368-6f16-434a-8ba9-8c81b6af49a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:31.778119 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a6368-6f16-434a-8ba9-8c81b6af49a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:31.781433 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a6368-6f16-434a-8ba9-8c81b6af49a8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:31.796136 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1420/2893] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:31.799974 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9e906-68fa-4283-bc30-3bc53a4708aa admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:31.811702 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9e906-68fa-4283-bc30-3bc53a4708aa admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:31.817769 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80764086-67bb-4c99-ae62-f3920394080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:31.818473 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80764086-67bb-4c99-ae62-f3920394080c admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:31.818756 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80764086-67bb-4c99-ae62-f3920394080c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:31.819035 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80764086-67bb-4c99-ae62-f3920394080c admin admin] PATH_INFO: `/v3/projects/631b87299eb149229c4d71da98b06808/users/b7d3f2e7e0b449728c7689c1d936ee6b/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:31.821474 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80764086-67bb-4c99-ae62-f3920394080c admin admin] RBAC: Authorizing `identity:create_grant(project_id=631b87299eb149229c4d71da98b06808, user_id=b7d3f2e7e0b449728c7689c1d936ee6b, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:31.824493 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80764086-67bb-4c99-ae62-f3920394080c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:31.838847 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1474/2894] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:46:31 2022] PUT /identity/v3/projects/631b87299eb149229c4d71da98b06808/users/b7d3f2e7e0b449728c7689c1d936ee6b/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:31.851279 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478fd95-1081-4495-8aa5-da50f6e27326 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:31.851589 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478fd95-1081-4495-8aa5-da50f6e27326 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:31.851866 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478fd95-1081-4495-8aa5-da50f6e27326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:31.889839 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4478fd95-1081-4495-8aa5-da50f6e27326 None None] MFA Rules not processed for user `b7d3f2e7e0b449728c7689c1d936ee6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:31.891128 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4478fd95-1081-4495-8aa5-da50f6e27326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:32.001964 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1421/2895] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:32.014700 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80764086-67bb-4c99-ae62-f3920394080c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:32.017222 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-80764086-67bb-4c99-ae62-f3920394080c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:32.111911 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80764086-67bb-4c99-ae62-f3920394080c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:32.116612 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fb800-0bfc-43cc-9208-75e9a8a1ceb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:32.117265 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fb800-0bfc-43cc-9208-75e9a8a1ceb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:32.117552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fb800-0bfc-43cc-9208-75e9a8a1ceb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:32.117936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fb800-0bfc-43cc-9208-75e9a8a1ceb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:32.163375 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:32.211331 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fb800-0bfc-43cc-9208-75e9a8a1ceb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:32.213944 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fb800-0bfc-43cc-9208-75e9a8a1ceb9 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:32.226228 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1475/2896] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:46:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:46:36.771751 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478fd95-1081-4495-8aa5-da50f6e27326 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:36.773440 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4478fd95-1081-4495-8aa5-da50f6e27326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:36.787721 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478fd95-1081-4495-8aa5-da50f6e27326 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:36.792106 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f9d74-97e7-4c77-b270-b6989601185c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:36.792786 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f9d74-97e7-4c77-b270-b6989601185c service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:36.793065 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f9d74-97e7-4c77-b270-b6989601185c service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:36.793372 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f9d74-97e7-4c77-b270-b6989601185c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:36.803846 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f9d74-97e7-4c77-b270-b6989601185c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:36.806214 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f9d74-97e7-4c77-b270-b6989601185c service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:36.816836 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1422/2897] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:46:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:46:41.867829 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fb800-0bfc-43cc-9208-75e9a8a1ceb9 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:41.942892 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fb800-0bfc-43cc-9208-75e9a8a1ceb9 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:41.948873 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a63c9d-7fd3-47d0-bf5f-6388178b8fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:41.949552 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a63c9d-7fd3-47d0-bf5f-6388178b8fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:41.949832 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a63c9d-7fd3-47d0-bf5f-6388178b8fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:41.950111 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a63c9d-7fd3-47d0-bf5f-6388178b8fd6 admin admin] PATH_INFO: `/v3/users/90965d9d22df45eebe0341fa2c8fd75b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:41.951650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a63c9d-7fd3-47d0-bf5f-6388178b8fd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90965d9d22df45eebe0341fa2c8fd75b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:41.954302 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a63c9d-7fd3-47d0-bf5f-6388178b8fd6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:42.022684 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d3a63c9d-7fd3-47d0-bf5f-6388178b8fd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90965d9d22df45eebe0341fa2c8fd75b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:42.023439 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d3a63c9d-7fd3-47d0-bf5f-6388178b8fd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90965d9d22df45eebe0341fa2c8fd75b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:42.033906 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d3a63c9d-7fd3-47d0-bf5f-6388178b8fd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90965d9d22df45eebe0341fa2c8fd75b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:42.034658 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d3a63c9d-7fd3-47d0-bf5f-6388178b8fd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90965d9d22df45eebe0341fa2c8fd75b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:42.049165 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d3a63c9d-7fd3-47d0-bf5f-6388178b8fd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90965d9d22df45eebe0341fa2c8fd75b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:42.065570 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1476/2898] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:46:41 2022] DELETE /identity/v3/users/90965d9d22df45eebe0341fa2c8fd75b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:46:42.071587 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b74cbe-f7d9-4bce-aa47-e5a1187d3950 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:42.072938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b74cbe-f7d9-4bce-aa47-e5a1187d3950 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:42.072938 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b74cbe-f7d9-4bce-aa47-e5a1187d3950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:42.095041 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-f2b74cbe-f7d9-4bce-aa47-e5a1187d3950 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:42.096344 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f2b74cbe-f7d9-4bce-aa47-e5a1187d3950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:42.111315 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:42.174934 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1423/2899] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:42.186234 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a63c9d-7fd3-47d0-bf5f-6388178b8fd6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:42.187946 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d3a63c9d-7fd3-47d0-bf5f-6388178b8fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:42.253868 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:42.263557 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a63c9d-7fd3-47d0-bf5f-6388178b8fd6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:42.268539 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5de9a-72b3-4e0f-8c07-5022ee31cfad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:42.269211 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5de9a-72b3-4e0f-8c07-5022ee31cfad service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:42.269496 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5de9a-72b3-4e0f-8c07-5022ee31cfad service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:42.269775 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5de9a-72b3-4e0f-8c07-5022ee31cfad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:42.281250 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5de9a-72b3-4e0f-8c07-5022ee31cfad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:42.282855 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5de9a-72b3-4e0f-8c07-5022ee31cfad service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:42.295290 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1477/2900] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:46:42.640527 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b74cbe-f7d9-4bce-aa47-e5a1187d3950 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:42.642426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f2b74cbe-f7d9-4bce-aa47-e5a1187d3950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:42.656361 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b74cbe-f7d9-4bce-aa47-e5a1187d3950 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:42.661401 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec05fe-7f0b-4599-be61-cf2314779623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:42.662115 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec05fe-7f0b-4599-be61-cf2314779623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:42.662396 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec05fe-7f0b-4599-be61-cf2314779623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:42.662666 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec05fe-7f0b-4599-be61-cf2314779623 admin admin] PATH_INFO: `/v3/projects/fb4e2bbf757d4bf39b0925f66931c1e1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:42.664015 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec05fe-7f0b-4599-be61-cf2314779623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb4e2bbf757d4bf39b0925f66931c1e1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:42.666287 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec05fe-7f0b-4599-be61-cf2314779623 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:42.728638 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f0ec05fe-7f0b-4599-be61-cf2314779623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb4e2bbf757d4bf39b0925f66931c1e1', 'request_id': 'req-f0ec05fe-7f0b-4599-be61-cf2314779623'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:42.735720 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f0ec05fe-7f0b-4599-be61-cf2314779623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb4e2bbf757d4bf39b0925f66931c1e1', 'request_id': 'req-f0ec05fe-7f0b-4599-be61-cf2314779623'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:42.745348 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f0ec05fe-7f0b-4599-be61-cf2314779623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb4e2bbf757d4bf39b0925f66931c1e1', 'request_id': 'req-f0ec05fe-7f0b-4599-be61-cf2314779623'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:42.757983 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f0ec05fe-7f0b-4599-be61-cf2314779623 admin admin] The token cache is being invalidate because project fb4e2bbf757d4bf39b0925f66931c1e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:46:42.758831 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f0ec05fe-7f0b-4599-be61-cf2314779623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:42.759657 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f0ec05fe-7f0b-4599-be61-cf2314779623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:42.761439 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1424/2901] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:46:42 2022] DELETE /identity/v3/projects/fb4e2bbf757d4bf39b0925f66931c1e1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:42.765919 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5de9a-72b3-4e0f-8c07-5022ee31cfad service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:42.777390 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5de9a-72b3-4e0f-8c07-5022ee31cfad service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:42.842935 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c41f29-9910-46f1-9d67-fd7afcaaf2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:42.843876 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c41f29-9910-46f1-9d67-fd7afcaaf2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:42.844160 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c41f29-9910-46f1-9d67-fd7afcaaf2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:42.844482 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c41f29-9910-46f1-9d67-fd7afcaaf2bb admin admin] PATH_INFO: `/v3/users/b7d3f2e7e0b449728c7689c1d936ee6b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:42.845812 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c41f29-9910-46f1-9d67-fd7afcaaf2bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d3f2e7e0b449728c7689c1d936ee6b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:42.847945 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c41f29-9910-46f1-9d67-fd7afcaaf2bb admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:42.907965 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-19c41f29-9910-46f1-9d67-fd7afcaaf2bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d3f2e7e0b449728c7689c1d936ee6b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:42.909074 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-19c41f29-9910-46f1-9d67-fd7afcaaf2bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d3f2e7e0b449728c7689c1d936ee6b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:42.917068 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-19c41f29-9910-46f1-9d67-fd7afcaaf2bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d3f2e7e0b449728c7689c1d936ee6b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:42.917804 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-19c41f29-9910-46f1-9d67-fd7afcaaf2bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d3f2e7e0b449728c7689c1d936ee6b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:42.931561 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-19c41f29-9910-46f1-9d67-fd7afcaaf2bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d3f2e7e0b449728c7689c1d936ee6b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:42.947823 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1478/2902] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:46:42 2022] DELETE /identity/v3/users/b7d3f2e7e0b449728c7689c1d936ee6b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:46:43.305725 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec05fe-7f0b-4599-be61-cf2314779623 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:43.308147 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f0ec05fe-7f0b-4599-be61-cf2314779623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:43.334343 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec05fe-7f0b-4599-be61-cf2314779623 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:43.413532 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaacda5-e712-42ab-a94d-21c9b58446a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:43.414199 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaacda5-e712-42ab-a94d-21c9b58446a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:43.415067 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaacda5-e712-42ab-a94d-21c9b58446a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:43.416097 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaacda5-e712-42ab-a94d-21c9b58446a0 admin admin] PATH_INFO: `/v3/projects/631b87299eb149229c4d71da98b06808` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:43.417450 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaacda5-e712-42ab-a94d-21c9b58446a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=631b87299eb149229c4d71da98b06808)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:43.419409 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaacda5-e712-42ab-a94d-21c9b58446a0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:43.483331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:43.490918 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ceaacda5-e712-42ab-a94d-21c9b58446a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '631b87299eb149229c4d71da98b06808', 'request_id': 'req-ceaacda5-e712-42ab-a94d-21c9b58446a0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:43.501545 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ceaacda5-e712-42ab-a94d-21c9b58446a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '631b87299eb149229c4d71da98b06808', 'request_id': 'req-ceaacda5-e712-42ab-a94d-21c9b58446a0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:43.511622 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ceaacda5-e712-42ab-a94d-21c9b58446a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '631b87299eb149229c4d71da98b06808', 'request_id': 'req-ceaacda5-e712-42ab-a94d-21c9b58446a0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:43.523788 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ceaacda5-e712-42ab-a94d-21c9b58446a0 admin admin] The token cache is being invalidate because project 631b87299eb149229c4d71da98b06808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:46:43.524301 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ceaacda5-e712-42ab-a94d-21c9b58446a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:43.524842 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ceaacda5-e712-42ab-a94d-21c9b58446a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:43.526411 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1425/2903] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:46:43 2022] DELETE /identity/v3/projects/631b87299eb149229c4d71da98b06808 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:43.532799 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3cbcb-cc5d-4e06-a97e-6916af8edfe8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:43.533801 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3cbcb-cc5d-4e06-a97e-6916af8edfe8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:43.534390 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3cbcb-cc5d-4e06-a97e-6916af8edfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:43.558423 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8df3cbcb-cc5d-4e06-a97e-6916af8edfe8 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:43.560457 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8df3cbcb-cc5d-4e06-a97e-6916af8edfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:43.637675 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1479/2904] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:43.648463 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7fb05-18a1-4603-a2e4-7c9da8a34e6b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:43.649238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7fb05-18a1-4603-a2e4-7c9da8a34e6b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:43.649238 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7fb05-18a1-4603-a2e4-7c9da8a34e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:43.672310 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-2ed7fb05-18a1-4603-a2e4-7c9da8a34e6b None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:43.673483 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2ed7fb05-18a1-4603-a2e4-7c9da8a34e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:43.682944 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1426/2905] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:43.690268 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3cbcb-cc5d-4e06-a97e-6916af8edfe8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:43.710622 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3cbcb-cc5d-4e06-a97e-6916af8edfe8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:43.720370 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91472d-7c6b-4c80-a3a7-2736bf62b28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:43.721510 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91472d-7c6b-4c80-a3a7-2736bf62b28b admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:43.722025 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91472d-7c6b-4c80-a3a7-2736bf62b28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:43.722545 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91472d-7c6b-4c80-a3a7-2736bf62b28b admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:43.723916 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91472d-7c6b-4c80-a3a7-2736bf62b28b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 10:46:43.724558 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91472d-7c6b-4c80-a3a7-2736bf62b28b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:43.728440 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91472d-7c6b-4c80-a3a7-2736bf62b28b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:43.733145 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:43.754339 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1480/2906] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Aug 4 10:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 10:46:43.761322 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7fb05-18a1-4603-a2e4-7c9da8a34e6b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:43.771544 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7fb05-18a1-4603-a2e4-7c9da8a34e6b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:43.777570 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a292f-d021-47e8-b28e-3c77b35d8709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:43.778211 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a292f-d021-47e8-b28e-3c77b35d8709 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:43.778504 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a292f-d021-47e8-b28e-3c77b35d8709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:43.778784 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a292f-d021-47e8-b28e-3c77b35d8709 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:43.779489 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a292f-d021-47e8-b28e-3c77b35d8709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:43.781506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a292f-d021-47e8-b28e-3c77b35d8709 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:43.813543 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1427/2907] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:46:43 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:43.818608 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91472d-7c6b-4c80-a3a7-2736bf62b28b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:43.830686 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91472d-7c6b-4c80-a3a7-2736bf62b28b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:43.896650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d93bb-6700-4961-9399-a9cc3a0fe63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:43.897296 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d93bb-6700-4961-9399-a9cc3a0fe63f admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:43.897575 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d93bb-6700-4961-9399-a9cc3a0fe63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:43.897863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d93bb-6700-4961-9399-a9cc3a0fe63f admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:43.898548 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d93bb-6700-4961-9399-a9cc3a0fe63f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:43.901583 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d93bb-6700-4961-9399-a9cc3a0fe63f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:43.927900 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1481/2908] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:46:43 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:43.934405 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a292f-d021-47e8-b28e-3c77b35d8709 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:43.954168 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a292f-d021-47e8-b28e-3c77b35d8709 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:43.959895 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5ecd5-c874-4345-9048-c5f4e4c474f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:43.960578 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5ecd5-c874-4345-9048-c5f4e4c474f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:43.960865 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5ecd5-c874-4345-9048-c5f4e4c474f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:43.961150 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5ecd5-c874-4345-9048-c5f4e4c474f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:43.962667 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5ecd5-c874-4345-9048-c5f4e4c474f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:43.964292 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5ecd5-c874-4345-9048-c5f4e4c474f2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:43.976435 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1428/2909] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:43.981972 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d93bb-6700-4961-9399-a9cc3a0fe63f admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:43.998064 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d93bb-6700-4961-9399-a9cc3a0fe63f admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:44.004149 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6e4a8-0246-4a83-badf-9d77be51ef05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:44.004968 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6e4a8-0246-4a83-badf-9d77be51ef05 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:44.005313 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6e4a8-0246-4a83-badf-9d77be51ef05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:44.005638 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6e4a8-0246-4a83-badf-9d77be51ef05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:44.006401 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6e4a8-0246-4a83-badf-9d77be51ef05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:44.008415 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6e4a8-0246-4a83-badf-9d77be51ef05 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:44.021250 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1482/2910] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:44.026869 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5ecd5-c874-4345-9048-c5f4e4c474f2 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:44.040913 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5ecd5-c874-4345-9048-c5f4e4c474f2 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:44.046119 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f5111-f354-49bd-b11f-e197d4fc0bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:44.046818 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f5111-f354-49bd-b11f-e197d4fc0bee admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:44.047099 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f5111-f354-49bd-b11f-e197d4fc0bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:44.047377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f5111-f354-49bd-b11f-e197d4fc0bee admin admin] PATH_INFO: `/v3/projects/5af1ac3c93e54238ade648537e0c91ef/users/50a6669f5c2648329bb0fe5b700f21c9/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:44.066168 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f5111-f354-49bd-b11f-e197d4fc0bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af1ac3c93e54238ade648537e0c91ef, user_id=50a6669f5c2648329bb0fe5b700f21c9, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:44.068977 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f5111-f354-49bd-b11f-e197d4fc0bee admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:44.090220 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1429/2911] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:46:44 2022] PUT /identity/v3/projects/5af1ac3c93e54238ade648537e0c91ef/users/50a6669f5c2648329bb0fe5b700f21c9/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:46:44.103662 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e181-b03f-4e09-ae7c-001b6829ade8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:44.104002 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e181-b03f-4e09-ae7c-001b6829ade8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:44.104433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e181-b03f-4e09-ae7c-001b6829ade8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:44.139179 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a6b8e181-b03f-4e09-ae7c-001b6829ade8 None None] MFA Rules not processed for user `50a6669f5c2648329bb0fe5b700f21c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:44.140485 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a6b8e181-b03f-4e09-ae7c-001b6829ade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:44.225459 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1483/2912] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:44.230372 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f5111-f354-49bd-b11f-e197d4fc0bee admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:44.300342 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f5111-f354-49bd-b11f-e197d4fc0bee admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:44.305999 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d2f2a-824a-4d02-9d50-01765d6623f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:44.306712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d2f2a-824a-4d02-9d50-01765d6623f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:44.307002 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d2f2a-824a-4d02-9d50-01765d6623f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:44.307273 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d2f2a-824a-4d02-9d50-01765d6623f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:44.308037 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d2f2a-824a-4d02-9d50-01765d6623f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:44.310014 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d2f2a-824a-4d02-9d50-01765d6623f8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:44.349701 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1430/2913] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:46:44 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:44.354200 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8e181-b03f-4e09-ae7c-001b6829ade8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:44.367685 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8e181-b03f-4e09-ae7c-001b6829ade8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:44.443401 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e81aa-52d5-4281-97c6-7e00a394604c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:44.444075 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e81aa-52d5-4281-97c6-7e00a394604c admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:44.444388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e81aa-52d5-4281-97c6-7e00a394604c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:44.444668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e81aa-52d5-4281-97c6-7e00a394604c admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:44.445351 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e81aa-52d5-4281-97c6-7e00a394604c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:44.447922 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e81aa-52d5-4281-97c6-7e00a394604c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:44.462466 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:44.480103 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1484/2914] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:46:44 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:44.485710 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d2f2a-824a-4d02-9d50-01765d6623f8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:44.498337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d2f2a-824a-4d02-9d50-01765d6623f8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:44.504562 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fb643-af9b-4aaf-9737-bb43da30485c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:44.505263 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fb643-af9b-4aaf-9737-bb43da30485c admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:44.505605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fb643-af9b-4aaf-9737-bb43da30485c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:44.505924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fb643-af9b-4aaf-9737-bb43da30485c admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:44.506718 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fb643-af9b-4aaf-9737-bb43da30485c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:44.509435 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fb643-af9b-4aaf-9737-bb43da30485c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:44.521674 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1431/2915] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:46:44.528471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e81aa-52d5-4281-97c6-7e00a394604c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:44.541166 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e81aa-52d5-4281-97c6-7e00a394604c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:44.546648 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5569dd2-7293-467f-b58e-931d26d1e2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:44.547416 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5569dd2-7293-467f-b58e-931d26d1e2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:44.547795 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5569dd2-7293-467f-b58e-931d26d1e2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:44.548137 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5569dd2-7293-467f-b58e-931d26d1e2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:44.549024 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5569dd2-7293-467f-b58e-931d26d1e2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:44.550732 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5569dd2-7293-467f-b58e-931d26d1e2e2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:44.564159 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1485/2916] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:44.569092 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fb643-af9b-4aaf-9737-bb43da30485c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:44.580395 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fb643-af9b-4aaf-9737-bb43da30485c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:44.585413 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45002e-4109-4c52-aa28-89b488d9dee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:44.586104 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45002e-4109-4c52-aa28-89b488d9dee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:44.586381 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45002e-4109-4c52-aa28-89b488d9dee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:44.586659 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45002e-4109-4c52-aa28-89b488d9dee9 admin admin] PATH_INFO: `/v3/projects/94e4a4faef0f437380a6cf19b4683655/users/f50bdc9352524e2eb02fc9b2e6efa359/roles/50575a0d3f4340ee92356ce22ff3e62a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:44.605529 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45002e-4109-4c52-aa28-89b488d9dee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e4a4faef0f437380a6cf19b4683655, user_id=f50bdc9352524e2eb02fc9b2e6efa359, role_id=50575a0d3f4340ee92356ce22ff3e62a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:44.609982 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45002e-4109-4c52-aa28-89b488d9dee9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:44.631115 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1432/2917] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:46:44 2022] PUT /identity/v3/projects/94e4a4faef0f437380a6cf19b4683655/users/f50bdc9352524e2eb02fc9b2e6efa359/roles/50575a0d3f4340ee92356ce22ff3e62a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:46:44.643655 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9585c2-c9b2-422a-8404-6a654ff0dee4 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:44.643945 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9585c2-c9b2-422a-8404-6a654ff0dee4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:44.644414 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9585c2-c9b2-422a-8404-6a654ff0dee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:44.676889 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-cf9585c2-c9b2-422a-8404-6a654ff0dee4 None None] MFA Rules not processed for user `f50bdc9352524e2eb02fc9b2e6efa359`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:44.678154 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-cf9585c2-c9b2-422a-8404-6a654ff0dee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:44.773866 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1486/2918] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:44.780706 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45002e-4109-4c52-aa28-89b488d9dee9 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:44.804017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:44.863844 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45002e-4109-4c52-aa28-89b488d9dee9 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:44.870431 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5029b-7720-4537-8171-d3cc26b7d683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:44.871082 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5029b-7720-4537-8171-d3cc26b7d683 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:44.871364 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5029b-7720-4537-8171-d3cc26b7d683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:44.871641 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5029b-7720-4537-8171-d3cc26b7d683 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:44.872376 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5029b-7720-4537-8171-d3cc26b7d683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:44.874336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5029b-7720-4537-8171-d3cc26b7d683 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:44.905404 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1433/2919] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Aug 4 10:46:44 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:44.909745 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9585c2-c9b2-422a-8404-6a654ff0dee4 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:44.922563 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9585c2-c9b2-422a-8404-6a654ff0dee4 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:44.990440 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1c18e-fd70-434b-8121-9ce858109b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:44.991240 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1c18e-fd70-434b-8121-9ce858109b7c admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:44.991240 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1c18e-fd70-434b-8121-9ce858109b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:44.991500 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1c18e-fd70-434b-8121-9ce858109b7c admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:44.992204 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1c18e-fd70-434b-8121-9ce858109b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:44.995650 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1c18e-fd70-434b-8121-9ce858109b7c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:45.019770 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1487/2920] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Aug 4 10:46:44 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 10:46:45.025974 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5029b-7720-4537-8171-d3cc26b7d683 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:45.038179 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5029b-7720-4537-8171-d3cc26b7d683 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:45.044850 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11431b2c-c88e-4237-890d-637dec9d67b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:45.045739 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11431b2c-c88e-4237-890d-637dec9d67b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:45.046141 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11431b2c-c88e-4237-890d-637dec9d67b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:45.046515 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11431b2c-c88e-4237-890d-637dec9d67b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:45.047469 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11431b2c-c88e-4237-890d-637dec9d67b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:45.049453 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11431b2c-c88e-4237-890d-637dec9d67b3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:45.063076 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1434/2921] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 10:46:45.068287 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1c18e-fd70-434b-8121-9ce858109b7c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:45.080272 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1c18e-fd70-434b-8121-9ce858109b7c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:45.085694 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e62e83-6e05-4484-8c6e-663cef297d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:45.088381 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e62e83-6e05-4484-8c6e-663cef297d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:45.088754 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e62e83-6e05-4484-8c6e-663cef297d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:45.089078 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e62e83-6e05-4484-8c6e-663cef297d6c admin admin] PATH_INFO: `/v3/projects/f60770f20f9d46a89901e0ab28e1a58f/users/0481dac709fd400ba10e923c203281ab/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:45.109590 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e62e83-6e05-4484-8c6e-663cef297d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60770f20f9d46a89901e0ab28e1a58f, user_id=0481dac709fd400ba10e923c203281ab, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:45.112433 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e62e83-6e05-4484-8c6e-663cef297d6c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:45.129205 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1488/2922] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:46:45 2022] PUT /identity/v3/projects/f60770f20f9d46a89901e0ab28e1a58f/users/0481dac709fd400ba10e923c203281ab/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:45.138699 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11431b2c-c88e-4237-890d-637dec9d67b3 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:45.150877 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11431b2c-c88e-4237-890d-637dec9d67b3 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:45.220337 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181ff49-2af8-4492-b337-53d5f5a1c9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:45.221151 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181ff49-2af8-4492-b337-53d5f5a1c9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:45.221477 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181ff49-2af8-4492-b337-53d5f5a1c9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:45.221818 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181ff49-2af8-4492-b337-53d5f5a1c9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:45.222645 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181ff49-2af8-4492-b337-53d5f5a1c9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:45.224454 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181ff49-2af8-4492-b337-53d5f5a1c9d5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:45.236873 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1435/2923] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Aug 4 10:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 10:46:45.245029 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e62e83-6e05-4484-8c6e-663cef297d6c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:45.264555 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e62e83-6e05-4484-8c6e-663cef297d6c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:45.272808 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564ea98-7213-4018-aee5-297ad2e1319a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:45.274094 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564ea98-7213-4018-aee5-297ad2e1319a admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:45.274630 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564ea98-7213-4018-aee5-297ad2e1319a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:45.275117 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564ea98-7213-4018-aee5-297ad2e1319a admin admin] PATH_INFO: `/v3/projects/f60770f20f9d46a89901e0ab28e1a58f/users/0481dac709fd400ba10e923c203281ab/roles/66ac7d7d384e439995b1c4d3dc16f3b1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:45.278824 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564ea98-7213-4018-aee5-297ad2e1319a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60770f20f9d46a89901e0ab28e1a58f, user_id=0481dac709fd400ba10e923c203281ab, role_id=66ac7d7d384e439995b1c4d3dc16f3b1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:45.284048 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564ea98-7213-4018-aee5-297ad2e1319a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:45.298985 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1489/2924] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Aug 4 10:46:45 2022] PUT /identity/v3/projects/f60770f20f9d46a89901e0ab28e1a58f/users/0481dac709fd400ba10e923c203281ab/roles/66ac7d7d384e439995b1c4d3dc16f3b1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:45.312867 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cb580-beca-4ccf-ab33-108d4337a289 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:45.313452 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cb580-beca-4ccf-ab33-108d4337a289 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:45.313876 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cb580-beca-4ccf-ab33-108d4337a289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:45.364712 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a76cb580-beca-4ccf-ab33-108d4337a289 None None] MFA Rules not processed for user `0481dac709fd400ba10e923c203281ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:45.366806 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a76cb580-beca-4ccf-ab33-108d4337a289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:45.456631 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1436/2925] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 10:46:45.469673 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564ea98-7213-4018-aee5-297ad2e1319a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:45.472517 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2564ea98-7213-4018-aee5-297ad2e1319a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:45.508863 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:45.547119 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564ea98-7213-4018-aee5-297ad2e1319a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:45.551203 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd366b-a5d7-4a8d-8a30-4d6db4cc5474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:45.551899 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd366b-a5d7-4a8d-8a30-4d6db4cc5474 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:45.552325 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd366b-a5d7-4a8d-8a30-4d6db4cc5474 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:45.552656 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd366b-a5d7-4a8d-8a30-4d6db4cc5474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:45.648316 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd366b-a5d7-4a8d-8a30-4d6db4cc5474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:45.651668 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd366b-a5d7-4a8d-8a30-4d6db4cc5474 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:45.669920 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1490/2926] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:46:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:46:47.367032 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cb580-beca-4ccf-ab33-108d4337a289 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:47.370171 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a76cb580-beca-4ccf-ab33-108d4337a289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:47.391987 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cb580-beca-4ccf-ab33-108d4337a289 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:47.398323 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f03db-3a08-4e2a-ab6a-7d843583f1a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:47.400068 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f03db-3a08-4e2a-ab6a-7d843583f1a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:47.400600 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f03db-3a08-4e2a-ab6a-7d843583f1a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:47.401100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f03db-3a08-4e2a-ab6a-7d843583f1a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:47.417100 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:47.479065 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f03db-3a08-4e2a-ab6a-7d843583f1a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:47.480605 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f03db-3a08-4e2a-ab6a-7d843583f1a8 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:47.491004 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1437/2927] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:46:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:46:48.155273 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd366b-a5d7-4a8d-8a30-4d6db4cc5474 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:48.168936 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd366b-a5d7-4a8d-8a30-4d6db4cc5474 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:48.173402 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d09c14-157b-4a00-bbca-def5c8063e00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '180731bbc26c4681965dfd9cf0c1f063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:48.174097 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d09c14-157b-4a00-bbca-def5c8063e00 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:48.174417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d09c14-157b-4a00-bbca-def5c8063e00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:48.174817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d09c14-157b-4a00-bbca-def5c8063e00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:48.185457 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d09c14-157b-4a00-bbca-def5c8063e00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:48.186938 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d09c14-157b-4a00-bbca-def5c8063e00 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:48.199105 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1491/2928] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:46:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 10:46:52.411969 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f03db-3a08-4e2a-ab6a-7d843583f1a8 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:52.497829 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f03db-3a08-4e2a-ab6a-7d843583f1a8 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:52.502711 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b8665-7c9d-41e6-8b6a-6ea6caf947ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:52.503414 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b8665-7c9d-41e6-8b6a-6ea6caf947ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:52.503702 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b8665-7c9d-41e6-8b6a-6ea6caf947ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:52.503985 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b8665-7c9d-41e6-8b6a-6ea6caf947ad admin admin] PATH_INFO: `/v3/users/50a6669f5c2648329bb0fe5b700f21c9` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:52.505312 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b8665-7c9d-41e6-8b6a-6ea6caf947ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a6669f5c2648329bb0fe5b700f21c9)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:52.507291 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b8665-7c9d-41e6-8b6a-6ea6caf947ad admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:52.566050 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-554b8665-7c9d-41e6-8b6a-6ea6caf947ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a6669f5c2648329bb0fe5b700f21c9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:52.566775 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-554b8665-7c9d-41e6-8b6a-6ea6caf947ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a6669f5c2648329bb0fe5b700f21c9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:52.574533 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-554b8665-7c9d-41e6-8b6a-6ea6caf947ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a6669f5c2648329bb0fe5b700f21c9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:52.588273 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-554b8665-7c9d-41e6-8b6a-6ea6caf947ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a6669f5c2648329bb0fe5b700f21c9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:52.597377 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-554b8665-7c9d-41e6-8b6a-6ea6caf947ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a6669f5c2648329bb0fe5b700f21c9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:52.605010 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1438/2929] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:46:52 2022] DELETE /identity/v3/users/50a6669f5c2648329bb0fe5b700f21c9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 10:46:52.610278 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221b861-4c63-41fe-9116-5583c69d2473 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:52.610878 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221b861-4c63-41fe-9116-5583c69d2473 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:52.610878 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221b861-4c63-41fe-9116-5583c69d2473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:52.636388 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5221b861-4c63-41fe-9116-5583c69d2473 None None] MFA Rules not processed for user `d47a57563f9b4a2aa0de495b20f1a6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 10:46:52.637644 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5221b861-4c63-41fe-9116-5583c69d2473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:52.708870 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1492/2930] 10.222.0.48 () {58 vars in 958 bytes} [Thu Aug 4 10:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 10:46:52.720957 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b8665-7c9d-41e6-8b6a-6ea6caf947ad admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:52.723336 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-554b8665-7c9d-41e6-8b6a-6ea6caf947ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:52.791412 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:52.820492 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b8665-7c9d-41e6-8b6a-6ea6caf947ad admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:52.824976 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304cf73-cf52-4a8a-92a5-712e447ee31c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2021ac71491f4bebb0fbd91c533dc383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:52.825619 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304cf73-cf52-4a8a-92a5-712e447ee31c service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:52.825909 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304cf73-cf52-4a8a-92a5-712e447ee31c service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:52.826171 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304cf73-cf52-4a8a-92a5-712e447ee31c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:52.836695 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304cf73-cf52-4a8a-92a5-712e447ee31c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:52.838309 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304cf73-cf52-4a8a-92a5-712e447ee31c service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:52.849733 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1439/2931] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:46:53.201051 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221b861-4c63-41fe-9116-5583c69d2473 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:53.202569 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5221b861-4c63-41fe-9116-5583c69d2473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:53.220383 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221b861-4c63-41fe-9116-5583c69d2473 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:53.226135 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbb299-7e18-4382-95a4-4df949b5e2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:53.227786 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbb299-7e18-4382-95a4-4df949b5e2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:53.228292 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbb299-7e18-4382-95a4-4df949b5e2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:53.228721 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbb299-7e18-4382-95a4-4df949b5e2fd admin admin] PATH_INFO: `/v3/projects/5af1ac3c93e54238ade648537e0c91ef` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:53.230484 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbb299-7e18-4382-95a4-4df949b5e2fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af1ac3c93e54238ade648537e0c91ef)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:53.232817 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbb299-7e18-4382-95a4-4df949b5e2fd admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:53.287477 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4dcbb299-7e18-4382-95a4-4df949b5e2fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af1ac3c93e54238ade648537e0c91ef', 'request_id': 'req-4dcbb299-7e18-4382-95a4-4df949b5e2fd'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:53.294833 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4dcbb299-7e18-4382-95a4-4df949b5e2fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af1ac3c93e54238ade648537e0c91ef', 'request_id': 'req-4dcbb299-7e18-4382-95a4-4df949b5e2fd'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:53.305605 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4dcbb299-7e18-4382-95a4-4df949b5e2fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af1ac3c93e54238ade648537e0c91ef', 'request_id': 'req-4dcbb299-7e18-4382-95a4-4df949b5e2fd'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:53.307374 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:53.324407 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4dcbb299-7e18-4382-95a4-4df949b5e2fd admin admin] The token cache is being invalidate because project 5af1ac3c93e54238ade648537e0c91ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:46:53.324792 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4dcbb299-7e18-4382-95a4-4df949b5e2fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:53.325698 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4dcbb299-7e18-4382-95a4-4df949b5e2fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:53.327525 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1493/2932] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:46:53 2022] DELETE /identity/v3/projects/5af1ac3c93e54238ade648537e0c91ef => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:53.332017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304cf73-cf52-4a8a-92a5-712e447ee31c service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:53.342637 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304cf73-cf52-4a8a-92a5-712e447ee31c service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:53.407710 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6551c-4ad3-4171-876b-127a6776627b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:53.408458 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6551c-4ad3-4171-876b-127a6776627b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:53.408924 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6551c-4ad3-4171-876b-127a6776627b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:53.409313 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6551c-4ad3-4171-876b-127a6776627b admin admin] PATH_INFO: `/v3/users/f50bdc9352524e2eb02fc9b2e6efa359` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:53.410676 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6551c-4ad3-4171-876b-127a6776627b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f50bdc9352524e2eb02fc9b2e6efa359)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:53.412956 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6551c-4ad3-4171-876b-127a6776627b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:53.470997 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-60b6551c-4ad3-4171-876b-127a6776627b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f50bdc9352524e2eb02fc9b2e6efa359'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:53.471749 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-60b6551c-4ad3-4171-876b-127a6776627b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f50bdc9352524e2eb02fc9b2e6efa359'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:53.480446 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-60b6551c-4ad3-4171-876b-127a6776627b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f50bdc9352524e2eb02fc9b2e6efa359'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:53.493594 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-60b6551c-4ad3-4171-876b-127a6776627b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f50bdc9352524e2eb02fc9b2e6efa359'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:53.503127 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-60b6551c-4ad3-4171-876b-127a6776627b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f50bdc9352524e2eb02fc9b2e6efa359'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:53.510426 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1440/2933] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:46:53 2022] DELETE /identity/v3/users/f50bdc9352524e2eb02fc9b2e6efa359 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:53.882348 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbb299-7e18-4382-95a4-4df949b5e2fd admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:53.884704 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4dcbb299-7e18-4382-95a4-4df949b5e2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:53.898621 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbb299-7e18-4382-95a4-4df949b5e2fd admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:53.983367 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54993c80-c348-48fe-968c-3544456775ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:53.984044 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54993c80-c348-48fe-968c-3544456775ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:53.984372 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54993c80-c348-48fe-968c-3544456775ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:53.984724 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54993c80-c348-48fe-968c-3544456775ed admin admin] PATH_INFO: `/v3/projects/94e4a4faef0f437380a6cf19b4683655` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:53.985973 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54993c80-c348-48fe-968c-3544456775ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e4a4faef0f437380a6cf19b4683655)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:53.987967 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54993c80-c348-48fe-968c-3544456775ed admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:54.040961 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-54993c80-c348-48fe-968c-3544456775ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e4a4faef0f437380a6cf19b4683655', 'request_id': 'req-54993c80-c348-48fe-968c-3544456775ed'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:54.048214 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-54993c80-c348-48fe-968c-3544456775ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e4a4faef0f437380a6cf19b4683655', 'request_id': 'req-54993c80-c348-48fe-968c-3544456775ed'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:54.057896 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-54993c80-c348-48fe-968c-3544456775ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e4a4faef0f437380a6cf19b4683655', 'request_id': 'req-54993c80-c348-48fe-968c-3544456775ed'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:54.073242 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-54993c80-c348-48fe-968c-3544456775ed admin admin] The token cache is being invalidate because project 94e4a4faef0f437380a6cf19b4683655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:46:54.073538 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-54993c80-c348-48fe-968c-3544456775ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:54.074285 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-54993c80-c348-48fe-968c-3544456775ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:54.076016 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1494/2934] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:46:53 2022] DELETE /identity/v3/projects/94e4a4faef0f437380a6cf19b4683655 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:54.080424 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6551c-4ad3-4171-876b-127a6776627b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:54.082008 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-60b6551c-4ad3-4171-876b-127a6776627b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:54.097447 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6551c-4ad3-4171-876b-127a6776627b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:54.161331 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:54.174840 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d87f4-5a79-4d7c-ab0f-5ce1aaaab8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:54.175519 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d87f4-5a79-4d7c-ab0f-5ce1aaaab8da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:54.175802 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d87f4-5a79-4d7c-ab0f-5ce1aaaab8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:54.176080 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d87f4-5a79-4d7c-ab0f-5ce1aaaab8da admin admin] PATH_INFO: `/v3/users/0481dac709fd400ba10e923c203281ab` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:54.177466 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d87f4-5a79-4d7c-ab0f-5ce1aaaab8da admin admin] RBAC: Authorizing `identity:delete_user(user_id=0481dac709fd400ba10e923c203281ab)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:54.179436 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d87f4-5a79-4d7c-ab0f-5ce1aaaab8da admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:54.246384 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b00d87f4-5a79-4d7c-ab0f-5ce1aaaab8da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0481dac709fd400ba10e923c203281ab'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:54.247017 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b00d87f4-5a79-4d7c-ab0f-5ce1aaaab8da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0481dac709fd400ba10e923c203281ab'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:54.254940 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b00d87f4-5a79-4d7c-ab0f-5ce1aaaab8da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0481dac709fd400ba10e923c203281ab'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:54.269699 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b00d87f4-5a79-4d7c-ab0f-5ce1aaaab8da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0481dac709fd400ba10e923c203281ab'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:54.278893 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b00d87f4-5a79-4d7c-ab0f-5ce1aaaab8da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0481dac709fd400ba10e923c203281ab'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:54.285531 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1441/2935] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Aug 4 10:46:54 2022] DELETE /identity/v3/users/0481dac709fd400ba10e923c203281ab => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:46:54.612464 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54993c80-c348-48fe-968c-3544456775ed admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:46:54.615062 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-54993c80-c348-48fe-968c-3544456775ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:46:54.647098 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54993c80-c348-48fe-968c-3544456775ed admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:46:54.724311 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15cd76-dcf1-40e3-9a83-dd0862ff7abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd47a57563f9b4a2aa0de495b20f1a6be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5a4d067698404b8e986636ba77adc9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:46:54.725001 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15cd76-dcf1-40e3-9a83-dd0862ff7abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:46:54.725286 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15cd76-dcf1-40e3-9a83-dd0862ff7abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:46:54.725567 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15cd76-dcf1-40e3-9a83-dd0862ff7abd admin admin] PATH_INFO: `/v3/projects/f60770f20f9d46a89901e0ab28e1a58f` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:46:54.727839 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15cd76-dcf1-40e3-9a83-dd0862ff7abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60770f20f9d46a89901e0ab28e1a58f)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:46:54.729973 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15cd76-dcf1-40e3-9a83-dd0862ff7abd admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:46:54.761523 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:54.794954 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0f15cd76-dcf1-40e3-9a83-dd0862ff7abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60770f20f9d46a89901e0ab28e1a58f', 'request_id': 'req-0f15cd76-dcf1-40e3-9a83-dd0862ff7abd'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:54.811341 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0f15cd76-dcf1-40e3-9a83-dd0862ff7abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60770f20f9d46a89901e0ab28e1a58f', 'request_id': 'req-0f15cd76-dcf1-40e3-9a83-dd0862ff7abd'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:54.821032 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0f15cd76-dcf1-40e3-9a83-dd0862ff7abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60770f20f9d46a89901e0ab28e1a58f', 'request_id': 'req-0f15cd76-dcf1-40e3-9a83-dd0862ff7abd'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:54.839924 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0f15cd76-dcf1-40e3-9a83-dd0862ff7abd admin admin] The token cache is being invalidate because project f60770f20f9d46a89901e0ab28e1a58f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 10:46:54.840471 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0f15cd76-dcf1-40e3-9a83-dd0862ff7abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:54.841598 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0f15cd76-dcf1-40e3-9a83-dd0862ff7abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 10:46:54.844417 dv-cinder-826608-8-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1495/2936] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Aug 4 10:46:54 2022] DELETE /identity/v3/projects/f60770f20f9d46a89901e0ab28e1a58f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 10:47:04.281822 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:47:04.833938 dv-cinder-826608-8-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:49:25.720108 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d87f4-5a79-4d7c-ab0f-5ce1aaaab8da admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 10:49:25.721852 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b00d87f4-5a79-4d7c-ab0f-5ce1aaaab8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:49:25.794108 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d87f4-5a79-4d7c-ab0f-5ce1aaaab8da admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 10:49:25.855105 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb217046-7446-4cee-afcc-34a2d7eef041 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0005b0c9582e430e9cb85704a4505bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e37543156ee42a0818bf5cfe747fdc2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 10:49:25.855731 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb217046-7446-4cee-afcc-34a2d7eef041 service placement] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 10:49:25.856721 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb217046-7446-4cee-afcc-34a2d7eef041 service placement] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 10:49:25.857179 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb217046-7446-4cee-afcc-34a2d7eef041 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 10:49:25.859178 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fb217046-7446-4cee-afcc-34a2d7eef041 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 10:49:25.873006 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb217046-7446-4cee-afcc-34a2d7eef041 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 10:49:25.874680 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb217046-7446-4cee-afcc-34a2d7eef041 service placement] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 10:49:25.885506 dv-cinder-826608-8-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1442/2937] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Aug 4 10:49:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 10:49:35.880899 dv-cinder-826608-8-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=58 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}